2023-09-30T13:43:32.913 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T13:43:32.914 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589 --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} --name yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/orig.config.yaml 2023-09-30T13:43:32.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T13:43:33.049 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} email: yweinste@redhat.com first_in_suite: false job_id: '7407589' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: 1d10b71792f3be8887a7631e69851ac2df3585af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1d10b71792f3be8887a7631e69851ac2df3585af thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1d10b71792f3be8887a7631e69851ac2df3585af owner: scheduled_yuriw@teuthology priority: 76 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6478 sha1: 1d10b71792f3be8887a7631e69851ac2df3585af sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1d10b71792f3be8887a7631e69851ac2df3585af syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGZBAhHPuluu1uEAN7RJbWAWb9Rc1RiIZ09OFcjEkpCMJtg6ZtvAu6tQxSvbIICTn7Y1fDINEVlPDyrrlnSbM0= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRhBi4DeLtpJNYmZrP4yTEJzTwCziio4JdbwekYe9qRFGbHPgD3JmLuig9RWJKPhQGu+FfG8Rs+h7gr3F4C/q4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:46:13 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T13:43:33.049 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa; will attempt to use it 2023-09-30T13:43:33.050 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks 2023-09-30T13:43:33.050 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T13:43:33.052 INFO:teuthology.task.internal:Checking packages... 2023-09-30T13:43:33.075 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1d10b71792f3be8887a7631e69851ac2df3585af' 2023-09-30T13:43:33.075 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T13:43:33.075 INFO:teuthology.packaging:ref: None 2023-09-30T13:43:33.075 INFO:teuthology.packaging:tag: None 2023-09-30T13:43:33.075 INFO:teuthology.packaging:branch: main 2023-09-30T13:43:33.075 INFO:teuthology.packaging:sha1: 1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T13:43:33.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-09-30T13:43:33.295 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6447.g1d10b717 2023-09-30T13:43:33.295 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T13:43:33.302 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T13:43:33.302 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T13:43:33.318 INFO:teuthology.task.internal:Saving configuration 2023-09-30T13:43:33.334 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T13:43:33.340 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T13:43:33.365 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 13:38:18.811613', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGZBAhHPuluu1uEAN7RJbWAWb9Rc1RiIZ09OFcjEkpCMJtg6ZtvAu6tQxSvbIICTn7Y1fDINEVlPDyrrlnSbM0='} 2023-09-30T13:43:33.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 13:38:18.813095', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRhBi4DeLtpJNYmZrP4yTEJzTwCziio4JdbwekYe9qRFGbHPgD3JmLuig9RWJKPhQGu+FfG8Rs+h7gr3F4C/q4='} 2023-09-30T13:43:33.388 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T13:43:33.394 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-30T13:43:33.395 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-30T13:43:33.395 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T13:43:33.464 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff102579040>, signals=[15]) 2023-09-30T13:43:33.465 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T13:43:33.471 INFO:teuthology.task.internal:Opening connections... 2023-09-30T13:43:33.471 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:43:33.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:43:33.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:43:33.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:43:33.658 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T13:43:33.665 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-09-30T13:43:33.683 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-09-30T13:43:33.683 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-09-30T13:43:33.740 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-09-30T13:43:33.740 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-09-30T13:43:33.740 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-09-30T13:43:33.740 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-09-30T13:43:33.740 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T13:43:33.741 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T13:43:33.742 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-09-30T13:43:33.766 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-09-30T13:43:33.784 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-09-30T13:43:33.784 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-30T13:43:33.841 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-09-30T13:43:33.841 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2023-09-30T13:43:33.841 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-09-30T13:43:33.841 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-30T13:43:33.842 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T13:43:33.843 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-30T13:43:33.864 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T13:43:33.873 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T13:43:33.878 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T13:43:33.879 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2023-09-30T13:43:33.881 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-09-30T13:43:33.897 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T13:43:33.903 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T13:43:33.903 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2023-09-30T13:43:33.938 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-09-30T13:43:34.036 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T13:43:34.090 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T13:43:34.104 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T13:43:34.104 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T13:43:34.105 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T13:43:34.105 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T13:43:34.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:43:34.121 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-09-30T13:43:34.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:43:34.123 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2023-09-30T13:43:34.178 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-361.el9.x86_64 2023-09-30T13:43:34.178 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-361.el9.x86_64 2023-09-30T13:43:34.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2023-09-30T13:43:34.181 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-361.el9.x86_64 2023-09-30T13:43:34.181 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-361.el9.x86_64 2023-09-30T13:43:34.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2023-09-30T13:43:36.419 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-09-30T13:43:36.556 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.3 MB 00:00 2023-09-30T13:43:37.932 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-09-30T13:43:37.944 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-09-30T13:43:38.914 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.8 MB 00:00 2023-09-30T13:43:39.885 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 7.8 MB 00:01 2023-09-30T13:43:42.641 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 18 MB 00:02 2023-09-30T13:43:42.836 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 18 MB 00:01 2023-09-30T13:43:46.450 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.7 MB 00:00 2023-09-30T13:43:48.034 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 14 kB 00:00 2023-09-30T13:43:48.121 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.7 MB 00:01 2023-09-30T13:43:49.620 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 14 kB 00:00 2023-09-30T13:43:50.697 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 19 MB/s | 19 MB 00:00 2023-09-30T13:43:50.936 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 19 MB 00:02 2023-09-30T13:43:55.280 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2023-09-30T13:43:55.402 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-09-30T13:43:57.270 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-09-30T13:43:57.270 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-09-30T13:43:57.351 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2023-09-30T13:43:57.351 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-09-30T13:43:57.352 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-09-30T13:43:57.356 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2023-09-30T13:43:57.356 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2023-09-30T13:43:57.356 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2023-09-30T13:43:57.356 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-368.el9 baseos 5.1 M 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-368.el9 baseos 20 M 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-368.el9 baseos 37 M 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-368.el9 baseos 32 M 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2023-09-30T13:43:57.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:43:57.358 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 94 M 2023-09-30T13:43:57.358 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 120 M 2023-09-30T13:43:57.358 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2023-09-30T13:43:57.441 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-30T13:43:57.450 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-30T13:43:57.450 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2023-09-30T13:43:57.450 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-30T13:43:57.450 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-368.el9 baseos 5.1 M 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-368.el9 baseos 20 M 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-368.el9 baseos 37 M 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-368.el9 baseos 32 M 2023-09-30T13:43:57.451 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 94 M 2023-09-30T13:43:57.452 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 120 M 2023-09-30T13:43:57.453 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-09-30T13:43:57.846 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-368.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2023-09-30T13:43:58.180 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-368.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-09-30T13:43:58.631 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-368.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2023-09-30T13:43:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-5.14.0-368.el9.x86_64.rpm 31 MB/s | 37 MB 00:01 2023-09-30T13:43:59.114 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-core-5.14.0-368.el9.x86_6 25 MB/s | 32 MB 00:01 2023-09-30T13:43:59.114 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-09-30T13:43:59.114 INFO:teuthology.orchestra.run.smithi135.stdout:Total 56 MB/s | 94 MB 00:01 2023-09-30T13:43:59.590 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-core-5.14.0-368.el9.x86_64.rpm 9.0 MB/s | 20 MB 00:02 2023-09-30T13:43:59.950 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-09-30T13:44:00.265 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-5.14.0-368.el9.x86_64.rpm 13 MB/s | 37 MB 00:02 2023-09-30T13:44:00.318 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-09-30T13:44:00.319 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-09-30T13:44:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-core-5.14.0-368.el9.x86_6 16 MB/s | 32 MB 00:01 2023-09-30T13:44:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2023-09-30T13:44:00.599 INFO:teuthology.orchestra.run.smithi062.stdout:Total 29 MB/s | 94 MB 00:03 2023-09-30T13:44:01.468 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2023-09-30T13:44:01.582 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-09-30T13:44:01.582 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-09-30T13:44:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2023-09-30T13:44:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2023-09-30T13:44:03.257 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2023-09-30T13:44:03.257 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2023-09-30T13:44:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-09-30T13:44:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-368.el9.x86_64 1/4 2023-09-30T13:44:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:06.044 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2023-09-30T13:44:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-368.el9.x86_64 1/4 2023-09-30T13:44:06.831 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:07.958 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:08.138 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:09.705 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:09.985 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:12.758 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:12.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:17.591 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:20.103 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:46.524 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:46.567 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:47.000 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:47.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-368.el9.x86_64 1/4 2023-09-30T13:44:47.000 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:47.001 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:47.434 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:47.434 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:44:47.434 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-09-30T13:44:47.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:47.434 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-368.el9.x86_64 2023-09-30T13:44:47.435 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-368.el9.x86_64 2023-09-30T13:44:47.435 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-368.el9.x86_64 2023-09-30T13:44:47.435 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:44:47.435 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-30T13:44:47.940 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T13:44:48.071 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:48.072 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-368.el9.x86_64 2023-09-30T13:44:48.072 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-368.el9.x86_64 2023-09-30T13:44:48.072 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T13:44:48.072 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T13:44:48.072 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-09-30T13:44:48.072 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T13:44:48.073 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T13:44:48.185 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:48.186 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-368.el9.x86_64 2023-09-30T13:44:48.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-09-30T13:44:48.224 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-09-30T13:44:48.224 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-09-30T13:44:48.224 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 68.el9 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8264254 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-09-30T13:44:48.225 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-09-30T13:44:48.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:44:48.227 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T13:44:48.228 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T13:44:48.229 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-368.el9.x86_64 2023-09-30T13:44:48.229 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T13:44:48.845 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-09-30T13:44:50.242 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-09-30T13:44:50.278 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-09-30T13:44:50.280 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-09-30T13:44:50.295 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.QmJ81cHT2Q 2023-09-30T13:44:50.296 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QmJ81cHT2Q 2023-09-30T13:44:50.358 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:50.364 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.QmJ81cHT2Q 2023-09-30T13:44:50.402 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:50.502 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.QmJ81cHT2Q is 6KB 2023-09-30T13:44:50.552 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.QmJ81cHT2Q 2023-09-30T13:44:50.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T13:44:50.638 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-09-30T13:44:50.638 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-09-30T13:44:50.638 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-09-30T13:44:50.638 INFO:teuthology.orchestra.run.smithi135.stdout:15949e3c88704300882482eddfd7baae-5.14.0-368.el9.x86_64.conf 2023-09-30T13:44:50.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-368.el9.x86_64 2023-09-30T13:44:50.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-09-30T13:44:50.807 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:50.808 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-368.el9.x86_64 1/4 2023-09-30T13:44:50.808 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-368.el9.x86_64 2/4 2023-09-30T13:44:50.808 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-368.el9.x86_64 3/4 2023-09-30T13:44:51.333 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-368.el9.x86_64 4/4 2023-09-30T13:44:51.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-368.el9.x86_64 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-368.el9.x86_64 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-368.el9.x86_64 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:44:51.334 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2023-09-30T13:44:51.806 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T13:44:51.946 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:51.946 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-368.el9.x86_64 2023-09-30T13:44:51.947 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-368.el9.x86_64 2023-09-30T13:44:51.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T13:44:51.947 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T13:44:51.947 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-30T13:44:51.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T13:44:51.947 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T13:44:52.067 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-368.el9.x86_64 2023-09-30T13:44:52.067 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-368.el9.x86_64 2023-09-30T13:44:52.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2023-09-30T13:44:52.110 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2023-09-30T13:44:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T13:44:52.112 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T13:44:52.113 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T13:44:52.113 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2023-09-30T13:44:52.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:44:52.113 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T13:44:52.114 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T13:44:52.114 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-368.el9.x86_64 2023-09-30T13:44:52.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T13:44:52.732 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2023-09-30T13:44:54.340 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-09-30T13:44:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:done 2023-09-30T13:44:54.361 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2023-09-30T13:44:54.376 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.DVMtjtiM6r 2023-09-30T13:44:54.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DVMtjtiM6r 2023-09-30T13:44:54.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.DVMtjtiM6r 2023-09-30T13:44:54.598 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.DVMtjtiM6r is 6KB 2023-09-30T13:44:54.647 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.DVMtjtiM6r 2023-09-30T13:44:54.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T13:44:54.730 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-09-30T13:44:54.730 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-09-30T13:44:54.730 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-09-30T13:44:54.730 INFO:teuthology.orchestra.run.smithi062.stdout:15949e3c88704300882482eddfd7baae-5.14.0-368.el9.x86_64.conf 2023-09-30T13:44:54.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-368.el9.x86_64 2023-09-30T13:44:54.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2023-09-30T13:45:20.814 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-09-30T13:45:20.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:45:20.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:45:24.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-30T13:45:24.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:45:24.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:45:39.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-30T13:45:43.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-30T13:45:48.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:45:48.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:45:51.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-30T13:45:52.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:45:52.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:45:55.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-30T13:46:03.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:46:03.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:46:07.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:46:07.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:46:21.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-30T13:46:25.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-30T13:46:36.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:46:36.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:46:37.039 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-30T13:46:37.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:46:37.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-368.el9.x86_64"... 2023-09-30T13:46:37.411 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-09-30T13:46:37.425 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-368.el9.x86_64 2023-09-30T13:46:37.425 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-368.el9.x86_64 vs 5.14.0-368.el9.x86_64 2023-09-30T13:46:37.425 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T13:46:37.425 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T13:46:38.427 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-09-30T13:46:38.427 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T13:46:38.493 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2023-09-30T13:46:38.524 DEBUG:teuthology.parallel:result is None 2023-09-30T13:46:40.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:46:40.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:46:41.096 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-09-30T13:46:41.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:46:41.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-368.el9.x86_64"... 2023-09-30T13:46:41.547 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2023-09-30T13:46:41.562 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-368.el9.x86_64 2023-09-30T13:46:41.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-368.el9.x86_64 vs 5.14.0-368.el9.x86_64 2023-09-30T13:46:41.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T13:46:41.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T13:46:42.563 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T13:46:42.563 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T13:46:42.621 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2023-09-30T13:46:42.669 DEBUG:teuthology.parallel:result is None 2023-09-30T13:46:42.670 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T13:46:42.679 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T13:46:42.679 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T13:46:42.682 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T13:46:42.698 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T13:46:42.708 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T13:46:42.724 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T13:46:42.724 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T13:46:42.738 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T13:46:42.772 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T13:46:42.783 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T13:46:42.784 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T13:46:42.800 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T13:46:42.833 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T13:46:42.845 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T13:46:42.849 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T13:46:42.861 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T13:46:42.861 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T13:46:42.872 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T13:46:42.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T13:46:42.894 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T13:46:42.932 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T13:46:42.941 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T13:46:42.942 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T13:46:42.964 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T13:46:42.990 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T13:46:43.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T13:46:43.123 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T13:46:43.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T13:46:43.210 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:46:43.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T13:46:43.280 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T13:46:43.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T13:46:43.391 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T13:46:43.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T13:46:43.478 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:46:43.479 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T13:46:43.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2023-09-30T13:46:43.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-09-30T13:46:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T13:46:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T13:46:44.105 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T13:46:44.115 INFO:teuthology.task.internal:Starting timer... 2023-09-30T13:46:44.115 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T13:46:44.131 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T13:46:44.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2023-09-30T13:46:44.193 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2023-09-30T13:46:44.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-09-30T13:46:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-09-30T13:46:44.248 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T13:46:44.248 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2023-09-30T13:46:44.271 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2023-09-30T13:46:44.271 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-09-30T13:46:44.291 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-09-30T13:46:44.291 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-09-30T13:46:44.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T13:46:44.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:46:44.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T13:46:44.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:46:44.371 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T13:46:44.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2023-09-30T13:46:44.423 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-09-30T13:46:44.459 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T13:46:44.469 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-30T13:46:44.474 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-30T13:46:44.584 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T13:46:44.607 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T13:46:44.608 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T13:52:12.808 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-09-30T13:52:12.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:52:12.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:52:12.910 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-09-30T13:52:12.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-30T13:52:12.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:52:12.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T13:52:13.064 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-30T13:52:13.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-30T13:52:13.133 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T13:52:13.148 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T13:52:13.148 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T13:52:13.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T13:52:13.150 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T13:52:13.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T13:52:13.183 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T13:52:13.203 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T13:52:13.204 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T13:52:13.220 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T13:52:13.239 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2023-09-30T13:52:13.250 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-09-30T13:52:13.256 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2023-09-30T13:52:13.265 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-09-30T13:52:13.276 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T13:52:13.280 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T13:52:13.295 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T13:52:13.296 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T13:52:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2023-09-30T13:52:13.342 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.343 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.346 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:52:13.347 INFO:teuthology.run_tasks:Running task install... 2023-09-30T13:52:13.356 DEBUG:teuthology.task.install:project ceph 2023-09-30T13:52:13.356 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}} 2023-09-30T13:52:13.357 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'} 2023-09-30T13:52:13.357 INFO:teuthology.task.install:Using flavor: default 2023-09-30T13:52:13.362 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T13:52:13.363 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-30T13:52:13.363 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T13:52:13.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T13:52:13.365 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T13:52:13.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T13:52:13.519 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/ 2023-09-30T13:52:13.520 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T13:52:13.589 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/ 2023-09-30T13:52:13.590 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T13:52:13.692 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T13:52:13.692 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:52:13.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T13:52:13.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T13:52:13.694 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:52:13.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T13:52:13.722 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-30T13:52:13.722 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T13:52:13.726 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-30T13:52:13.727 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T13:52:13.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T13:52:13.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T13:52:13.871 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T13:52:13.887 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T13:52:13.916 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2023-09-30T13:52:13.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2023-09-30T13:52:13.937 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-09-30T13:52:13.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-09-30T13:52:14.170 INFO:teuthology.orchestra.run.smithi062.stdout:69 files removed 2023-09-30T13:52:14.177 INFO:teuthology.orchestra.run.smithi135.stdout:69 files removed 2023-09-30T13:52:14.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-30T13:52:14.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-30T13:52:14.914 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 198 kB/s | 78 kB 00:00 2023-09-30T13:52:14.951 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 185 kB/s | 78 kB 00:00 2023-09-30T13:52:15.264 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-09-30T13:52:15.371 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-09-30T13:52:15.581 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2023-09-30T13:52:15.797 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-09-30T13:52:16.151 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-09-30T13:52:16.282 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-09-30T13:52:17.601 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-09-30T13:52:17.633 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-09-30T13:52:18.600 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.8 MB 00:00 2023-09-30T13:52:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 7.8 MB 00:03 2023-09-30T13:52:23.735 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-09-30T13:52:26.568 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 18 MB 00:06 2023-09-30T13:52:28.075 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 5.7 MB 00:00 2023-09-30T13:52:29.410 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 14 kB 00:00 2023-09-30T13:52:30.636 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 17 MB/s | 19 MB 00:01 2023-09-30T13:52:30.893 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 5.7 MB 00:01 2023-09-30T13:52:32.519 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 14 kB 00:00 2023-09-30T13:52:33.654 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-09-30T13:52:35.205 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-09-30T13:52:37.416 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-30T13:52:37.417 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-30T13:52:37.430 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-09-30T13:52:37.431 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-09-30T13:52:37.433 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-09-30T13:52:37.434 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-09-30T13:52:37.436 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-09-30T13:52:37.439 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-09-30T13:52:37.439 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-09-30T13:52:37.512 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2023-09-30T13:52:37.522 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2023-09-30T13:52:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2023-09-30T13:52:37.522 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2023-09-30T13:52:37.522 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2023-09-30T13:52:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 6.5 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 5.2 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 855 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 141 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 1.5 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 132 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 1.8 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 7.4 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 47 k 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 8.6 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 41 M 2023-09-30T13:52:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 262 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 253 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 218 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 18 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 31 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 715 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 126 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-09-30T13:52:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 162 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 321 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 297 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 99 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 85 k 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.0 M 2023-09-30T13:52:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 169 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.45.2-1.el9 baseos 2.2 M 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.45.2-1.el9 baseos 1.8 M 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.45.2-1.el9 baseos 42 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.45.2-1.el9 baseos 247 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.3 M 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.0 M 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-09-30T13:52:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 19 M 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 23 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 2.1 M 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 242 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 4.4 M 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 18 M 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 15 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 24 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-09-30T13:52:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 163 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-09-30T13:52:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 472 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 4.8 M 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-09-30T13:52:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 45 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 127 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-09-30T13:52:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.23.0-1.el9 epel 196 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-09-30T13:52:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-09-30T13:52:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-09-30T13:52:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-09-30T13:52:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:Install 133 Packages 2023-09-30T13:52:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 6 Packages 2023-09-30T13:52:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:52:37.536 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 199 M 2023-09-30T13:52:37.536 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2023-09-30T13:52:38.054 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-09-30T13:52:38.546 INFO:teuthology.orchestra.run.smithi062.stdout:(1/139): ceph-18.0.0-6447.g1d10b717.el9.x86_64. 30 kB/s | 6.5 kB 00:00 2023-09-30T13:52:39.246 INFO:teuthology.orchestra.run.smithi062.stdout:(2/139): ceph-fuse-18.0.0-6447.g1d10b717.el9.x8 1.2 MB/s | 855 kB 00:00 2023-09-30T13:52:39.480 INFO:teuthology.orchestra.run.smithi062.stdout:(3/139): ceph-common-18.0.0-6447.g1d10b717.el9. 16 MB/s | 19 MB 00:01 2023-09-30T13:52:39.506 INFO:teuthology.orchestra.run.smithi062.stdout:(4/139): ceph-immutable-object-cache-18.0.0-644 545 kB/s | 141 kB 00:00 2023-09-30T13:52:39.613 INFO:teuthology.orchestra.run.smithi062.stdout:(5/139): ceph-mds-18.0.0-6447.g1d10b717.el9.x86 16 MB/s | 2.1 MB 00:00 2023-09-30T13:52:39.864 INFO:teuthology.orchestra.run.smithi062.stdout:(6/139): ceph-mon-18.0.0-6447.g1d10b717.el9.x86 18 MB/s | 4.4 MB 00:00 2023-09-30T13:52:40.166 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-30T13:52:40.167 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-09-30T13:52:40.180 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-09-30T13:52:40.181 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-09-30T13:52:40.182 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-09-30T13:52:40.183 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-09-30T13:52:40.185 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-09-30T13:52:40.188 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-09-30T13:52:40.189 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-09-30T13:52:40.256 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-09-30T13:52:40.274 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-09-30T13:52:40.274 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 6.5 k 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 5.2 M 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 855 k 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 141 k 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 1.5 M 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 132 k 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 1.8 M 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 7.4 M 2023-09-30T13:52:40.275 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 47 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 8.6 M 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 41 M 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 262 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 253 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 218 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 18 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 31 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 715 k 2023-09-30T13:52:40.276 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 126 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 162 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 321 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 297 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 99 k 2023-09-30T13:52:40.277 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 85 k 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.0 M 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 169 k 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.45.2-1.el9 baseos 2.2 M 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.45.2-1.el9 baseos 1.8 M 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.45.2-1.el9 baseos 42 k 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.45.2-1.el9 baseos 247 k 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.3 M 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 3.0 M 2023-09-30T13:52:40.278 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 19 M 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 23 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 2.1 M 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 242 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 4.4 M 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 18 M 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el9 ceph-noarch 15 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 24 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-09-30T13:52:40.279 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 163 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-09-30T13:52:40.280 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 472 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 4.8 M 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-09-30T13:52:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 45 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el9 ceph 127 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-09-30T13:52:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.23.0-1.el9 epel 196 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-09-30T13:52:40.283 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-09-30T13:52:40.284 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-09-30T13:52:40.285 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-09-30T13:52:40.286 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-09-30T13:52:40.287 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2023-09-30T13:52:40.288 INFO:teuthology.orchestra.run.smithi135.stdout:Install 133 Packages 2023-09-30T13:52:40.288 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 6 Packages 2023-09-30T13:52:40.288 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:52:40.288 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 199 M 2023-09-30T13:52:40.289 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-09-30T13:52:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:(7/139): ceph-mgr-18.0.0-6447.g1d10b717.el9.x86 1.4 MB/s | 1.5 MB 00:01 2023-09-30T13:52:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:(8/139): ceph-osd-18.0.0-6447.g1d10b717.el9.x86 21 MB/s | 18 MB 00:00 2023-09-30T13:52:40.748 INFO:teuthology.orchestra.run.smithi062.stdout:(9/139): ceph-selinux-18.0.0-6447.g1d10b717.el9 732 kB/s | 24 kB 00:00 2023-09-30T13:52:41.064 INFO:teuthology.orchestra.run.smithi135.stdout:(1/139): ceph-18.0.0-6447.g1d10b717.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2023-09-30T13:52:41.465 INFO:teuthology.orchestra.run.smithi062.stdout:(10/139): ceph-base-18.0.0-6447.g1d10b717.el9.x 1.7 MB/s | 5.2 MB 00:03 2023-09-30T13:52:41.648 INFO:teuthology.orchestra.run.smithi062.stdout:(11/139): cephfs-mirror-18.0.0-6447.g1d10b717.e 1.2 MB/s | 218 kB 00:00 2023-09-30T13:52:41.749 INFO:teuthology.orchestra.run.smithi062.stdout:(12/139): libcephfs-devel-18.0.0-6447.g1d10b717 312 kB/s | 31 kB 00:00 2023-09-30T13:52:41.905 INFO:teuthology.orchestra.run.smithi135.stdout:(2/139): ceph-fuse-18.0.0-6447.g1d10b717.el9.x8 1.0 MB/s | 855 kB 00:00 2023-09-30T13:52:42.064 INFO:teuthology.orchestra.run.smithi135.stdout:(3/139): ceph-immutable-object-cache-18.0.0-644 890 kB/s | 141 kB 00:00 2023-09-30T13:52:42.190 INFO:teuthology.orchestra.run.smithi062.stdout:(13/139): libcephfs2-18.0.0-6447.g1d10b717.el9. 1.6 MB/s | 715 kB 00:00 2023-09-30T13:52:42.374 INFO:teuthology.orchestra.run.smithi062.stdout:(14/139): libcephsqlite-18.0.0-6447.g1d10b717.e 893 kB/s | 163 kB 00:00 2023-09-30T13:52:42.483 INFO:teuthology.orchestra.run.smithi062.stdout:(15/139): librados-devel-18.0.0-6447.g1d10b717. 1.1 MB/s | 126 kB 00:00 2023-09-30T13:52:42.947 INFO:teuthology.orchestra.run.smithi135.stdout:(4/139): ceph-base-18.0.0-6447.g1d10b717.el9.x8 2.4 MB/s | 5.2 MB 00:02 2023-09-30T13:52:43.093 INFO:teuthology.orchestra.run.smithi062.stdout:(16/139): ceph-test-18.0.0-6447.g1d10b717.el9.x 17 MB/s | 41 MB 00:02 2023-09-30T13:52:43.106 INFO:teuthology.orchestra.run.smithi135.stdout:(5/139): ceph-mds-18.0.0-6447.g1d10b717.el9.x86 2.0 MB/s | 2.1 MB 00:01 2023-09-30T13:52:43.118 INFO:teuthology.orchestra.run.smithi062.stdout:(17/139): libradosstriper1-18.0.0-6447.g1d10b71 745 kB/s | 472 kB 00:00 2023-09-30T13:52:43.201 INFO:teuthology.orchestra.run.smithi062.stdout:(18/139): python3-ceph-argparse-18.0.0-6447.g1d 541 kB/s | 45 kB 00:00 2023-09-30T13:52:43.392 INFO:teuthology.orchestra.run.smithi062.stdout:(19/139): python3-ceph-common-18.0.0-6447.g1d10 662 kB/s | 127 kB 00:00 2023-09-30T13:52:43.423 INFO:teuthology.orchestra.run.smithi135.stdout:(6/139): ceph-mgr-18.0.0-6447.g1d10b717.el9.x86 3.1 MB/s | 1.5 MB 00:00 2023-09-30T13:52:43.484 INFO:teuthology.orchestra.run.smithi062.stdout:(20/139): librgw2-18.0.0-6447.g1d10b717.el9.x86 12 MB/s | 4.8 MB 00:00 2023-09-30T13:52:43.543 INFO:teuthology.orchestra.run.smithi062.stdout:(21/139): python3-rados-18.0.0-6447.g1d10b717.e 5.4 MB/s | 321 kB 00:00 2023-09-30T13:52:43.568 INFO:teuthology.orchestra.run.smithi062.stdout:(22/139): python3-cephfs-18.0.0-6447.g1d10b717. 921 kB/s | 162 kB 00:00 2023-09-30T13:52:43.602 INFO:teuthology.orchestra.run.smithi062.stdout:(23/139): python3-rbd-18.0.0-6447.g1d10b717.el9 5.0 MB/s | 297 kB 00:00 2023-09-30T13:52:43.635 INFO:teuthology.orchestra.run.smithi062.stdout:(24/139): python3-rgw-18.0.0-6447.g1d10b717.el9 1.4 MB/s | 99 kB 00:00 2023-09-30T13:52:43.661 INFO:teuthology.orchestra.run.smithi062.stdout:(25/139): rbd-fuse-18.0.0-6447.g1d10b717.el9.x8 1.4 MB/s | 85 kB 00:00 2023-09-30T13:52:43.719 INFO:teuthology.orchestra.run.smithi062.stdout:(26/139): rbd-nbd-18.0.0-6447.g1d10b717.el9.x86 2.8 MB/s | 169 kB 00:00 2023-09-30T13:52:43.770 INFO:teuthology.orchestra.run.smithi062.stdout:(27/139): ceph-grafana-dashboards-18.0.0-6447.g 462 kB/s | 23 kB 00:00 2023-09-30T13:52:43.828 INFO:teuthology.orchestra.run.smithi062.stdout:(28/139): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 2.2 MB/s | 132 kB 00:00 2023-09-30T13:52:43.995 INFO:teuthology.orchestra.run.smithi062.stdout:(29/139): ceph-mgr-dashboard-18.0.0-6447.g1d10b 11 MB/s | 1.8 MB 00:00 2023-09-30T13:52:44.190 INFO:teuthology.orchestra.run.smithi135.stdout:(7/139): ceph-common-18.0.0-6447.g1d10b717.el9. 5.5 MB/s | 19 MB 00:03 2023-09-30T13:52:44.504 INFO:teuthology.orchestra.run.smithi062.stdout:(30/139): ceph-mgr-diskprediction-local-18.0.0- 15 MB/s | 7.4 MB 00:00 2023-09-30T13:52:44.562 INFO:teuthology.orchestra.run.smithi062.stdout:(31/139): ceph-mgr-modules-core-18.0.0-6447.g1d 4.1 MB/s | 242 kB 00:00 2023-09-30T13:52:44.621 INFO:teuthology.orchestra.run.smithi062.stdout:(32/139): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 814 kB/s | 47 kB 00:00 2023-09-30T13:52:44.680 INFO:teuthology.orchestra.run.smithi062.stdout:(33/139): ceph-prometheus-alerts-18.0.0-6447.g1 251 kB/s | 15 kB 00:00 2023-09-30T13:52:44.730 INFO:teuthology.orchestra.run.smithi062.stdout:(34/139): rbd-mirror-18.0.0-6447.g1d10b717.el9. 2.8 MB/s | 3.0 MB 00:01 2023-09-30T13:52:44.756 INFO:teuthology.orchestra.run.smithi062.stdout:(35/139): ceph-volume-18.0.0-6447.g1d10b717.el9 3.4 MB/s | 262 kB 00:00 2023-09-30T13:52:44.797 INFO:teuthology.orchestra.run.smithi062.stdout:(36/139): cephfs-top-18.0.0-6447.g1d10b717.el9. 439 kB/s | 18 kB 00:00 2023-09-30T13:52:44.807 INFO:teuthology.orchestra.run.smithi135.stdout:(8/139): ceph-mon-18.0.0-6447.g1d10b717.el9.x86 2.6 MB/s | 4.4 MB 00:01 2023-09-30T13:52:44.857 INFO:teuthology.orchestra.run.smithi135.stdout:(9/139): ceph-selinux-18.0.0-6447.g1d10b717.el9 483 kB/s | 24 kB 00:00 2023-09-30T13:52:44.864 INFO:teuthology.orchestra.run.smithi062.stdout:(37/139): cephadm-18.0.0-6447.g1d10b717.el9.noa 1.8 MB/s | 253 kB 00:00 2023-09-30T13:52:44.931 INFO:teuthology.orchestra.run.smithi062.stdout:(38/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-09-30T13:52:44.973 INFO:teuthology.orchestra.run.smithi062.stdout:(39/139): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2023-09-30T13:52:44.998 INFO:teuthology.orchestra.run.smithi062.stdout:(40/139): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-09-30T13:52:45.015 INFO:teuthology.orchestra.run.smithi062.stdout:(41/139): flexiblas-3.0.4-8.el9.x86_64.rpm 766 kB/s | 32 kB 00:00 2023-09-30T13:52:45.065 INFO:teuthology.orchestra.run.smithi135.stdout:(10/139): ceph-radosgw-18.0.0-6447.g1d10b717.el 9.8 MB/s | 8.6 MB 00:00 2023-09-30T13:52:45.091 INFO:teuthology.orchestra.run.smithi062.stdout:(42/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-09-30T13:52:45.124 INFO:teuthology.orchestra.run.smithi062.stdout:(43/139): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 17 kB 00:00 2023-09-30T13:52:45.132 INFO:teuthology.orchestra.run.smithi135.stdout:(11/139): cephfs-mirror-18.0.0-6447.g1d10b717.e 3.2 MB/s | 218 kB 00:00 2023-09-30T13:52:45.158 INFO:teuthology.orchestra.run.smithi062.stdout:(44/139): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2023-09-30T13:52:45.182 INFO:teuthology.orchestra.run.smithi135.stdout:(12/139): libcephfs-devel-18.0.0-6447.g1d10b717 623 kB/s | 31 kB 00:00 2023-09-30T13:52:45.183 INFO:teuthology.orchestra.run.smithi062.stdout:(45/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-09-30T13:52:45.217 INFO:teuthology.orchestra.run.smithi062.stdout:(46/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-09-30T13:52:45.242 INFO:teuthology.orchestra.run.smithi062.stdout:(47/139): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-09-30T13:52:45.267 INFO:teuthology.orchestra.run.smithi062.stdout:(48/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 940 kB/s | 46 kB 00:00 2023-09-30T13:52:45.282 INFO:teuthology.orchestra.run.smithi135.stdout:(13/139): libcephfs2-18.0.0-6447.g1d10b717.el9. 7.0 MB/s | 715 kB 00:00 2023-09-30T13:52:45.293 INFO:teuthology.orchestra.run.smithi062.stdout:(49/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-09-30T13:52:45.318 INFO:teuthology.orchestra.run.smithi062.stdout:(50/139): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-09-30T13:52:45.343 INFO:teuthology.orchestra.run.smithi062.stdout:(51/139): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-09-30T13:52:45.349 INFO:teuthology.orchestra.run.smithi135.stdout:(14/139): libcephsqlite-18.0.0-6447.g1d10b717.e 2.4 MB/s | 163 kB 00:00 2023-09-30T13:52:45.417 INFO:teuthology.orchestra.run.smithi135.stdout:(15/139): librados-devel-18.0.0-6447.g1d10b717. 1.9 MB/s | 126 kB 00:00 2023-09-30T13:52:45.452 INFO:teuthology.orchestra.run.smithi062.stdout:(52/139): ceph-radosgw-18.0.0-6447.g1d10b717.el 1.7 MB/s | 8.6 MB 00:04 2023-09-30T13:52:45.500 INFO:teuthology.orchestra.run.smithi135.stdout:(16/139): libradosstriper1-18.0.0-6447.g1d10b71 5.5 MB/s | 472 kB 00:00 2023-09-30T13:52:45.519 INFO:teuthology.orchestra.run.smithi062.stdout:(53/139): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-09-30T13:52:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:(54/139): postgresql-13.11-1.el9.x86_64.rpm 7.2 MB/s | 1.5 MB 00:00 2023-09-30T13:52:45.586 INFO:teuthology.orchestra.run.smithi062.stdout:(55/139): postgresql-contrib-13.11-1.el9.x86_64 6.1 MB/s | 811 kB 00:00 2023-09-30T13:52:45.611 INFO:teuthology.orchestra.run.smithi062.stdout:(56/139): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2023-09-30T13:52:45.720 INFO:teuthology.orchestra.run.smithi062.stdout:(57/139): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 205 kB 00:00 2023-09-30T13:52:45.795 INFO:teuthology.orchestra.run.smithi062.stdout:(58/139): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2023-09-30T13:52:45.871 INFO:teuthology.orchestra.run.smithi062.stdout:(59/139): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2023-09-30T13:52:45.896 INFO:teuthology.orchestra.run.smithi062.stdout:(60/139): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-09-30T13:52:45.909 INFO:teuthology.orchestra.run.smithi135.stdout:(17/139): librgw2-18.0.0-6447.g1d10b717.el9.x86 12 MB/s | 4.8 MB 00:00 2023-09-30T13:52:45.921 INFO:teuthology.orchestra.run.smithi062.stdout:(61/139): python3-jsonpatch-1.21-16.el9.noarch. 199 kB/s | 24 kB 00:00 2023-09-30T13:52:45.946 INFO:teuthology.orchestra.run.smithi062.stdout:(62/139): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2023-09-30T13:52:45.972 INFO:teuthology.orchestra.run.smithi062.stdout:(63/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-09-30T13:52:45.976 INFO:teuthology.orchestra.run.smithi135.stdout:(18/139): python3-ceph-argparse-18.0.0-6447.g1d 677 kB/s | 45 kB 00:00 2023-09-30T13:52:45.997 INFO:teuthology.orchestra.run.smithi062.stdout:(64/139): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 32 kB 00:00 2023-09-30T13:52:46.022 INFO:teuthology.orchestra.run.smithi062.stdout:(65/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2023-09-30T13:52:46.043 INFO:teuthology.orchestra.run.smithi135.stdout:(19/139): python3-ceph-common-18.0.0-6447.g1d10 1.9 MB/s | 127 kB 00:00 2023-09-30T13:52:46.106 INFO:teuthology.orchestra.run.smithi062.stdout:(66/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-09-30T13:52:46.109 INFO:teuthology.orchestra.run.smithi135.stdout:(20/139): python3-cephfs-18.0.0-6447.g1d10b717. 2.4 MB/s | 162 kB 00:00 2023-09-30T13:52:46.131 INFO:teuthology.orchestra.run.smithi062.stdout:(67/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-09-30T13:52:46.156 INFO:teuthology.orchestra.run.smithi062.stdout:(68/139): python3-prettytable-0.7.2-27.el9.noar 314 kB/s | 41 kB 00:00 2023-09-30T13:52:46.173 INFO:teuthology.orchestra.run.smithi062.stdout:(69/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-09-30T13:52:46.185 INFO:teuthology.orchestra.run.smithi135.stdout:(21/139): python3-rados-18.0.0-6447.g1d10b717.e 4.2 MB/s | 321 kB 00:00 2023-09-30T13:52:46.198 INFO:teuthology.orchestra.run.smithi062.stdout:(70/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-09-30T13:52:46.223 INFO:teuthology.orchestra.run.smithi062.stdout:(71/139): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-09-30T13:52:46.260 INFO:teuthology.orchestra.run.smithi135.stdout:(22/139): python3-rbd-18.0.0-6447.g1d10b717.el9 3.9 MB/s | 297 kB 00:00 2023-09-30T13:52:46.327 INFO:teuthology.orchestra.run.smithi135.stdout:(23/139): python3-rgw-18.0.0-6447.g1d10b717.el9 1.5 MB/s | 99 kB 00:00 2023-09-30T13:52:46.394 INFO:teuthology.orchestra.run.smithi135.stdout:(24/139): rbd-fuse-18.0.0-6447.g1d10b717.el9.x8 1.2 MB/s | 85 kB 00:00 2023-09-30T13:52:46.490 INFO:teuthology.orchestra.run.smithi062.stdout:(72/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2023-09-30T13:52:46.516 INFO:teuthology.orchestra.run.smithi062.stdout:(73/139): python3-toml-0.10.2-6.el9.noarch.rpm 123 kB/s | 39 kB 00:00 2023-09-30T13:52:46.541 INFO:teuthology.orchestra.run.smithi062.stdout:(74/139): socat-1.7.4.1-5.el9.x86_64.rpm 955 kB/s | 300 kB 00:00 2023-09-30T13:52:46.558 INFO:teuthology.orchestra.run.smithi062.stdout:(75/139): uuid-1.6.2-55.el9.x86_64.rpm 845 kB/s | 56 kB 00:00 2023-09-30T13:52:46.575 INFO:teuthology.orchestra.run.smithi062.stdout:(76/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-09-30T13:52:46.600 INFO:teuthology.orchestra.run.smithi062.stdout:(77/139): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-09-30T13:52:46.626 INFO:teuthology.orchestra.run.smithi062.stdout:(78/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2023-09-30T13:52:46.636 INFO:teuthology.orchestra.run.smithi135.stdout:(25/139): ceph-osd-18.0.0-6447.g1d10b717.el9.x8 5.5 MB/s | 18 MB 00:03 2023-09-30T13:52:46.651 INFO:teuthology.orchestra.run.smithi062.stdout:(79/139): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-09-30T13:52:46.676 INFO:teuthology.orchestra.run.smithi062.stdout:(80/139): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-09-30T13:52:46.695 INFO:teuthology.orchestra.run.smithi135.stdout:(26/139): rbd-nbd-18.0.0-6447.g1d10b717.el9.x86 2.8 MB/s | 169 kB 00:00 2023-09-30T13:52:46.701 INFO:teuthology.orchestra.run.smithi062.stdout:(81/139): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-09-30T13:52:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:(82/139): python3-urllib3-1.26.5-3.el9.noarch.r 3.7 MB/s | 188 kB 00:00 2023-09-30T13:52:46.778 INFO:teuthology.orchestra.run.smithi135.stdout:(27/139): rbd-mirror-18.0.0-6447.g1d10b717.el9. 7.9 MB/s | 3.0 MB 00:00 2023-09-30T13:52:46.804 INFO:teuthology.orchestra.run.smithi135.stdout:(28/139): ceph-grafana-dashboards-18.0.0-6447.g 213 kB/s | 23 kB 00:00 2023-09-30T13:52:46.837 INFO:teuthology.orchestra.run.smithi135.stdout:(29/139): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 2.2 MB/s | 132 kB 00:00 2023-09-30T13:52:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:(83/139): libquadmath-11.4.1-2.1.el9.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-09-30T13:52:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:(84/139): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2023-09-30T13:52:47.061 INFO:teuthology.orchestra.run.smithi062.stdout:(85/139): libgfortran-11.4.1-2.1.el9.x86_64.rpm 2.1 MB/s | 809 kB 00:00 2023-09-30T13:52:47.096 INFO:teuthology.orchestra.run.smithi135.stdout:(30/139): ceph-mgr-dashboard-18.0.0-6447.g1d10b 6.0 MB/s | 1.8 MB 00:00 2023-09-30T13:52:47.179 INFO:teuthology.orchestra.run.smithi135.stdout:(31/139): ceph-mgr-modules-core-18.0.0-6447.g1d 2.9 MB/s | 242 kB 00:00 2023-09-30T13:52:47.221 INFO:teuthology.orchestra.run.smithi135.stdout:(32/139): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 1.1 MB/s | 47 kB 00:00 2023-09-30T13:52:47.253 INFO:teuthology.orchestra.run.smithi062.stdout:(86/139): elfutils-libelf-devel-0.189-3.el9.x86 74 kB/s | 22 kB 00:00 2023-09-30T13:52:47.263 INFO:teuthology.orchestra.run.smithi135.stdout:(33/139): ceph-prometheus-alerts-18.0.0-6447.g1 353 kB/s | 15 kB 00:00 2023-09-30T13:52:47.355 INFO:teuthology.orchestra.run.smithi135.stdout:(34/139): ceph-volume-18.0.0-6447.g1d10b717.el9 2.8 MB/s | 262 kB 00:00 2023-09-30T13:52:47.447 INFO:teuthology.orchestra.run.smithi135.stdout:(35/139): ceph-mgr-diskprediction-local-18.0.0- 12 MB/s | 7.4 MB 00:00 2023-09-30T13:52:47.453 INFO:teuthology.orchestra.run.smithi062.stdout:(87/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2023-09-30T13:52:47.472 INFO:teuthology.orchestra.run.smithi135.stdout:(36/139): cephadm-18.0.0-6447.g1d10b717.el9.noa 2.1 MB/s | 253 kB 00:00 2023-09-30T13:52:47.523 INFO:teuthology.orchestra.run.smithi135.stdout:(37/139): cephfs-top-18.0.0-6447.g1d10b717.el9. 243 kB/s | 18 kB 00:00 2023-09-30T13:52:47.545 INFO:teuthology.orchestra.run.smithi062.stdout:(88/139): automake-1.16.2-8.el9.noarch.rpm 983 kB/s | 689 kB 00:00 2023-09-30T13:52:47.570 INFO:teuthology.orchestra.run.smithi062.stdout:(89/139): jq-1.6-15.el9.x86_64.rpm 367 kB/s | 187 kB 00:00 2023-09-30T13:52:47.595 INFO:teuthology.orchestra.run.smithi062.stdout:(90/139): libuuid-devel-2.37.4-15.el9.x86_64.rp 180 kB/s | 26 kB 00:00 2023-09-30T13:52:47.606 INFO:teuthology.orchestra.run.smithi135.stdout:(38/139): bison-3.7.4-5.el9.x86_64.rpm 6.7 MB/s | 920 kB 00:00 2023-09-30T13:52:47.631 INFO:teuthology.orchestra.run.smithi135.stdout:(39/139): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 106 kB 00:00 2023-09-30T13:52:47.657 INFO:teuthology.orchestra.run.smithi135.stdout:(40/139): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-09-30T13:52:47.674 INFO:teuthology.orchestra.run.smithi135.stdout:(41/139): flexiblas-3.0.4-8.el9.x86_64.rpm 764 kB/s | 32 kB 00:00 2023-09-30T13:52:47.712 INFO:teuthology.orchestra.run.smithi062.stdout:(91/139): python3-pytz-2021.1-5.el9.noarch.rpm 359 kB/s | 51 kB 00:00 2023-09-30T13:52:47.737 INFO:teuthology.orchestra.run.smithi062.stdout:(92/139): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 608 kB/s | 86 kB 00:00 2023-09-30T13:52:47.749 INFO:teuthology.orchestra.run.smithi135.stdout:(42/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-09-30T13:52:47.766 INFO:teuthology.orchestra.run.smithi135.stdout:(43/139): flexiblas-openblas-openmp-3.0.4-8.el9 188 kB/s | 17 kB 00:00 2023-09-30T13:52:47.783 INFO:teuthology.orchestra.run.smithi135.stdout:(44/139): libaio-devel-0.3.111-13.el9.x86_64.rp 300 kB/s | 10 kB 00:00 2023-09-30T13:52:47.808 INFO:teuthology.orchestra.run.smithi135.stdout:(45/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-09-30T13:52:47.834 INFO:teuthology.orchestra.run.smithi135.stdout:(46/139): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-09-30T13:52:47.854 INFO:teuthology.orchestra.run.smithi062.stdout:(93/139): zlib-devel-1.2.11-40.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2023-09-30T13:52:47.858 INFO:teuthology.orchestra.run.smithi135.stdout:(47/139): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-09-30T13:52:47.876 INFO:teuthology.orchestra.run.smithi135.stdout:(48/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2023-09-30T13:52:47.880 INFO:teuthology.orchestra.run.smithi062.stdout:(94/139): fmt-8.1.1-5.el9.x86_64.rpm 780 kB/s | 111 kB 00:00 2023-09-30T13:52:47.901 INFO:teuthology.orchestra.run.smithi135.stdout:(49/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-09-30T13:52:47.918 INFO:teuthology.orchestra.run.smithi135.stdout:(50/139): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-09-30T13:52:47.943 INFO:teuthology.orchestra.run.smithi135.stdout:(51/139): openblas-0.3.21-2.el9.x86_64.rpm 822 kB/s | 34 kB 00:00 2023-09-30T13:52:47.946 INFO:teuthology.orchestra.run.smithi062.stdout:(95/139): openssl-devel-3.0.7-24.el9.x86_64.rpm 10 MB/s | 4.1 MB 00:00 2023-09-30T13:52:48.010 INFO:teuthology.orchestra.run.smithi135.stdout:(52/139): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2023-09-30T13:52:48.013 INFO:teuthology.orchestra.run.smithi062.stdout:(96/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 MB/s | 309 kB 00:00 2023-09-30T13:52:48.039 INFO:teuthology.orchestra.run.smithi062.stdout:(97/139): libarrow-doc-9.0.0-9.el9.noarch.rpm 265 kB/s | 24 kB 00:00 2023-09-30T13:52:48.064 INFO:teuthology.orchestra.run.smithi062.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2023-09-30T13:52:48.077 INFO:teuthology.orchestra.run.smithi135.stdout:(53/139): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-09-30T13:52:48.102 INFO:teuthology.orchestra.run.smithi135.stdout:(54/139): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-09-30T13:52:48.114 INFO:teuthology.orchestra.run.smithi062.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2023-09-30T13:52:48.127 INFO:teuthology.orchestra.run.smithi135.stdout:(55/139): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-09-30T13:52:48.190 INFO:teuthology.orchestra.run.smithi062.stdout:(100/139): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.5 MB/s | 837 kB 00:00 2023-09-30T13:52:48.240 INFO:teuthology.orchestra.run.smithi062.stdout:(101/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2023-09-30T13:52:48.253 INFO:teuthology.orchestra.run.smithi135.stdout:(56/139): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2023-09-30T13:52:48.315 INFO:teuthology.orchestra.run.smithi062.stdout:(102/139): libarrow-9.0.0-9.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2023-09-30T13:52:48.340 INFO:teuthology.orchestra.run.smithi062.stdout:(103/139): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2023-09-30T13:52:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:(104/139): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2023-09-30T13:52:48.370 INFO:teuthology.orchestra.run.smithi135.stdout:(57/139): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2023-09-30T13:52:48.395 INFO:teuthology.orchestra.run.smithi135.stdout:(58/139): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 205 kB 00:00 2023-09-30T13:52:48.399 INFO:teuthology.orchestra.run.smithi062.stdout:(105/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-09-30T13:52:48.420 INFO:teuthology.orchestra.run.smithi135.stdout:(59/139): python3-jinja2-2.11.3-4.el9.noarch.rp 4.5 MB/s | 228 kB 00:00 2023-09-30T13:52:48.425 INFO:teuthology.orchestra.run.smithi062.stdout:(106/139): python3-asyncssh-2.13.2-3.el9.noarch 1.7 MB/s | 548 kB 00:00 2023-09-30T13:52:48.446 INFO:teuthology.orchestra.run.smithi135.stdout:(60/139): python3-jsonpatch-1.21-16.el9.noarch. 488 kB/s | 24 kB 00:00 2023-09-30T13:52:48.450 INFO:teuthology.orchestra.run.smithi062.stdout:(107/139): python3-google-auth-2.23.0-1.el9.noa 3.8 MB/s | 196 kB 00:00 2023-09-30T13:52:48.471 INFO:teuthology.orchestra.run.smithi135.stdout:(61/139): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2023-09-30T13:52:48.475 INFO:teuthology.orchestra.run.smithi062.stdout:(108/139): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2023-09-30T13:52:48.496 INFO:teuthology.orchestra.run.smithi135.stdout:(62/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-09-30T13:52:48.501 INFO:teuthology.orchestra.run.smithi062.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-09-30T13:52:48.521 INFO:teuthology.orchestra.run.smithi135.stdout:(63/139): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-09-30T13:52:48.526 INFO:teuthology.orchestra.run.smithi062.stdout:(110/139): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2023-09-30T13:52:48.551 INFO:teuthology.orchestra.run.smithi062.stdout:(111/139): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2023-09-30T13:52:48.577 INFO:teuthology.orchestra.run.smithi062.stdout:(112/139): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2023-09-30T13:52:48.601 INFO:teuthology.orchestra.run.smithi062.stdout:(113/139): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2023-09-30T13:52:48.622 INFO:teuthology.orchestra.run.smithi135.stdout:(64/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2023-09-30T13:52:48.627 INFO:teuthology.orchestra.run.smithi062.stdout:(114/139): python3-jwt+crypto-2.4.0-1.el9.noarc 120 kB/s | 9.0 kB 00:00 2023-09-30T13:52:48.647 INFO:teuthology.orchestra.run.smithi135.stdout:(65/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2023-09-30T13:52:48.652 INFO:teuthology.orchestra.run.smithi062.stdout:(115/139): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2023-09-30T13:52:48.672 INFO:teuthology.orchestra.run.smithi135.stdout:(66/139): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-09-30T13:52:48.677 INFO:teuthology.orchestra.run.smithi062.stdout:(116/139): python3-logutils-0.3.5-21.el9.noarch 921 kB/s | 46 kB 00:00 2023-09-30T13:52:48.689 INFO:teuthology.orchestra.run.smithi135.stdout:(67/139): python3-prettytable-0.7.2-27.el9.noar 987 kB/s | 41 kB 00:00 2023-09-30T13:52:48.703 INFO:teuthology.orchestra.run.smithi062.stdout:(117/139): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-09-30T13:52:48.715 INFO:teuthology.orchestra.run.smithi135.stdout:(68/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-09-30T13:52:48.728 INFO:teuthology.orchestra.run.smithi062.stdout:(118/139): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-09-30T13:52:48.740 INFO:teuthology.orchestra.run.smithi135.stdout:(69/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-09-30T13:52:48.753 INFO:teuthology.orchestra.run.smithi062.stdout:(119/139): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-09-30T13:52:48.765 INFO:teuthology.orchestra.run.smithi135.stdout:(70/139): python3-requests-oauthlib-1.3.0-12.el 856 kB/s | 43 kB 00:00 2023-09-30T13:52:48.770 INFO:teuthology.orchestra.run.smithi062.stdout:(120/139): python3-portend-3.1.0-2.el9.noarch.r 394 kB/s | 16 kB 00:00 2023-09-30T13:52:48.796 INFO:teuthology.orchestra.run.smithi062.stdout:(121/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2023-09-30T13:52:48.821 INFO:teuthology.orchestra.run.smithi062.stdout:(122/139): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2023-09-30T13:52:48.824 INFO:teuthology.orchestra.run.smithi135.stdout:(71/139): python3-toml-0.10.2-6.el9.noarch.rpm 679 kB/s | 39 kB 00:00 2023-09-30T13:52:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:(123/139): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2023-09-30T13:52:48.880 INFO:teuthology.orchestra.run.smithi062.stdout:(124/139): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-09-30T13:52:48.905 INFO:teuthology.orchestra.run.smithi062.stdout:(125/139): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2023-09-30T13:52:48.930 INFO:teuthology.orchestra.run.smithi062.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-09-30T13:52:48.955 INFO:teuthology.orchestra.run.smithi062.stdout:(127/139): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2023-09-30T13:52:48.981 INFO:teuthology.orchestra.run.smithi062.stdout:(128/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2023-09-30T13:52:49.006 INFO:teuthology.orchestra.run.smithi062.stdout:(129/139): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-09-30T13:52:49.031 INFO:teuthology.orchestra.run.smithi062.stdout:(130/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2023-09-30T13:52:49.057 INFO:teuthology.orchestra.run.smithi062.stdout:(131/139): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-09-30T13:52:49.082 INFO:teuthology.orchestra.run.smithi062.stdout:(132/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-09-30T13:52:49.082 INFO:teuthology.orchestra.run.smithi135.stdout:(72/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-09-30T13:52:49.108 INFO:teuthology.orchestra.run.smithi135.stdout:(73/139): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2023-09-30T13:52:49.132 INFO:teuthology.orchestra.run.smithi062.stdout:(133/139): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-09-30T13:52:49.133 INFO:teuthology.orchestra.run.smithi135.stdout:(74/139): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-09-30T13:52:49.158 INFO:teuthology.orchestra.run.smithi135.stdout:(75/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-09-30T13:52:49.183 INFO:teuthology.orchestra.run.smithi135.stdout:(76/139): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-09-30T13:52:49.209 INFO:teuthology.orchestra.run.smithi135.stdout:(77/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-09-30T13:52:49.234 INFO:teuthology.orchestra.run.smithi135.stdout:(78/139): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-09-30T13:52:49.259 INFO:teuthology.orchestra.run.smithi135.stdout:(79/139): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-09-30T13:52:49.276 INFO:teuthology.orchestra.run.smithi135.stdout:(80/139): python3-requests-2.25.1-7.el9.noarch. 2.6 MB/s | 113 kB 00:00 2023-09-30T13:52:49.302 INFO:teuthology.orchestra.run.smithi135.stdout:(81/139): python3-urllib3-1.26.5-3.el9.noarch.r 4.4 MB/s | 188 kB 00:00 2023-09-30T13:52:49.427 INFO:teuthology.orchestra.run.smithi135.stdout:(82/139): libquadmath-11.4.1-2.1.el9.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2023-09-30T13:52:49.594 INFO:teuthology.orchestra.run.smithi135.stdout:(83/139): libgfortran-11.4.1-2.1.el9.x86_64.rpm 2.5 MB/s | 809 kB 00:00 2023-09-30T13:52:49.652 INFO:teuthology.orchestra.run.smithi135.stdout:(84/139): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2023-09-30T13:52:49.903 INFO:teuthology.orchestra.run.smithi135.stdout:(85/139): elfutils-libelf-devel-0.189-3.el9.x86 89 kB/s | 22 kB 00:00 2023-09-30T13:52:49.924 INFO:teuthology.orchestra.run.smithi062.stdout:(134/139): librbd1-18.0.0-6447.g1d10b717.el9.x8 3.6 MB/s | 3.0 MB 00:00 2023-09-30T13:52:50.091 INFO:teuthology.orchestra.run.smithi062.stdout:(135/139): NetworkManager-1.45.2-1.el9.x86_64.r 2.3 MB/s | 2.2 MB 00:00 2023-09-30T13:52:50.142 INFO:teuthology.orchestra.run.smithi062.stdout:(136/139): NetworkManager-team-1.45.2-1.el9.x86 847 kB/s | 42 kB 00:00 2023-09-30T13:52:50.192 INFO:teuthology.orchestra.run.smithi062.stdout:(137/139): librados2-18.0.0-6447.g1d10b717.el9. 2.9 MB/s | 3.3 MB 00:01 2023-09-30T13:52:50.220 INFO:teuthology.orchestra.run.smithi135.stdout:(86/139): jq-1.6-15.el9.x86_64.rpm 590 kB/s | 187 kB 00:00 2023-09-30T13:52:50.245 INFO:teuthology.orchestra.run.smithi135.stdout:(87/139): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2023-09-30T13:52:50.276 INFO:teuthology.orchestra.run.smithi062.stdout:(138/139): NetworkManager-tui-1.45.2-1.el9.x86_ 1.8 MB/s | 247 kB 00:00 2023-09-30T13:52:50.329 INFO:teuthology.orchestra.run.smithi135.stdout:(88/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2023-09-30T13:52:50.354 INFO:teuthology.orchestra.run.smithi135.stdout:(89/139): libuuid-devel-2.37.4-15.el9.x86_64.rp 235 kB/s | 26 kB 00:00 2023-09-30T13:52:50.454 INFO:teuthology.orchestra.run.smithi135.stdout:(90/139): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2023-09-30T13:52:50.579 INFO:teuthology.orchestra.run.smithi135.stdout:(91/139): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 691 kB/s | 86 kB 00:00 2023-09-30T13:52:50.667 INFO:teuthology.orchestra.run.smithi062.stdout:(139/139): NetworkManager-libnm-1.45.2-1.el9.x8 2.4 MB/s | 1.8 MB 00:00 2023-09-30T13:52:50.670 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2023-09-30T13:52:50.670 INFO:teuthology.orchestra.run.smithi062.stdout:Total 15 MB/s | 199 MB 00:13 2023-09-30T13:52:50.688 INFO:teuthology.orchestra.run.smithi135.stdout:(92/139): zlib-devel-1.2.11-40.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2023-09-30T13:52:50.822 INFO:teuthology.orchestra.run.smithi135.stdout:(93/139): openssl-devel-3.0.7-24.el9.x86_64.rpm 8.4 MB/s | 4.1 MB 00:00 2023-09-30T13:52:50.909 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2023-09-30T13:52:51.041 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2023-09-30T13:52:51.041 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2023-09-30T13:52:51.239 INFO:teuthology.orchestra.run.smithi135.stdout:(94/139): ceph-test-18.0.0-6447.g1d10b717.el9.x 6.4 MB/s | 41 MB 00:06 2023-09-30T13:52:51.364 INFO:teuthology.orchestra.run.smithi135.stdout:(95/139): fmt-8.1.1-5.el9.x86_64.rpm 164 kB/s | 111 kB 00:00 2023-09-30T13:52:51.464 INFO:teuthology.orchestra.run.smithi135.stdout:(96/139): libarrow-doc-9.0.0-9.el9.noarch.rpm 244 kB/s | 24 kB 00:00 2023-09-30T13:52:51.589 INFO:teuthology.orchestra.run.smithi135.stdout:(97/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 403 kB/s | 309 kB 00:00 2023-09-30T13:52:51.606 INFO:teuthology.orchestra.run.smithi135.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2023-09-30T13:52:51.665 INFO:teuthology.orchestra.run.smithi135.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2023-09-30T13:52:51.790 INFO:teuthology.orchestra.run.smithi135.stdout:(100/139): python3-asyncssh-2.13.2-3.el9.noarch 4.3 MB/s | 548 kB 00:00 2023-09-30T13:52:51.849 INFO:teuthology.orchestra.run.smithi135.stdout:(101/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 747 kB/s | 43 kB 00:00 2023-09-30T13:52:51.907 INFO:teuthology.orchestra.run.smithi135.stdout:(102/139): libarrow-9.0.0-9.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2023-09-30T13:52:51.924 INFO:teuthology.orchestra.run.smithi135.stdout:(103/139): python3-cachetools-4.2.4-1.el9.noarc 429 kB/s | 32 kB 00:00 2023-09-30T13:52:51.974 INFO:teuthology.orchestra.run.smithi135.stdout:(104/139): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2023-09-30T13:52:52.000 INFO:teuthology.orchestra.run.smithi135.stdout:(105/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-09-30T13:52:52.050 INFO:teuthology.orchestra.run.smithi135.stdout:(106/139): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2023-09-30T13:52:52.075 INFO:teuthology.orchestra.run.smithi135.stdout:(107/139): python3-google-auth-2.23.0-1.el9.noa 2.5 MB/s | 196 kB 00:00 2023-09-30T13:52:52.117 INFO:teuthology.orchestra.run.smithi135.stdout:(108/139): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.6 MB/s | 837 kB 00:00 2023-09-30T13:52:52.142 INFO:teuthology.orchestra.run.smithi135.stdout:(109/139): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2023-09-30T13:52:52.168 INFO:teuthology.orchestra.run.smithi135.stdout:(110/139): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2023-09-30T13:52:52.193 INFO:teuthology.orchestra.run.smithi135.stdout:(111/139): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2023-09-30T13:52:52.218 INFO:teuthology.orchestra.run.smithi135.stdout:(112/139): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2023-09-30T13:52:52.243 INFO:teuthology.orchestra.run.smithi135.stdout:(113/139): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2023-09-30T13:52:52.277 INFO:teuthology.orchestra.run.smithi135.stdout:(114/139): python3-jwt+crypto-2.4.0-1.el9.noarc 108 kB/s | 9.0 kB 00:00 2023-09-30T13:52:52.302 INFO:teuthology.orchestra.run.smithi135.stdout:(115/139): python3-jwt-2.4.0-1.el9.noarch.rpm 489 kB/s | 41 kB 00:00 2023-09-30T13:52:52.361 INFO:teuthology.orchestra.run.smithi135.stdout:(116/139): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2023-09-30T13:52:52.386 INFO:teuthology.orchestra.run.smithi135.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 425 kB/s | 46 kB 00:00 2023-09-30T13:52:52.412 INFO:teuthology.orchestra.run.smithi135.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 723 kB/s | 79 kB 00:00 2023-09-30T13:52:52.437 INFO:teuthology.orchestra.run.smithi135.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 763 kB/s | 58 kB 00:00 2023-09-30T13:52:52.479 INFO:teuthology.orchestra.run.smithi135.stdout:(120/139): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2023-09-30T13:52:52.504 INFO:teuthology.orchestra.run.smithi135.stdout:(121/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-09-30T13:52:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-09-30T13:52:52.563 INFO:teuthology.orchestra.run.smithi135.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2023-09-30T13:52:52.588 INFO:teuthology.orchestra.run.smithi135.stdout:(124/139): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-09-30T13:52:52.622 INFO:teuthology.orchestra.run.smithi135.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2023-09-30T13:52:52.647 INFO:teuthology.orchestra.run.smithi135.stdout:(126/139): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2023-09-30T13:52:52.672 INFO:teuthology.orchestra.run.smithi135.stdout:(127/139): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2023-09-30T13:52:52.714 INFO:teuthology.orchestra.run.smithi135.stdout:(128/139): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2023-09-30T13:52:52.748 INFO:teuthology.orchestra.run.smithi135.stdout:(129/139): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-09-30T13:52:52.773 INFO:teuthology.orchestra.run.smithi135.stdout:(130/139): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2023-09-30T13:52:52.798 INFO:teuthology.orchestra.run.smithi135.stdout:(131/139): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2023-09-30T13:52:52.865 INFO:teuthology.orchestra.run.smithi135.stdout:(132/139): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-09-30T13:52:52.907 INFO:teuthology.orchestra.run.smithi135.stdout:(133/139): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2023-09-30T13:52:52.964 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2023-09-30T13:52:52.964 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2023-09-30T13:52:53.099 INFO:teuthology.orchestra.run.smithi135.stdout:(134/139): NetworkManager-1.45.2-1.el9.x86_64.r 12 MB/s | 2.2 MB 00:00 2023-09-30T13:52:53.183 INFO:teuthology.orchestra.run.smithi135.stdout:(135/139): NetworkManager-libnm-1.45.2-1.el9.x8 22 MB/s | 1.8 MB 00:00 2023-09-30T13:52:53.250 INFO:teuthology.orchestra.run.smithi135.stdout:(136/139): librados2-18.0.0-6447.g1d10b717.el9. 7.3 MB/s | 3.3 MB 00:00 2023-09-30T13:52:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:(137/139): NetworkManager-team-1.45.2-1.el9.x86 459 kB/s | 42 kB 00:00 2023-09-30T13:52:53.367 INFO:teuthology.orchestra.run.smithi135.stdout:(138/139): NetworkManager-tui-1.45.2-1.el9.x86_ 2.1 MB/s | 247 kB 00:00 2023-09-30T13:52:53.417 INFO:teuthology.orchestra.run.smithi135.stdout:(139/139): librbd1-18.0.0-6447.g1d10b717.el9.x8 5.5 MB/s | 3.0 MB 00:00 2023-09-30T13:52:53.423 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-09-30T13:52:53.423 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 199 MB 00:13 2023-09-30T13:52:53.654 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-09-30T13:52:53.771 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-09-30T13:52:53.772 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-09-30T13:52:55.565 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-09-30T13:52:55.566 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-09-30T13:52:58.622 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2023-09-30T13:52:58.687 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/145 2023-09-30T13:52:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/145 2023-09-30T13:52:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/145 2023-09-30T13:52:58.826 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/145 2023-09-30T13:52:59.172 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/145 2023-09-30T13:52:59.230 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:52:59.335 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:52:59.373 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:52:59.456 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:52:59.508 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 8/145 2023-09-30T13:52:59.592 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/145 2023-09-30T13:52:59.643 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/145 2023-09-30T13:52:59.676 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/145 2023-09-30T13:52:59.842 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/145 2023-09-30T13:52:59.893 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/145 2023-09-30T13:52:59.921 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 14/145 2023-09-30T13:53:00.006 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 14/145 2023-09-30T13:53:00.030 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 15/145 2023-09-30T13:53:00.238 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 15/145 2023-09-30T13:53:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/145 2023-09-30T13:53:00.420 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/145 2023-09-30T13:53:00.514 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:00.582 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:00.875 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:00.903 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-09-30T13:53:00.909 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2023-09-30T13:53:00.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2023-09-30T13:53:00.977 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/145 2023-09-30T13:53:00.979 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2023-09-30T13:53:01.002 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/145 2023-09-30T13:53:01.023 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 21/145 2023-09-30T13:53:01.039 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/145 2023-09-30T13:53:01.096 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 22/145 2023-09-30T13:53:01.136 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/145 2023-09-30T13:53:01.164 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/145 2023-09-30T13:53:01.183 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/145 2023-09-30T13:53:01.236 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/145 2023-09-30T13:53:01.278 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el9. 26/145 2023-09-30T13:53:01.330 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 27/145 2023-09-30T13:53:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_6 28/145 2023-09-30T13:53:01.553 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/145 2023-09-30T13:53:01.564 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/145 2023-09-30T13:53:01.608 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 30/145 2023-09-30T13:53:01.629 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:53:01.731 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:53:01.763 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:53:01.846 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:53:01.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 8/145 2023-09-30T13:53:01.970 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/145 2023-09-30T13:53:02.033 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/145 2023-09-30T13:53:02.072 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/145 2023-09-30T13:53:02.174 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 31/145 2023-09-30T13:53:02.260 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/145 2023-09-30T13:53:02.264 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 32/145 2023-09-30T13:53:02.309 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/145 2023-09-30T13:53:02.310 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 33/145 2023-09-30T13:53:02.337 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 14/145 2023-09-30T13:53:02.347 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_6 34/145 2023-09-30T13:53:02.377 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/145 2023-09-30T13:53:02.437 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 14/145 2023-09-30T13:53:02.463 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 15/145 2023-09-30T13:53:02.488 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 36/145 2023-09-30T13:53:02.523 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 37/145 2023-09-30T13:53:02.580 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 38/145 2023-09-30T13:53:02.654 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 39/145 2023-09-30T13:53:02.670 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 15/145 2023-09-30T13:53:02.690 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 40/145 2023-09-30T13:53:02.719 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 41/145 2023-09-30T13:53:02.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 42/145 2023-09-30T13:53:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/145 2023-09-30T13:53:02.811 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 43/145 2023-09-30T13:53:02.852 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 16/145 2023-09-30T13:53:02.854 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 44/145 2023-09-30T13:53:02.950 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:02.996 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 45/145 2023-09-30T13:53:03.003 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:03.038 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 46/145 2023-09-30T13:53:03.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 47/145 2023-09-30T13:53:03.188 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 48/145 2023-09-30T13:53:03.222 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.23.0-1.el9.noarch 49/145 2023-09-30T13:53:03.255 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 50/145 2023-09-30T13:53:03.266 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.45.2-1.el9.x86_64 17/145 2023-09-30T13:53:03.295 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 51/145 2023-09-30T13:53:03.299 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2023-09-30T13:53:03.321 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 52/145 2023-09-30T13:53:03.341 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2023-09-30T13:53:03.346 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fmt-8.1.1-5.el9.x86_64 53/145 2023-09-30T13:53:03.368 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2023-09-30T13:53:03.375 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/145 2023-09-30T13:53:03.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 21/145 2023-09-30T13:53:03.471 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/145 2023-09-30T13:53:03.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 22/145 2023-09-30T13:53:03.508 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 56/145 2023-09-30T13:53:03.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/145 2023-09-30T13:53:03.547 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/145 2023-09-30T13:53:03.567 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/145 2023-09-30T13:53:03.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/145 2023-09-30T13:53:03.640 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/145 2023-09-30T13:53:03.652 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el9. 26/145 2023-09-30T13:53:03.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 27/145 2023-09-30T13:53:03.770 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_6 28/145 2023-09-30T13:53:03.861 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/145 2023-09-30T13:53:03.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/145 2023-09-30T13:53:03.955 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/145 2023-09-30T13:53:03.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 30/145 2023-09-30T13:53:04.349 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/145 2023-09-30T13:53:04.391 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/145 2023-09-30T13:53:04.419 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/145 2023-09-30T13:53:04.462 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/145 2023-09-30T13:53:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/145 2023-09-30T13:53:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 31/145 2023-09-30T13:53:04.527 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/145 2023-09-30T13:53:04.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/145 2023-09-30T13:53:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 32/145 2023-09-30T13:53:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 33/145 2023-09-30T13:53:04.623 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/145 2023-09-30T13:53:04.658 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/145 2023-09-30T13:53:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_6 34/145 2023-09-30T13:53:04.688 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/145 2023-09-30T13:53:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 35/145 2023-09-30T13:53:04.776 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/145 2023-09-30T13:53:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 36/145 2023-09-30T13:53:04.814 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/145 2023-09-30T13:53:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 37/145 2023-09-30T13:53:04.847 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/145 2023-09-30T13:53:04.890 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/145 2023-09-30T13:53:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 38/145 2023-09-30T13:53:04.956 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/145 2023-09-30T13:53:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 39/145 2023-09-30T13:53:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 40/145 2023-09-30T13:53:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 41/145 2023-09-30T13:53:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 42/145 2023-09-30T13:53:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 43/145 2023-09-30T13:53:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 44/145 2023-09-30T13:53:05.198 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/145 2023-09-30T13:53:05.316 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 45/145 2023-09-30T13:53:05.351 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/145 2023-09-30T13:53:05.358 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 46/145 2023-09-30T13:53:05.408 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 47/145 2023-09-30T13:53:05.461 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/145 2023-09-30T13:53:05.502 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 48/145 2023-09-30T13:53:05.514 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/145 2023-09-30T13:53:05.534 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.23.0-1.el9.noarch 49/145 2023-09-30T13:53:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 50/145 2023-09-30T13:53:05.607 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 51/145 2023-09-30T13:53:05.634 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 52/145 2023-09-30T13:53:05.659 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fmt-8.1.1-5.el9.x86_64 53/145 2023-09-30T13:53:05.687 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/145 2023-09-30T13:53:05.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/145 2023-09-30T13:53:05.828 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 56/145 2023-09-30T13:53:05.877 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/145 2023-09-30T13:53:05.936 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/145 2023-09-30T13:53:06.153 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/145 2023-09-30T13:53:06.207 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/145 2023-09-30T13:53:06.293 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/145 2023-09-30T13:53:06.334 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/145 2023-09-30T13:53:06.339 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/145 2023-09-30T13:53:06.368 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/145 2023-09-30T13:53:06.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/145 2023-09-30T13:53:06.472 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/145 2023-09-30T13:53:06.518 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/145 2023-09-30T13:53:06.589 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/145 2023-09-30T13:53:06.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/145 2023-09-30T13:53:06.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/145 2023-09-30T13:53:06.689 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/145 2023-09-30T13:53:06.720 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/145 2023-09-30T13:53:06.747 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/145 2023-09-30T13:53:06.749 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/145 2023-09-30T13:53:06.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/145 2023-09-30T13:53:06.827 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/145 2023-09-30T13:53:06.833 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/145 2023-09-30T13:53:06.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/145 2023-09-30T13:53:06.936 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/145 2023-09-30T13:53:06.976 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/145 2023-09-30T13:53:07.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/145 2023-09-30T13:53:07.051 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/145 2023-09-30T13:53:07.085 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/145 2023-09-30T13:53:07.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/145 2023-09-30T13:53:07.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/145 2023-09-30T13:53:07.316 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/145 2023-09-30T13:53:07.363 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/145 2023-09-30T13:53:07.523 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/145 2023-09-30T13:53:07.643 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/145 2023-09-30T13:53:08.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/145 2023-09-30T13:53:08.152 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/145 2023-09-30T13:53:08.185 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/145 2023-09-30T13:53:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/145 2023-09-30T13:53:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/145 2023-09-30T13:53:08.497 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/145 2023-09-30T13:53:08.535 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/145 2023-09-30T13:53:08.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/145 2023-09-30T13:53:08.991 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/145 2023-09-30T13:53:09.067 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/145 2023-09-30T13:53:09.101 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/145 2023-09-30T13:53:09.128 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.6-15.el9.x86_64 93/145 2023-09-30T13:53:09.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/145 2023-09-30T13:53:09.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/145 2023-09-30T13:53:09.365 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/145 2023-09-30T13:53:09.486 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/145 2023-09-30T13:53:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 96/145 2023-09-30T13:53:09.668 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 96/145 2023-09-30T13:53:09.707 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 97/145 2023-09-30T13:53:09.744 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/145 2023-09-30T13:53:10.194 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/145 2023-09-30T13:53:10.221 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 100/145 2023-09-30T13:53:10.276 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 100/145 2023-09-30T13:53:10.306 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 101/145 2023-09-30T13:53:10.624 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/145 2023-09-30T13:53:10.709 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/145 2023-09-30T13:53:10.740 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/145 2023-09-30T13:53:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-15.el9.x86_64 93/145 2023-09-30T13:53:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/145 2023-09-30T13:53:11.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/145 2023-09-30T13:53:11.137 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 96/145 2023-09-30T13:53:11.227 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 96/145 2023-09-30T13:53:11.258 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 97/145 2023-09-30T13:53:11.295 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/145 2023-09-30T13:53:11.723 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/145 2023-09-30T13:53:11.756 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 100/145 2023-09-30T13:53:11.828 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 100/145 2023-09-30T13:53:11.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 101/145 2023-09-30T13:53:12.636 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:12.670 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:13.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:13.290 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 103/145 2023-09-30T13:53:13.397 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 103/145 2023-09-30T13:53:13.398 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-09-30T13:53:13.398 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-09-30T13:53:13.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:13.433 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 104/145 2023-09-30T13:53:14.192 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:14.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:14.774 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 102/145 2023-09-30T13:53:14.824 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 103/145 2023-09-30T13:53:14.911 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 103/145 2023-09-30T13:53:14.912 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-09-30T13:53:14.912 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-09-30T13:53:14.912 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:14.942 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 104/145 2023-09-30T13:53:25.515 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 104/145 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2023-09-30T13:53:25.516 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:25.677 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 105/145 2023-09-30T13:53:25.693 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 105/145 2023-09-30T13:53:25.693 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:25.693 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-09-30T13:53:25.693 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 104/145 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-09-30T13:53:26.745 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:26.912 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 105/145 2023-09-30T13:53:26.927 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 105/145 2023-09-30T13:53:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-09-30T13:53:26.927 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:27.314 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 106/145 2023-09-30T13:53:27.341 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 106/145 2023-09-30T13:53:27.341 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:27.341 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-09-30T13:53:27.341 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-30T13:53:27.341 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-30T13:53:27.342 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:27.565 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 107/145 2023-09-30T13:53:27.588 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 107/145 2023-09-30T13:53:27.588 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:27.588 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-09-30T13:53:27.589 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-30T13:53:27.589 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-30T13:53:27.589 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:28.057 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 108/145 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 108/145 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-30T13:53:28.081 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:28.414 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 109/145 2023-09-30T13:53:28.431 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 109/145 2023-09-30T13:53:28.460 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 110/145 2023-09-30T13:53:28.473 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 106/145 2023-09-30T13:53:28.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 106/145 2023-09-30T13:53:28.499 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:28.499 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-09-30T13:53:28.499 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-30T13:53:28.499 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-09-30T13:53:28.499 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:28.524 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 111/145 2023-09-30T13:53:28.554 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 112/145 2023-09-30T13:53:28.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 107/145 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 107/145 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-09-30T13:53:28.729 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:28.788 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 112/145 2023-09-30T13:53:28.822 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 113/145 2023-09-30T13:53:29.166 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 108/145 2023-09-30T13:53:29.188 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 108/145 2023-09-30T13:53:29.188 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:29.189 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-09-30T13:53:29.189 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-30T13:53:29.189 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-09-30T13:53:29.189 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:29.623 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 109/145 2023-09-30T13:53:29.648 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 109/145 2023-09-30T13:53:29.677 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 110/145 2023-09-30T13:53:29.739 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 111/145 2023-09-30T13:53:29.763 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 112/145 2023-09-30T13:53:29.842 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 113/145 2023-09-30T13:53:29.872 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 114/145 2023-09-30T13:53:29.976 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 114/145 2023-09-30T13:53:29.985 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 112/145 2023-09-30T13:53:30.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 113/145 2023-09-30T13:53:30.136 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 115/145 2023-09-30T13:53:30.165 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 116/145 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 116/145 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-30T13:53:30.190 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:30.225 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 117/145 2023-09-30T13:53:30.236 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 117/145 2023-09-30T13:53:30.983 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 113/145 2023-09-30T13:53:31.006 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 114/145 2023-09-30T13:53:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 118/145 2023-09-30T13:53:31.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 119/145 2023-09-30T13:53:31.103 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 114/145 2023-09-30T13:53:31.108 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 119/145 2023-09-30T13:53:31.109 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:31.109 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-09-30T13:53:31.109 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-30T13:53:31.109 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-30T13:53:31.109 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:31.151 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 120/145 2023-09-30T13:53:31.175 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 120/145 2023-09-30T13:53:31.175 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:31.175 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-09-30T13:53:31.175 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:31.219 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 121/145 2023-09-30T13:53:31.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 121/145 2023-09-30T13:53:31.242 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:31.243 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-09-30T13:53:31.243 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-30T13:53:31.243 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-30T13:53:31.243 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:31.263 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 115/145 2023-09-30T13:53:31.300 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 116/145 2023-09-30T13:53:31.322 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 116/145 2023-09-30T13:53:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-09-30T13:53:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-30T13:53:31.323 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-09-30T13:53:31.323 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:31.367 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 117/145 2023-09-30T13:53:31.377 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 117/145 2023-09-30T13:53:31.553 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 122/145 2023-09-30T13:53:31.576 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 122/145 2023-09-30T13:53:31.577 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:31.577 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-09-30T13:53:31.577 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-30T13:53:31.577 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-30T13:53:31.577 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:32.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 118/145 2023-09-30T13:53:32.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 119/145 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 119/145 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-09-30T13:53:32.199 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:32.236 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 120/145 2023-09-30T13:53:32.257 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 120/145 2023-09-30T13:53:32.257 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:32.258 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-09-30T13:53:32.258 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:32.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 121/145 2023-09-30T13:53:32.325 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 121/145 2023-09-30T13:53:32.325 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:32.325 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-09-30T13:53:32.325 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-30T13:53:32.325 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-09-30T13:53:32.326 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:32.620 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 122/145 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 122/145 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-09-30T13:53:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:35.615 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 123/145 2023-09-30T13:53:35.664 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 124/145 2023-09-30T13:53:35.694 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 125/145 2023-09-30T13:53:35.903 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/145 2023-09-30T13:53:36.013 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/145 2023-09-30T13:53:36.072 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 128/145 2023-09-30T13:53:36.112 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/145 2023-09-30T13:53:36.144 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/145 2023-09-30T13:53:36.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_ 131/145 2023-09-30T13:53:36.222 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.45.2-1.el9.x86_64 132/145 2023-09-30T13:53:36.267 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.45.2-1.el9.x86_64 133/145 2023-09-30T13:53:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 123/145 2023-09-30T13:53:36.498 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 124/145 2023-09-30T13:53:36.528 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 125/145 2023-09-30T13:53:36.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/145 2023-09-30T13:53:36.835 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/145 2023-09-30T13:53:36.864 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:36.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 128/145 2023-09-30T13:53:36.907 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:36.927 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:36.946 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/145 2023-09-30T13:53:36.978 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/145 2023-09-30T13:53:37.017 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_ 131/145 2023-09-30T13:53:37.047 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.45.2-1.el9.x86_64 132/145 2023-09-30T13:53:37.084 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.45.2-1.el9.x86_64 133/145 2023-09-30T13:53:37.695 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:37.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:37.752 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 134/145 2023-09-30T13:53:37.822 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 135/145 2023-09-30T13:53:37.911 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 136/145 2023-09-30T13:53:37.961 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/145 2023-09-30T13:53:38.056 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/145 2023-09-30T13:53:38.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/145 2023-09-30T13:53:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 140/145 2023-09-30T13:53:38.115 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/145 2023-09-30T13:53:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/145 2023-09-30T13:53:38.224 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 142/145 2023-09-30T13:53:38.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:38.242 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:38.435 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:38.435 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 144/145 2023-09-30T13:53:38.502 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 144/145 2023-09-30T13:53:38.502 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 145/145 2023-09-30T13:53:38.552 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 135/145 2023-09-30T13:53:38.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 136/145 2023-09-30T13:53:38.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/145 2023-09-30T13:53:38.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/145 2023-09-30T13:53:38.823 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/145 2023-09-30T13:53:38.849 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 140/145 2023-09-30T13:53:38.850 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/145 2023-09-30T13:53:38.941 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/145 2023-09-30T13:53:38.966 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 142/145 2023-09-30T13:53:38.981 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:38.981 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:39.161 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:39.161 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 144/145 2023-09-30T13:53:39.244 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 144/145 2023-09-30T13:53:39.244 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 145/145 2023-09-30T13:53:43.089 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 145/145 2023-09-30T13:53:43.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 1/145 2023-09-30T13:53:43.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 2/145 2023-09-30T13:53:43.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 3/145 2023-09-30T13:53:43.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 4/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 8/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 9/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 10/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 11/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 12/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 13/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_ 14/145 2023-09-30T13:53:43.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 15/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 16/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_6 17/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 18/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 19/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 20/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el9. 21/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_6 22/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 23/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 24/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 25/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 26/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 27/145 2023-09-30T13:53:43.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 28/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 29/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 30/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 31/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 32/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 33/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 34/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 35/145 2023-09-30T13:53:43.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 36/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 37/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 38/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/145 2023-09-30T13:53:43.093 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/145 2023-09-30T13:53:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/145 2023-09-30T13:53:43.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 78/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 79/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 80/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 81/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 82/145 2023-09-30T13:53:43.096 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 83/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 84/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.6-15.el9.x86_64 88/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/145 2023-09-30T13:53:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/145 2023-09-30T13:53:43.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.23.0-1.el9.noarch 108/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/145 2023-09-30T13:53:43.099 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/145 2023-09-30T13:53:43.100 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 134/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 136/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.45.2-1.el9.x86_64 138/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 139/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 140/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 141/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.45.2-1.el9.x86_64 142/145 2023-09-30T13:53:43.101 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:43.102 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.45.2-1.el9.x86_64 144/145 2023-09-30T13:53:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 145/145 2023-09-30T13:53:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 1/145 2023-09-30T13:53:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 2/145 2023-09-30T13:53:44.243 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 3/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 4/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 6/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 7/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 8/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 9/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 10/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 11/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 12/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 13/145 2023-09-30T13:53:44.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_ 14/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 15/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 16/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_6 17/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86 18/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 19/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 20/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el9. 21/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_6 22/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 23/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 24/145 2023-09-30T13:53:44.245 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 25/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 26/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 27/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 28/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 29/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noa 30/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.n 31/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 32/145 2023-09-30T13:53:44.256 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 33/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 34/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 35/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 36/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 37/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 38/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/145 2023-09-30T13:53:44.257 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/145 2023-09-30T13:53:44.258 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/145 2023-09-30T13:53:44.259 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/145 2023-09-30T13:53:44.260 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 78/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 79/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 80/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 81/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 82/145 2023-09-30T13:53:44.261 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 83/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 84/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-15.el9.x86_64 88/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/145 2023-09-30T13:53:44.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/145 2023-09-30T13:53:44.263 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/145 2023-09-30T13:53:44.264 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/145 2023-09-30T13:53:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/145 2023-09-30T13:53:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/145 2023-09-30T13:53:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/145 2023-09-30T13:53:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/145 2023-09-30T13:53:44.265 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.23.0-1.el9.noarch 108/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/145 2023-09-30T13:53:44.266 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/145 2023-09-30T13:53:44.267 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/145 2023-09-30T13:53:44.268 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/145 2023-09-30T13:53:44.269 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 134/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 136/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.45.2-1.el9.x86_64 138/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 139/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.45.2-1.el9.x86_64 140/145 2023-09-30T13:53:44.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 141/145 2023-09-30T13:53:44.271 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.45.2-1.el9.x86_64 142/145 2023-09-30T13:53:44.271 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 143/145 2023-09-30T13:53:44.271 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.45.2-1.el9.x86_64 144/145 2023-09-30T13:53:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 145/145 2023-09-30T13:53:45.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2023-09-30T13:53:45.634 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:45.636 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: fmt-8.1.1-5.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-15.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: jq-1.6-15.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-9.el9.x86_64 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-09-30T13:53:45.637 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-45.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.11-1.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-09-30T13:53:45.639 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.11-1.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-09-30T13:53:45.640 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.23.0-1.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-09-30T13:53:45.641 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-09-30T13:53:45.642 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-09-30T13:53:45.643 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-7.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-09-30T13:53:45.644 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-09-30T13:53:45.645 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-09-30T13:53:45.646 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-09-30T13:53:45.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:45.646 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2023-09-30T13:53:46.007 DEBUG:teuthology.parallel:result is None 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 145/145 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.45.2-1.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.005 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.006 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.007 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-6447.g1d10b717.el9.noarch 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: fmt-8.1.1-5.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-09-30T13:53:47.008 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-15.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-9.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.009 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-09-30T13:53:47.010 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.11-1.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.11-1.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.011 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.23.0-1.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-09-30T13:53:47.012 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-09-30T13:53:47.013 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.014 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-7.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-09-30T13:53:47.015 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2023-09-30T13:53:47.016 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-09-30T13:53:47.017 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-09-30T13:53:47.017 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-09-30T13:53:47.017 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:47.017 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-09-30T13:53:47.381 DEBUG:teuthology.parallel:result is None 2023-09-30T13:53:47.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T13:53:47.529 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T13:53:47.556 INFO:teuthology.orchestra.run.smithi062.stdout:18.0.0-6447.g1d10b717.el9 2023-09-30T13:53:47.557 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el9 2023-09-30T13:53:47.557 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T13:53:47.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T13:53:47.703 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T13:53:47.724 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-6447.g1d10b717.el9 2023-09-30T13:53:47.725 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el9 2023-09-30T13:53:47.725 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T13:53:47.725 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T13:53:47.725 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:47.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T13:53:47.765 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:47.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T13:53:47.794 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T13:53:47.795 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:47.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T13:53:47.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T13:53:47.912 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:47.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T13:53:47.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T13:53:48.006 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T13:53:48.007 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:48.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T13:53:48.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T13:53:48.111 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:48.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T13:53:48.137 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T13:53:48.203 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T13:53:48.204 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:48.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T13:53:48.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T13:53:48.308 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:48.308 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T13:53:48.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T13:53:48.403 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T13:53:48.468 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T13:53:48.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2023-09-30T13:53:48.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2023-09-30T13:53:48.500 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T13:53:48.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T13:53:48.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T13:53:48.571 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T13:53:48.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T13:53:48.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T13:53:48.650 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-30T13:53:48.650 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-30T13:53:48.650 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-30T13:53:48.650 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:48.650 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T13:53:48.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T13:53:48.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-30T13:53:48.861 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:48.861 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T13:53:48.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T13:53:48.991 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-30T13:53:49.023 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T13:53:49.023 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T13:53:49.024 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7407589', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 76, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6478, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGZBAhHPuluu1uEAN7RJbWAWb9Rc1RiIZ09OFcjEkpCMJtg6ZtvAu6tQxSvbIICTn7Y1fDINEVlPDyrrlnSbM0=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRhBi4DeLtpJNYmZrP4yTEJzTwCziio4JdbwekYe9qRFGbHPgD3JmLuig9RWJKPhQGu+FfG8Rs+h7gr3F4C/q4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:46:13', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T13:53:49.024 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T13:53:49.027 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T13:53:49.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T13:53:49.082 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T13:53:49.139 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:49.139 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T13:53:49.165 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T13:53:49.165 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-09-30 13:53:38.968373569 +0000 2023-09-30T13:53:49.220 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-09-30 13:51:48.872127124 +0000 2023-09-30T13:53:49.221 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-09-30 13:51:48.872127124 +0000 2023-09-30T13:53:49.221 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2023-09-30 13:51:48.872127124 +0000 2023-09-30T13:53:49.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T13:53:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-09-30T13:53:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-09-30T13:53:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000200041 s, 2.6 MB/s 2023-09-30T13:53:49.290 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T13:53:49.346 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2023-09-30T13:53:49.401 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T13:53:49.401 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:49.401 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-09-30T13:53:49.401 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:49.401 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:49.402 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-09-30 13:53:38.968373569 +0000 2023-09-30T13:53:49.402 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-09-30 13:51:49.389119321 +0000 2023-09-30T13:53:49.402 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-09-30 13:51:49.389119321 +0000 2023-09-30T13:53:49.402 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2023-09-30 13:51:49.389119321 +0000 2023-09-30T13:53:49.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T13:53:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-09-30T13:53:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-09-30T13:53:49.471 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000204331 s, 2.5 MB/s 2023-09-30T13:53:49.472 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T13:53:49.528 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2023-09-30T13:53:49.583 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T13:53:49.583 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-09-30 13:53:38.968373569 +0000 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-09-30 13:51:49.905111533 +0000 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-09-30 13:51:49.905111533 +0000 2023-09-30T13:53:49.584 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2023-09-30 13:51:49.905111533 +0000 2023-09-30T13:53:49.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T13:53:49.652 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-09-30T13:53:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-09-30T13:53:49.653 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000225533 s, 2.3 MB/s 2023-09-30T13:53:49.654 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T13:53:49.711 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2023-09-30T13:53:49.766 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T13:53:49.766 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:49.766 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-09-30 13:53:38.969373553 +0000 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-09-30 13:51:50.419103775 +0000 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-09-30 13:51:50.419103775 +0000 2023-09-30T13:53:49.767 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2023-09-30 13:51:50.419103775 +0000 2023-09-30T13:53:49.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T13:53:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-09-30T13:53:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-09-30T13:53:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000227534 s, 2.3 MB/s 2023-09-30T13:53:49.836 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T13:53:49.892 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:49.892 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:49.893 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T13:53:49.911 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T13:53:49.911 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-09-30T13:53:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T13:53:49.969 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:49.969 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-09-30T13:53:49.969 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:49.970 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:49.970 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-30 13:53:39.714854040 +0000 2023-09-30T13:53:49.970 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-30 13:51:40.582998740 +0000 2023-09-30T13:53:49.970 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-30 13:51:40.582998740 +0000 2023-09-30T13:53:49.970 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-30 13:51:40.582998740 +0000 2023-09-30T13:53:49.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T13:53:50.038 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-30T13:53:50.038 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-30T13:53:50.039 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000521911 s, 981 kB/s 2023-09-30T13:53:50.040 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T13:53:50.097 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-09-30T13:53:50.153 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T13:53:50.153 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:50.153 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-09-30T13:53:50.153 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:50.154 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:50.154 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-30 13:53:39.714854040 +0000 2023-09-30T13:53:50.154 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-30 13:51:41.101988147 +0000 2023-09-30T13:53:50.154 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-30 13:51:41.101988147 +0000 2023-09-30T13:53:50.154 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-30 13:51:41.101988147 +0000 2023-09-30T13:53:50.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T13:53:50.220 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-30T13:53:50.220 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-30T13:53:50.220 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000218883 s, 2.3 MB/s 2023-09-30T13:53:50.221 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T13:53:50.278 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-30 13:53:39.715854020 +0000 2023-09-30T13:53:50.334 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-30 13:51:41.598978003 +0000 2023-09-30T13:53:50.335 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-30 13:51:41.598978003 +0000 2023-09-30T13:53:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-30 13:51:41.598978003 +0000 2023-09-30T13:53:50.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T13:53:50.400 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-30T13:53:50.401 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-30T13:53:50.401 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000189247 s, 2.7 MB/s 2023-09-30T13:53:50.402 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T13:53:50.459 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-09-30T13:53:50.514 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-09-30 13:53:39.715854020 +0000 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-09-30 13:51:42.110967553 +0000 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-09-30 13:51:42.110967553 +0000 2023-09-30T13:53:50.515 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-09-30 13:51:42.110967553 +0000 2023-09-30T13:53:50.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T13:53:50.580 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-09-30T13:53:50.581 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-09-30T13:53:50.581 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000172609 s, 3.0 MB/s 2023-09-30T13:53:50.582 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T13:53:50.637 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:50.637 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T13:53:50.637 INFO:tasks.ceph:Generating config... 2023-09-30T13:53:50.638 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T13:53:50.638 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T13:53:50.639 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T13:53:50.639 INFO:tasks.ceph:[client] pid file = 2023-09-30T13:53:50.639 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T13:53:50.639 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T13:53:50.639 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T13:53:50.639 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T13:53:50.639 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T13:53:50.639 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T13:53:50.639 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T13:53:50.640 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T13:53:50.641 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T13:53:50.641 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T13:53:50.642 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T13:53:50.642 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T13:53:50.642 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T13:53:50.642 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T13:53:50.642 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T13:53:50.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T13:53:50.709 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T13:53:50.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T13:53:50.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T13:53:50.794 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2023-09-30T13:53:50.795 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T13:53:50.795 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:50.796 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T13:53:50.849 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:50.934 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:50.934 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 79595c1b-6895-4c76-9183-336503666b5b 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = pacific 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 79595c1b-6895-4c76-9183-336503666b5b 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2023-09-30T13:53:50.935847+0000 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:created 2023-09-30T13:53:50.935847+0000 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 16 (pacific) 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2023-09-30T13:53:50.935 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2023-09-30T13:53:50.936 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T13:53:50.937 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T13:53:50.951 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 79595c1b-6895-4c76-9183-336503666b5b... 2023-09-30T13:53:50.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T13:53:50.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T13:53:51.044 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2023-09-30T13:53:51.044 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.045 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2023-09-30T13:53:51.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T13:53:51.047 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.62,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 79595c1b-6895-4c76-9183-336503666b5b 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2023-09-30T13:53:51.048 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2023-09-30T13:53:51.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2023-09-30T13:53:51.050 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2023-09-30T13:53:51.051 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-09-30T13:53:51.052 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2023-09-30T13:53:51.053 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.054 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2023-09-30T13:53:51.055 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-09-30T13:53:51.056 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-09-30T13:53:51.057 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2023-09-30T13:53:51.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T13:53:51.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2023-09-30T13:53:51.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 79595c1b-6895-4c76-9183-336503666b5b 2023-09-30T13:53:51.061 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2023-09-30T13:53:51.062 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.063 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2023-09-30T13:53:51.064 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2023-09-30T13:53:51.065 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2023-09-30T13:53:51.066 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T13:53:51.067 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2023-09-30T13:53:51.068 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = "" 2023-09-30T13:53:51.069 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-09-30T13:53:51.070 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-09-30T13:53:51.071 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-09-30T13:53:51.074 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T13:53:51.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T13:53:51.133 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T13:53:51.134 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:51.134 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T13:53:51.149 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:51.149 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T13:53:51.204 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:53:51.204 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:51.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T13:53:51.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T13:53:51.290 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:53:51.290 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:51.345 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:53:51.345 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:51.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T13:53:51.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T13:53:51.384 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:53:51.385 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:51.439 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T13:53:51.439 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T13:53:51.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T13:53:51.501 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T13:53:51.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T13:53:51.574 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T13:53:51.577 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T13:53:51.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T13:53:51.639 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T13:53:51.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T13:53:51.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T13:53:51.773 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T13:53:51.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-30T13:53:51.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T13:53:51.860 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T13:53:51.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-30T13:53:51.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T13:53:51.983 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-30T13:53:51.986 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-30T13:53:52.012 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T13:53:52.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T13:53:52.059 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T13:53:52.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-30T13:53:52.123 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-30T13:53:52.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-30T13:53:52.184 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-30T13:53:52.199 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-30T13:53:52.281 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-30T13:53:52.296 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T13:53:52.296 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-30T13:53:52.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T13:53:52.327 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:52.327 INFO:tasks.ceph:role: osd.0 2023-09-30T13:53:52.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:53:52.327 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T13:53:52.405 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:53:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:53:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:53:52.405 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:53:52.405 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:53:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:53:52.406 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:53:52.406 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:53:52.406 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:53:52.406 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:53:52.926 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-09-30T13:53:52.928 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-09-30T13:53:52.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T13:53:53.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T13:53:53.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T13:53:53.188 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:53.188 INFO:tasks.ceph:role: osd.1 2023-09-30T13:53:53.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:53:53.189 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:53:53.268 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:53:53.269 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:53:53.269 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:53:53.269 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:53:53.721 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-09-30T13:53:53.723 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-09-30T13:53:53.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T13:53:53.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T13:53:53.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T13:53:53.937 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:53.937 INFO:tasks.ceph:role: osd.2 2023-09-30T13:53:53.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:53:53.938 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T13:53:54.017 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:53:54.018 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:53:54.506 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-09-30T13:53:54.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-09-30T13:53:54.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T13:53:54.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T13:53:54.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T13:53:54.795 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T13:53:54.796 INFO:tasks.ceph:role: osd.3 2023-09-30T13:53:54.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:53:54.796 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T13:53:54.876 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:53:54.876 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:53:54.876 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:53:54.876 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:53:54.876 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:53:54.877 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:53:54.877 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:53:54.877 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:53:54.877 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:53:54.877 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:53:55.387 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-09-30T13:53:55.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-09-30T13:53:55.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T13:53:55.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T13:53:55.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:55.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.644+0000 7fdeb4774500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T13:53:55.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.644+0000 7fdeb4774500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T13:53:55.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.644+0000 7fdeb4774500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T13:53:55.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.644+0000 7fdeb4774500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T13:53:55.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.644+0000 7fdeb4774500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T13:53:55.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:55.645+0000 7fdeb4774500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T13:53:58.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T13:53:58.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:53:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.632+0000 7f700140e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T13:53:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.632+0000 7f700140e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T13:53:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.632+0000 7f700140e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T13:53:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.632+0000 7f700140e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T13:53:58.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.632+0000 7f700140e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T13:53:58.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:53:58.633+0000 7f700140e500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T13:54:01.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T13:54:01.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.622+0000 7f5e11a21500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T13:54:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.623+0000 7f5e11a21500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T13:54:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.623+0000 7f5e11a21500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T13:54:01.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.623+0000 7f5e11a21500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T13:54:01.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.623+0000 7f5e11a21500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T13:54:01.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:01.623+0000 7f5e11a21500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T13:54:04.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T13:54:04.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.602+0000 7f450000e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.602+0000 7f450000e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.602+0000 7f450000e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.602+0000 7f450000e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.602+0000 7f450000e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T13:54:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:04.603+0000 7f450000e500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T13:54:07.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T13:54:07.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-30T13:54:07.519 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T13:54:07.520 INFO:tasks.ceph:role: osd.4 2023-09-30T13:54:07.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:54:07.520 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T13:54:07.598 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:54:07.598 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:54:07.599 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:54:08.090 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-09-30T13:54:08.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-09-30T13:54:08.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-30T13:54:08.226 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-30T13:54:08.259 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-30T13:54:08.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T13:54:08.327 INFO:tasks.ceph:role: osd.5 2023-09-30T13:54:08.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:54:08.327 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T13:54:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:54:08.400 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:54:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:54:08.858 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-09-30T13:54:08.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-09-30T13:54:08.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-30T13:54:08.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-30T13:54:08.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-30T13:54:09.042 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T13:54:09.042 INFO:tasks.ceph:role: osd.6 2023-09-30T13:54:09.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:54:09.043 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T13:54:09.116 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:54:09.116 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:54:09.116 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:54:09.116 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:54:09.117 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:54:09.600 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-09-30T13:54:09.602 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-09-30T13:54:09.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-30T13:54:09.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-30T13:54:09.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-30T13:54:09.837 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-30T13:54:09.837 INFO:tasks.ceph:role: osd.7 2023-09-30T13:54:09.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:54:09.837 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T13:54:09.911 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-09-30T13:54:09.912 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T13:54:09.912 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-09-30T13:54:09.912 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T13:54:09.912 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T13:54:10.411 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-09-30T13:54:10.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-09-30T13:54:10.413 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-30T13:54:10.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-30T13:54:10.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:10.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.678+0000 7f70500a1500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-30T13:54:10.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.678+0000 7f70500a1500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-30T13:54:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.678+0000 7f70500a1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T13:54:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.678+0000 7f70500a1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T13:54:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.678+0000 7f70500a1500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-30T13:54:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:10.679+0000 7f70500a1500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-30T13:54:13.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-30T13:54:13.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:13.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.649+0000 7f5862c16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-30T13:54:13.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.649+0000 7f5862c16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-30T13:54:13.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.649+0000 7f5862c16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T13:54:13.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.649+0000 7f5862c16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T13:54:13.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.649+0000 7f5862c16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-30T13:54:13.650 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:13.650+0000 7f5862c16500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-30T13:54:16.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-30T13:54:16.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:16.633 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-30T13:54:16.633 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-30T13:54:16.633 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T13:54:16.634 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T13:54:16.634 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-30T13:54:16.634 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:16.633+0000 7f384f810500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-30T13:54:19.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:54:19.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:54:19.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-30T13:54:19.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.603+0000 7f97787be500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-30T13:54:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.603+0000 7f97787be500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-30T13:54:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.603+0000 7f97787be500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T13:54:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.603+0000 7f97787be500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T13:54:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.603+0000 7f97787be500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-30T13:54:19.603 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:19.604+0000 7f97787be500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-30T13:54:22.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-30T13:54:22.484 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T13:54:22.484 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-30T13:54:22.521 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T13:54:22.596 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-30T13:54:22.670 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T13:54:22.743 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T13:54:22.816 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T13:54:22.889 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:22.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T13:54:22.961 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:22.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T13:54:22.993 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:22.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-30T13:54:23.063 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-30T13:54:23.133 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-30T13:54:23.201 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.201 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-30T13:54:23.269 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-30T13:54:23.337 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.337 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-30T13:54:23.405 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:23.406 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T13:54:23.422 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:23.423 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-30T13:54:23.478 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.478 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-30T13:54:23.494 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:23.494 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-30T13:54:23.549 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T13:54:23.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T13:54:23.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T13:54:23.593 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhltKb8HRAATthRYp02RhUU2XOjqOo0Ug== 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhlxpAwJhAA9S96yMqtQkbHvOBPtH7FDQ== 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhlnvIqLhAA9wCFwL4CWvsyndpi2EmT0g== 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2023-09-30T13:54:23.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBzKBhly/ZyJhAARwfNM6QjXO7wBi9+nBIkCQ== 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB2KBhl96G/JRAAxiscRxTjKnlMCxKQPlgUKQ== 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB5KBhl8vUpJRAACE+BodmpiCvUUCab7G/9CQ== 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB8KBhlup4BJBAAa/xRihBaMU0E3jbIequ7+w== 2023-09-30T13:54:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhlS3lWIhAAiURVPGSV0bvLZYk/SlHvvg== 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhlwt1mMxAAofjPTwT8sJ6h6ZLq7/TL+Q== 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBvKBhleb65OhAAfneFfCzo7tFsfl5yQGo51A== 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2023-09-30T13:54:23.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCCKBhldMiBKBAA4DVzsMmj+BvYOXB2Ru6nKg== 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCFKBhl1KPEJhAArDc6YiyFATnvUAmfT6/+pQ== 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCIKBhlAn3MJRAA0zhhsqrXFNWJOguc/5FKHQ== 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCLKBhlA731IxAAOkK1g+EUEGh4FhLGqxqRbA== 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ== 2023-09-30T13:54:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2023-09-30T13:54:23.598 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhl4m9uBxAAGa9B6FqGeq+Wa8UIms5SSQ== 2023-09-30T13:54:23.598 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2023-09-30T13:54:23.598 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhlQ5EMCxAAzPZ3IeIR0UJAwlX3mZtKXA== 2023-09-30T13:54:23.598 INFO:teuthology.orchestra.run.smithi062.stdout:[client.3] 2023-09-30T13:54:23.598 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhl7G7dEBAAlufHYOxr3XBzPYX1Z7L03w== 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhltKb8HRAATthRYp02RhUU2XOjqOo0Ug== 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhlxpAwJhAA9S96yMqtQkbHvOBPtH7FDQ== 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhlnvIqLhAA9wCFwL4CWvsyndpi2EmT0g== 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2023-09-30T13:54:23.617 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBzKBhly/ZyJhAARwfNM6QjXO7wBi9+nBIkCQ== 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB2KBhl96G/JRAAxiscRxTjKnlMCxKQPlgUKQ== 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB5KBhl8vUpJRAACE+BodmpiCvUUCab7G/9CQ== 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB8KBhlup4BJBAAa/xRihBaMU0E3jbIequ7+w== 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2023-09-30T13:54:23.618 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhlS3lWIhAAiURVPGSV0bvLZYk/SlHvvg== 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhlwt1mMxAAofjPTwT8sJ6h6ZLq7/TL+Q== 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBvKBhleb65OhAAfneFfCzo7tFsfl5yQGo51A== 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCCKBhldMiBKBAA4DVzsMmj+BvYOXB2Ru6nKg== 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2023-09-30T13:54:23.619 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCFKBhl1KPEJhAArDc6YiyFATnvUAmfT6/+pQ== 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCIKBhlAn3MJRAA0zhhsqrXFNWJOguc/5FKHQ== 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCLKBhlA731IxAAOkK1g+EUEGh4FhLGqxqRbA== 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ== 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBwKBhl4m9uBxAAGa9B6FqGeq+Wa8UIms5SSQ== 2023-09-30T13:54:23.620 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2023-09-30T13:54:23.621 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBwKBhlQ5EMCxAAzPZ3IeIR0UJAwlX3mZtKXA== 2023-09-30T13:54:23.621 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2023-09-30T13:54:23.621 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBwKBhl7G7dEBAAlufHYOxr3XBzPYX1Z7L03w== 2023-09-30T13:54:23.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T13:54:23.642 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T13:54:23.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:23.718 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:23.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:23.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:23.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:23.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:23.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:23.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:23.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:23.949 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T13:54:24.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T13:54:24.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:24.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:24.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:24.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T13:54:24.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.289 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T13:54:24.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.513 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T13:54:24.685 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T13:54:24.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T13:54:24.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T13:54:24.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T13:54:24.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T13:54:24.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T13:54:24.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T13:54:24.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T13:54:25.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T13:54:25.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T13:54:25.190 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:25.192 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T13:54:25.245 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T13:54:25.245 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T13:54:25.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T13:54:25.248 INFO:tasks.ceph.mon.a:Started 2023-09-30T13:54:25.248 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T13:54:25.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T13:54:25.287 INFO:tasks.ceph.mon.b:Started 2023-09-30T13:54:25.287 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T13:54:25.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T13:54:25.289 INFO:tasks.ceph.mon.c:Started 2023-09-30T13:54:25.289 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T13:54:25.289 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-30T13:54:25.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-30T13:54:25.291 INFO:tasks.ceph.mgr.y:Started 2023-09-30T13:54:25.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T13:54:25.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T13:54:25.294 INFO:tasks.ceph.mgr.x:Started 2023-09-30T13:54:25.294 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T13:54:25.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T13:54:25.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.401+0000 7f8018b9e640 1 Processor -- start 2023-09-30T13:54:25.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.401+0000 7f8018b9e640 1 -- start start 2023-09-30T13:54:25.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8018b9e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 0x7f80140ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8018b9e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8018b9e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801406c540 con 0x7f801415d820 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8018b9e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801415dc90 con 0x7f80140aeb00 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8018b9e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140b29c0 con 0x7f8014153d20 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39946/0 (socket says 172.21.15.62:39946) 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 -- 172.21.15.62:0/4260739228 learned_addr learned my addr 172.21.15.62:0/4260739228 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:25.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f801259c640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 0x7f80140ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 msgr2=0x7f801415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 msgr2=0x7f801415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f8011d9b640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f801259c640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 msgr2=0x7f80140ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T13:54:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f801259c640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 msgr2=0x7f80140ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T13:54:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f801259c640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 0x7f80140ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T13:54:25.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.402+0000 7f801259c640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 0x7f80140ae5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T13:54:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.581+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463313732 0 0) 0x7f801406c540 con 0x7f801415d820 2023-09-30T13:54:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.581+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8000003520 con 0x7f801415d820 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477157352 0 0) 0x7f8000003520 con 0x7f801415d820 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 msgr2=0x7f80140ae5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.135:3300/0 conn(0x7f8014153d20 0x7f80140ae5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 msgr2=0x7f801415d2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 --2- 172.21.15.62:0/4260739228 >> v2:172.21.15.62:3300/0 conn(0x7f80140aeb00 0x7f801415d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014154100 con 0x7f801415d820 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.584+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f800c0019f0 con 0x7f801415d820 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 >> v1:172.21.15.135:6789/0 conn(0x7f801415d820 legacy=0x7f8014159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:25.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80000039c0 0x7f8000003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80000047c0 0x7f8000004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f800000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801415dc90 con 0x7f8000005180 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140b29c0 con 0x7f80000039c0 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800000e2e0 con 0x7f80000047c0 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f801259c640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80000039c0 0x7f8000003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f800000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8011d9b640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80000047c0 0x7f8000004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 -- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80000047c0 msgr2=0x7f8000004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80000047c0 0x7f8000004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 -- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80000039c0 msgr2=0x7f8000003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:25.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80000039c0 0x7f8000003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.585+0000 7f8012d9d640 1 -- 172.21.15.62:0/4260739228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000003520 con 0x7f8000005180 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.586+0000 7f8012d9d640 1 -- 172.21.15.62:0/4260739228 reap_dead start 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.586+0000 7f8012d9d640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f800000b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c4c0 tx=0x7f80000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06f9974fbccb186 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.586+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c02ccb0 con 0x7f8000005180 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.586+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c02ce30 con 0x7f8000005180 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.586+0000 7f801159a640 1 -- 172.21.15.62:0/4260739228 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c034680 con 0x7f8000005180 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 -- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 msgr2=0x7f800000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f800000b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c4c0 tx=0x7f80000057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 -- 172.21.15.62:0/4260739228 shutdown_connections 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 --2- 172.21.15.62:0/4260739228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f800000b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 -- 172.21.15.62:0/4260739228 >> 172.21.15.62:0/4260739228 conn(0x7f80140cb720 msgr2=0x7f80140ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 -- 172.21.15.62:0/4260739228 shutdown_connections 2023-09-30T13:54:25.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.587+0000 7f8018b9e640 1 -- 172.21.15.62:0/4260739228 wait complete. 2023-09-30T13:54:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.589+0000 7f8018b9e640 1 Processor -- start 2023-09-30T13:54:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.589+0000 7f8018b9e640 1 -- start start 2023-09-30T13:54:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 0x7f80141542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8014154830 0x7f80141f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141f13b0 con 0x7f8000005180 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141eeb30 con 0x7f8014150e30 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8018b9e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801414ae40 con 0x7f8014154830 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40002/0 (socket says 172.21.15.62:40002) 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 -- 172.21.15.62:0/3973485978 learned_addr learned my addr 172.21.15.62:0/3973485978 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8012d9d640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8014154830 0x7f80141f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8011d9b640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 0x7f80141542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 -- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8014154830 msgr2=0x7f80141f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8014154830 0x7f80141f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 -- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 msgr2=0x7f80141542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 0x7f80141542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f801259c640 1 -- 172.21.15.62:0/3973485978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80141ee290 con 0x7f8000005180 2023-09-30T13:54:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.590+0000 7f8011d9b640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 0x7f80141542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.591+0000 7f801259c640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0108f0 tx=0x7f7ffc010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00e9c0 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00eb20 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80141ee570 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00eed0 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80141512b0 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ffc016780 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.592+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ffc0148c0 con 0x7f8000005180 2023-09-30T13:54:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.593+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801404e0d0 con 0x7f8000005180 2023-09-30T13:54:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.595+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7ffc03eb40 con 0x7f8000005180 2023-09-30T13:54:25.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.661+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f801406e3a0 con 0x7f8000005180 2023-09-30T13:54:25.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.663+0000 7f800affd640 1 -- 172.21.15.62:0/3973485978 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7ffc02d020 con 0x7f8000005180 2023-09-30T13:54:25.662 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 msgr2=0x7f80141edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0108f0 tx=0x7f7ffc010db0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 shutdown_connections 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8014154830 0x7f80141f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014150e30 0x7f80141542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 --2- 172.21.15.62:0/3973485978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8000005180 0x7f80141edb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 >> 172.21.15.62:0/3973485978 conn(0x7f80140cb720 msgr2=0x7f80140cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 shutdown_connections 2023-09-30T13:54:25.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:25.664+0000 7f8018b9e640 1 -- 172.21.15.62:0/3973485978 wait complete. 2023-09-30T13:54:25.674 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T13:54:25.674 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T13:54:25.675 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:25.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T13:54:25.705 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:25.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T13:54:25.776 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:25.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T13:54:25.847 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:25.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T13:54:25.918 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:25.918 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-30T13:54:25.945 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:25.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-30T13:54:26.011 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:26.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-30T13:54:26.034 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.034+0000 7f6a9fa3b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T13:54:26.060 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:54:26.061 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-30T13:54:26.071 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.072+0000 7f523da3b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T13:54:26.089 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.089+0000 7f6a9fa3b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T13:54:26.115 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 1617d48e-c996-463c-bf1d-b5e3659642dd 0 2023-09-30T13:54:26.125 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.125+0000 7f523da3b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T13:54:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.254+0000 7eff5e2e0640 1 Processor -- start 2023-09-30T13:54:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.254+0000 7eff5e2e0640 1 -- start start 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5e2e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5e2e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff580ae300 0x7eff5806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5e2e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5806d740 con 0x7eff5815cee0 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5e2e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5806da20 con 0x7eff580ae300 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5e2e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5806dd00 con 0x7eff5815cb00 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:55756/0 (socket says 172.21.15.135:55756) 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 -- 172.21.15.135:0/2523475084 learned_addr learned my addr 172.21.15.135:0/2523475084 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.256 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff5c87d640 1 --2- 172.21.15.135:0/2523475084 >> v2:172.21.15.62:3300/0 conn(0x7eff580ae300 0x7eff5806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 -- 172.21.15.135:0/2523475084 >> v2:172.21.15.62:3300/0 conn(0x7eff580ae300 msgr2=0x7eff5806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 --2- 172.21.15.135:0/2523475084 >> v2:172.21.15.62:3300/0 conn(0x7eff580ae300 0x7eff5806ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 -- 172.21.15.135:0/2523475084 >> v1:172.21.15.62:6789/0 conn(0x7eff5815cee0 legacy=0x7eff580c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.255+0000 7eff57fff640 1 -- 172.21.15.135:0/2523475084 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5806dfe0 con 0x7eff5815cb00 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.256+0000 7eff57fff640 1 --2- 172.21.15.135:0/2523475084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff48009870 tx=0x7eff4802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2dd724465bb0cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.256+0000 7eff56ffd640 1 -- 172.21.15.135:0/2523475084 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48030840 con 0x7eff5815cb00 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.256+0000 7eff56ffd640 1 -- 172.21.15.135:0/2523475084 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff480309a0 con 0x7eff5815cb00 2023-09-30T13:54:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.256+0000 7eff56ffd640 1 -- 172.21.15.135:0/2523475084 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48030d30 con 0x7eff5815cb00 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 -- 172.21.15.135:0/2523475084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 msgr2=0x7eff58071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/2523475084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff48009870 tx=0x7eff4802b980 comp rx=0 tx=0).stop 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 -- 172.21.15.135:0/2523475084 shutdown_connections 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/2523475084 >> v2:172.21.15.62:3300/0 conn(0x7eff580ae300 0x7eff5806ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/2523475084 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cb00 0x7eff58071860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 -- 172.21.15.135:0/2523475084 >> 172.21.15.135:0/2523475084 conn(0x7eff58070970 msgr2=0x7eff58070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 -- 172.21.15.135:0/2523475084 shutdown_connections 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.257+0000 7eff5e2e0640 1 -- 172.21.15.135:0/2523475084 wait complete. 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.258+0000 7eff5e2e0640 1 Processor -- start 2023-09-30T13:54:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.258+0000 7eff5e2e0640 1 -- start start 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 0x7eff581512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff5815cb00 0x7eff581f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580b3b40 con 0x7eff5815cb00 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580b31e0 con 0x7eff580ae300 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5e2e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff580b3480 con 0x7eff5815cee0 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 0x7eff581512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:55760/0 (socket says 172.21.15.135:55760) 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 -- 172.21.15.135:0/3356256472 learned_addr learned my addr 172.21.15.135:0/3356256472 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff577fe640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff5815cb00 0x7eff581f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 -- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 msgr2=0x7eff581512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 0x7eff581512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 -- 172.21.15.135:0/3356256472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff5815cb00 msgr2=0x7eff581f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff5815cb00 0x7eff581f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 -- 172.21.15.135:0/3356256472 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480094d0 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff57fff640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 0x7eff581512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff5c87d640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff50007d80 tx=0x7eff5000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50014420 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.259+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50014580 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff580b3760 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50014930 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff581f2e00 con 0x7eff5815cee0 2023-09-30T13:54:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff5001e460 con 0x7eff5815cee0 2023-09-30T13:54:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff5001d3c0 con 0x7eff5815cee0 2023-09-30T13:54:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.260+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff580666d0 con 0x7eff5815cee0 2023-09-30T13:54:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.263+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7eff5001e8a0 con 0x7eff5815cee0 2023-09-30T13:54:26.333 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.333+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1617d48e-c996-463c-bf1d-b5e3659642dd", "id": 0} v 0) v1 -- 0x7eff580b3c80 con 0x7eff5815cee0 2023-09-30T13:54:26.336 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.336+0000 7eff54ff9640 1 -- 172.21.15.135:0/3356256472 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1617d48e-c996-463c-bf1d-b5e3659642dd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff580b3c80 con 0x7eff5815cee0 2023-09-30T13:54:26.337 INFO:teuthology.orchestra.run.smithi135.stdout:0 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 msgr2=0x7eff580c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff50007d80 tx=0x7eff5000e4b0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 shutdown_connections 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff5815cee0 0x7eff580c6d10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff5815cb00 0x7eff581f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 --2- 172.21.15.135:0/3356256472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff580ae300 0x7eff581512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 >> 172.21.15.135:0/3356256472 conn(0x7eff58070970 msgr2=0x7eff580cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.338 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 shutdown_connections 2023-09-30T13:54:26.339 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.337+0000 7eff5e2e0640 1 -- 172.21.15.135:0/3356256472 wait complete. 2023-09-30T13:54:26.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 7334acb9-dd02-4c65-968a-e6f3eb5aa1b1 1 2023-09-30T13:54:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.448+0000 7f3e18dc0640 1 Processor -- start 2023-09-30T13:54:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.448+0000 7f3e18dc0640 1 -- start start 2023-09-30T13:54:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e18dc0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e140cca40 0x7f3e1406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e18dc0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e18dc0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140cdb30 con 0x7f3e1415dc60 2023-09-30T13:54:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e18dc0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140ccf20 con 0x7f3e140cca40 2023-09-30T13:54:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e18dc0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140cd200 con 0x7f3e140cdfc0 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e12d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e0bfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e140cca40 0x7f3e1406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e0bfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e140cca40 0x7f3e1406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59146/0 (socket says 172.21.15.135:59146) 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e12d9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:38964/0 (socket says 172.21.15.135:38964) 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.449+0000 7f3e0bfff640 1 -- 172.21.15.135:0/2055357949 learned_addr learned my addr 172.21.15.135:0/2055357949 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e0bfff640 1 -- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 msgr2=0x7f3e140ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e0bfff640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e0bfff640 1 -- 172.21.15.135:0/2055357949 >> v1:172.21.15.135:6789/0 conn(0x7f3e1415dc60 legacy=0x7f3e140b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e0bfff640 1 -- 172.21.15.135:0/2055357949 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140cd4e0 con 0x7f3e140cca40 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e12d9d640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e0bfff640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e1406db70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009870 tx=0x7f3dfc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c175968798083099 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e11d9b640 1 -- 172.21.15.135:0/2055357949 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc031640 con 0x7f3e140cca40 2023-09-30T13:54:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e11d9b640 1 -- 172.21.15.135:0/2055357949 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0317a0 con 0x7f3e140cca40 2023-09-30T13:54:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.450+0000 7f3e11d9b640 1 -- 172.21.15.135:0/2055357949 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc031b30 con 0x7f3e140cca40 2023-09-30T13:54:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 -- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 msgr2=0x7f3e1406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e1406db70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009870 tx=0x7f3dfc02b8f0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 -- 172.21.15.135:0/2055357949 shutdown_connections 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e140ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/2055357949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e1406db70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 -- 172.21.15.135:0/2055357949 >> 172.21.15.135:0/2055357949 conn(0x7f3e14070970 msgr2=0x7f3e14070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 -- 172.21.15.135:0/2055357949 shutdown_connections 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.451+0000 7f3e18dc0640 1 -- 172.21.15.135:0/2055357949 wait complete. 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.452+0000 7f3e18dc0640 1 Processor -- start 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.452+0000 7f3e18dc0640 1 -- start start 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e14154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1415dc60 0x7f3e14158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c9010 con 0x7f3e1415dc60 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c4530 con 0x7f3e140cca40 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e18dc0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c4810 con 0x7f3e140cdfc0 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e14154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e1259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e1259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59148/0 (socket says 172.21.15.135:59148) 2023-09-30T13:54:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e1259c640 1 -- 172.21.15.135:0/4179406569 learned_addr learned my addr 172.21.15.135:0/4179406569 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e12d9d640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1415dc60 0x7f3e14158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 -- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 msgr2=0x7f3e140c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 -- 172.21.15.135:0/4179406569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1415dc60 msgr2=0x7f3e14158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1415dc60 0x7f3e14158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e0bfff640 1 -- 172.21.15.135:0/4179406569 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009a70 con 0x7f3e140cdfc0 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.453+0000 7f3e1259c640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0bfff640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e14154cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc033000 tx=0x7f3dfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc03ac60 con 0x7f3e140cdfc0 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc03ade0 con 0x7f3e140cdfc0 2023-09-30T13:54:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc044630 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc0094d0 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e140c4dd0 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3dfc02f050 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.454+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3dfc04d920 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.455+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e140666d0 con 0x7f3e140cdfc0 2023-09-30T13:54:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.457+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3dfc035020 con 0x7f3e140cdfc0 2023-09-30T13:54:26.529 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.529+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7334acb9-dd02-4c65-968a-e6f3eb5aa1b1", "id": 1} v 0) v1 -- 0x7f3e1404e0d0 con 0x7f3e140cdfc0 2023-09-30T13:54:26.532 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.532+0000 7f3e0affd640 1 -- 172.21.15.135:0/4179406569 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7334acb9-dd02-4c65-968a-e6f3eb5aa1b1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3dfc02d040 con 0x7f3e140cdfc0 2023-09-30T13:54:26.532 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-09-30T13:54:26.533 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 msgr2=0x7f3e14154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.533 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e14154cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc033000 tx=0x7f3dfc0046c0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.533 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 shutdown_connections 2023-09-30T13:54:26.533 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1415dc60 0x7f3e14158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.534 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e140cdfc0 0x7f3e14154cf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.534 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 --2- 172.21.15.135:0/4179406569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e140cca40 0x7f3e140c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.534 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 >> 172.21.15.135:0/4179406569 conn(0x7f3e14070970 msgr2=0x7f3e140b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.534 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 shutdown_connections 2023-09-30T13:54:26.534 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.533+0000 7f3e18dc0640 1 -- 172.21.15.135:0/4179406569 wait complete. 2023-09-30T13:54:26.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 22a78843-494d-4097-8a92-4b60a70d2e7b 2 2023-09-30T13:54:26.642 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.642+0000 7f6a9fa3b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T13:54:26.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.643+0000 7f71279a9640 1 Processor -- start 2023-09-30T13:54:26.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.644+0000 7f71279a9640 1 -- start start 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.644+0000 7f71279a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f712015d1a0 0x7f712006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.644+0000 7f71279a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712006bc80 con 0x7f71200b4f80 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.644+0000 7f71279a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71200ae7b0 con 0x7f71200cbc30 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.644+0000 7f71279a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712015d580 con 0x7f712015d1a0 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f712015d1a0 0x7f712006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f712015d1a0 0x7f712006ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59152/0 (socket says 172.21.15.135:59152) 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 -- 172.21.15.135:0/1456114367 learned_addr learned my addr 172.21.15.135:0/1456114367 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 -- 172.21.15.135:0/1456114367 >> v1:172.21.15.135:6789/0 conn(0x7f71200cbc30 legacy=0x7f712006ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 -- 172.21.15.135:0/1456114367 >> v1:172.21.15.62:6789/0 conn(0x7f71200b4f80 legacy=0x7f712006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.646 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.645+0000 7f7125745640 1 -- 172.21.15.135:0/1456114367 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71200aea90 con 0x7f712015d1a0 2023-09-30T13:54:26.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f7125745640 1 --2- 172.21.15.135:0/1456114367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712015d1a0 0x7f712006ed30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7110009870 tx=0x7f711002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc8ba414959729 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f7117fff640 1 -- 172.21.15.135:0/1456114367 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002f840 con 0x7f712015d1a0 2023-09-30T13:54:26.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f7117fff640 1 -- 172.21.15.135:0/1456114367 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711002f9a0 con 0x7f712015d1a0 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f7117fff640 1 -- 172.21.15.135:0/1456114367 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002fd30 con 0x7f712015d1a0 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f71279a9640 1 -- 172.21.15.135:0/1456114367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712015d1a0 msgr2=0x7f712006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f71279a9640 1 --2- 172.21.15.135:0/1456114367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712015d1a0 0x7f712006ed30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7110009870 tx=0x7f711002ba20 comp rx=0 tx=0).stop 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f71279a9640 1 -- 172.21.15.135:0/1456114367 shutdown_connections 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f71279a9640 1 --2- 172.21.15.135:0/1456114367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712015d1a0 0x7f712006ed30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.646+0000 7f71279a9640 1 -- 172.21.15.135:0/1456114367 >> 172.21.15.135:0/1456114367 conn(0x7f71200cc180 msgr2=0x7f71200cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.647+0000 7f71279a9640 1 -- 172.21.15.135:0/1456114367 shutdown_connections 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.647+0000 7f71279a9640 1 -- 172.21.15.135:0/1456114367 wait complete. 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 Processor -- start 2023-09-30T13:54:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 -- start start 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71200cbc30 0x7f712014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 0x7f71200afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200b0520 con 0x7f71200cbc30 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200c3340 con 0x7f71200b4f80 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f71279a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200c3620 con 0x7f712015d1a0 2023-09-30T13:54:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f7125745640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f7125f46640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 0x7f71200afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f7125745640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59158/0 (socket says 172.21.15.135:59158) 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.648+0000 7f7125745640 1 -- 172.21.15.135:0/1722968849 learned_addr learned my addr 172.21.15.135:0/1722968849 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7124f44640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71200cbc30 0x7f712014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 -- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 msgr2=0x7f71200afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 0x7f71200afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 -- 172.21.15.135:0/1722968849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71200cbc30 msgr2=0x7f712014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71200cbc30 0x7f712014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 -- 172.21.15.135:0/1722968849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100094d0 con 0x7f71200b4f80 2023-09-30T13:54:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125f46640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 0x7f71200afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7125745640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7110000c00 tx=0x7f71100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711002f7f0 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711003e420 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200c3900 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711003e7b0 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.649+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712014ff00 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.650+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f711003e910 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.650+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7110051e00 con 0x7f71200b4f80 2023-09-30T13:54:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.650+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712004e0d0 con 0x7f71200b4f80 2023-09-30T13:54:26.654 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.654+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f711003eda0 con 0x7f71200b4f80 2023-09-30T13:54:26.668 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.669+0000 7f523da3b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T13:54:26.698 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.699+0000 7f6a9fa3b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T13:54:26.723 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.723+0000 7f523da3b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T13:54:26.726 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.726+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22a78843-494d-4097-8a92-4b60a70d2e7b", "id": 2} v 0) v1 -- 0x7f71200ce660 con 0x7f71200b4f80 2023-09-30T13:54:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.732+0000 7f7115ffb640 1 -- 172.21.15.135:0/1722968849 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22a78843-494d-4097-8a92-4b60a70d2e7b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7110051440 con 0x7f71200b4f80 2023-09-30T13:54:26.732 INFO:teuthology.orchestra.run.smithi135.stdout:2 2023-09-30T13:54:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 msgr2=0x7f712014dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7110000c00 tx=0x7f71100046c0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 shutdown_connections 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f712015d1a0 0x7f71200afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71200cbc30 0x7f712014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 --2- 172.21.15.135:0/1722968849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71200b4f80 0x7f712014dc00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 >> 172.21.15.135:0/1722968849 conn(0x7f71200cc180 msgr2=0x7f7120153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 shutdown_connections 2023-09-30T13:54:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.733+0000 7f71279a9640 1 -- 172.21.15.135:0/1722968849 wait complete. 2023-09-30T13:54:26.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new d564f1bb-203e-4a74-880d-8c49d7874e70 3 2023-09-30T13:54:26.746 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.746+0000 7f6a9fa3b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T13:54:26.769 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.770+0000 7f523da3b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T13:54:26.805 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.805+0000 7f6a9fa3b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T13:54:26.825 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.826+0000 7f523da3b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T13:54:26.842 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.843+0000 7f2b984b4640 1 Processor -- start 2023-09-30T13:54:26.843 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.843+0000 7f2b984b4640 1 -- start start 2023-09-30T13:54:26.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.843+0000 7f2b984b4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2b900ca620 0x7f2b900caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.843+0000 7f2b984b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.843+0000 7f2b984b4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9015e840 con 0x7f2b9006b9b0 2023-09-30T13:54:26.845 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b984b4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9006a0a0 con 0x7f2b900ca620 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b984b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9015eae0 con 0x7f2b9015a970 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2b900ca620 0x7f2b900caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96a51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2b900ca620 0x7f2b900caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59170/0 (socket says 172.21.15.135:59170) 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96a51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:39006/0 (socket says 172.21.15.135:39006) 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 -- 172.21.15.135:0/3406120712 learned_addr learned my addr 172.21.15.135:0/3406120712 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 -- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 msgr2=0x7f2b9015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 -- 172.21.15.135:0/3406120712 >> v1:172.21.15.62:6789/0 conn(0x7f2b9006b9b0 legacy=0x7f2b900b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96250640 1 -- 172.21.15.135:0/3406120712 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9015edc0 con 0x7f2b900ca620 2023-09-30T13:54:26.846 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.844+0000 7f2b96a51640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b96250640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b900ca620 0x7f2b900caa00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dcd96cb519a687 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b9524e640 1 -- 172.21.15.135:0/3406120712 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c02f830 con 0x7f2b900ca620 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b9524e640 1 -- 172.21.15.135:0/3406120712 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c02f990 con 0x7f2b900ca620 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b9524e640 1 -- 172.21.15.135:0/3406120712 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c02fd20 con 0x7f2b900ca620 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 -- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b900ca620 msgr2=0x7f2b900caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b900ca620 0x7f2b900caa00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02ba10 comp rx=0 tx=0).stop 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 -- 172.21.15.135:0/3406120712 shutdown_connections 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b9015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3406120712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b900ca620 0x7f2b900caa00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.845+0000 7f2b984b4640 1 -- 172.21.15.135:0/3406120712 >> 172.21.15.135:0/3406120712 conn(0x7f2b900cc180 msgr2=0x7f2b900cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.846+0000 7f2b984b4640 1 -- 172.21.15.135:0/3406120712 shutdown_connections 2023-09-30T13:54:26.847 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.846+0000 7f2b984b4640 1 -- 172.21.15.135:0/3406120712 wait complete. 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 Processor -- start 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 -- start start 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b900ca620 0x7f2b900c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b900c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b901f0d30 con 0x7f2b900ca620 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90158f20 con 0x7f2b9006b9b0 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.847+0000 7f2b984b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c5fa0 con 0x7f2b9015a970 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96a51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b900c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.850 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59172/0 (socket says 172.21.15.135:59172) 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 -- 172.21.15.135:0/3777681462 learned_addr learned my addr 172.21.15.135:0/3777681462 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b95a4f640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b900ca620 0x7f2b900c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 -- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 msgr2=0x7f2b900c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b900c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 -- 172.21.15.135:0/3777681462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b900ca620 msgr2=0x7f2b900c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b900ca620 0x7f2b900c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 -- 172.21.15.135:0/3777681462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009a70 con 0x7f2b9006b9b0 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96a51640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b900c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b96250640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000c00 tx=0x7f2b8c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c037c40 con 0x7f2b9006b9b0 2023-09-30T13:54:26.851 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c037dc0 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c041640 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c0094d0 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b900c5cc0 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b8c041aa0 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.848+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2b8c03c070 con 0x7f2b9006b9b0 2023-09-30T13:54:26.852 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.849+0000 7f6a9fa3b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T13:54:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.849+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9004e0d0 con 0x7f2b9006b9b0 2023-09-30T13:54:26.853 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.853+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2b8c04b460 con 0x7f2b9006b9b0 2023-09-30T13:54:26.869 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.870+0000 7f523da3b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T13:54:26.924 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.924+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d564f1bb-203e-4a74-880d-8c49d7874e70", "id": 3} v 0) v1 -- 0x7f2b900ca080 con 0x7f2b9006b9b0 2023-09-30T13:54:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.929+0000 7f2b86ffd640 1 -- 172.21.15.135:0/3777681462 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d564f1bb-203e-4a74-880d-8c49d7874e70", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b8c04b960 con 0x7f2b9006b9b0 2023-09-30T13:54:26.930 INFO:teuthology.orchestra.run.smithi135.stdout:3 2023-09-30T13:54:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 msgr2=0x7f2b901589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000c00 tx=0x7f2b8c004730 comp rx=0 tx=0).stop 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 shutdown_connections 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b9015a970 0x7f2b900c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b900ca620 0x7f2b900c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 --2- 172.21.15.135:0/3777681462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b9006b9b0 0x7f2b901589e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 >> 172.21.15.135:0/3777681462 conn(0x7f2b900cc180 msgr2=0x7f2b900b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 shutdown_connections 2023-09-30T13:54:26.931 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:26.930+0000 7f2b984b4640 1 -- 172.21.15.135:0/3777681462 wait complete. 2023-09-30T13:54:26.940 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 4e515b4c-a3ad-4a04-b5e7-e57c25760faf 4 2023-09-30T13:54:26.955 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:26.955+0000 7f6a9fa3b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T13:54:26.975 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:26.975+0000 7f523da3b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T13:54:27.028 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.028+0000 7f6a9fa3b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T13:54:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.039+0000 7f085b383640 1 Processor -- start 2023-09-30T13:54:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.039+0000 7f085b383640 1 -- start start 2023-09-30T13:54:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085b383640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 0x7f08541604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085b383640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08541613a0 con 0x7f0854069d50 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085b383640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540ca2c0 con 0x7f08540ccb90 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085b383640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0854160de0 con 0x7f085415c8a0 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085891e640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f08540ccb90 0x7f08540c9bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42108/0 (socket says 172.21.15.135:42108) 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085911f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 0x7f08541604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f085891e640 1 -- 172.21.15.135:0/3367470825 learned_addr learned my addr 172.21.15.135:0/3367470825 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f084bfff640 1 -- 172.21.15.135:0/3367470825 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082620604 0 0) 0x7f08540ca2c0 con 0x7f08540ccb90 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.040+0000 7f084bfff640 1 -- 172.21.15.135:0/3367470825 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0840003520 con 0x7f08540ccb90 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f085911f640 1 -- 172.21.15.135:0/3367470825 >> v1:172.21.15.135:6789/0 conn(0x7f08540ccb90 legacy=0x7f08540c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f085911f640 1 -- 172.21.15.135:0/3367470825 >> v1:172.21.15.62:6789/0 conn(0x7f0854069d50 legacy=0x7f085406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f085911f640 1 -- 172.21.15.135:0/3367470825 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08541610c0 con 0x7f085415c8a0 2023-09-30T13:54:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f085911f640 1 --2- 172.21.15.135:0/3367470825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 0x7f08541604e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08440097d0 tx=0x7f084402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43947364fff7561d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f084bfff640 1 -- 172.21.15.135:0/3367470825 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844031800 con 0x7f085415c8a0 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f084bfff640 1 -- 172.21.15.135:0/3367470825 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0844031960 con 0x7f085415c8a0 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.041+0000 7f084bfff640 1 -- 172.21.15.135:0/3367470825 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844031cf0 con 0x7f085415c8a0 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 -- 172.21.15.135:0/3367470825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 msgr2=0x7f08541604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 --2- 172.21.15.135:0/3367470825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 0x7f08541604e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f08440097d0 tx=0x7f084402b8a0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 -- 172.21.15.135:0/3367470825 shutdown_connections 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 --2- 172.21.15.135:0/3367470825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f085415c8a0 0x7f08541604e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 -- 172.21.15.135:0/3367470825 >> 172.21.15.135:0/3367470825 conn(0x7f085406d070 msgr2=0x7f085406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 -- 172.21.15.135:0/3367470825 shutdown_connections 2023-09-30T13:54:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.042+0000 7f085b383640 1 -- 172.21.15.135:0/3367470825 wait complete. 2023-09-30T13:54:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.043+0000 7f085b383640 1 Processor -- start 2023-09-30T13:54:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.043+0000 7f085b383640 1 -- start start 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0854069d50 0x7f085414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 0x7f085415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085415dc70 con 0x7f0854069d50 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085414cd70 con 0x7f085415c8a0 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085b383640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085415d060 con 0x7f08540ccb90 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f0859920640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 0x7f085415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:39018/0 (socket says 172.21.15.135:39018) 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 -- 172.21.15.135:0/2947248477 learned_addr learned my addr 172.21.15.135:0/2947248477 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085911f640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0854069d50 0x7f085414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.046 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 -- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 msgr2=0x7f085415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 0x7f085415f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 -- 172.21.15.135:0/2947248477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0854069d50 msgr2=0x7f085414c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0854069d50 0x7f085414c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f085891e640 1 -- 172.21.15.135:0/2947248477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844009400 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.044+0000 7f0859920640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 0x7f085415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f085891e640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f085000c3e0 tx=0x7f085000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850005ce0 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850005e40 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085415d340 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500072d0 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085415d900 con 0x7f08540ccb90 2023-09-30T13:54:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f085001c440 con 0x7f08540ccb90 2023-09-30T13:54:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.045+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0850012910 con 0x7f08540ccb90 2023-09-30T13:54:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.046+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08540cc980 con 0x7f08540ccb90 2023-09-30T13:54:27.048 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.048+0000 7f523da3b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T13:54:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.048+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0850021060 con 0x7f08540ccb90 2023-09-30T13:54:27.077 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.077+0000 7f6a9fa3b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T13:54:27.095 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.096+0000 7f523da3b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T13:54:27.118 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.118+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4e515b4c-a3ad-4a04-b5e7-e57c25760faf", "id": 4} v 0) v1 -- 0x7f085415dde0 con 0x7f08540ccb90 2023-09-30T13:54:27.123 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.124+0000 7f0849ffb640 1 -- 172.21.15.135:0/2947248477 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4e515b4c-a3ad-4a04-b5e7-e57c25760faf", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0850017070 con 0x7f08540ccb90 2023-09-30T13:54:27.124 INFO:teuthology.orchestra.run.smithi135.stdout:4 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 msgr2=0x7f085415e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f085000c3e0 tx=0x7f085000c8a0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 shutdown_connections 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f085415c8a0 0x7f085415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540ccb90 0x7f085415e100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 --2- 172.21.15.135:0/2947248477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0854069d50 0x7f085414c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 >> 172.21.15.135:0/2947248477 conn(0x7f085406d070 msgr2=0x7f0854071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 shutdown_connections 2023-09-30T13:54:27.125 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.125+0000 7f085b383640 1 -- 172.21.15.135:0/2947248477 wait complete. 2023-09-30T13:54:27.130 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.130+0000 7f6a9fa3b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T13:54:27.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 5dc9c737-1e11-4d7e-933d-a5d65ec69066 5 2023-09-30T13:54:27.150 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.150+0000 7f523da3b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T13:54:27.178 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.179+0000 7f6a9fa3b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T13:54:27.199 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.199+0000 7f523da3b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.275+0000 7f41dbdd5640 1 Processor -- start 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 -- start start 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41d40ca0e0 0x7f41d40ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d406f6d0 con 0x7f41d415ce90 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d406b5f0 con 0x7f41d40ca0e0 2023-09-30T13:54:27.277 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41dbdd5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40ce3f0 con 0x7f41d406ed30 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41d9b71640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f41d415ce90 0x7f41d406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42114/0 (socket says 172.21.15.135:42114) 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41d9370640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.276+0000 7f41d9b71640 1 -- 172.21.15.135:0/1393795470 learned_addr learned my addr 172.21.15.135:0/1393795470 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41da372640 1 --2- 172.21.15.135:0/1393795470 >> v2:172.21.15.62:3300/0 conn(0x7f41d40ca0e0 0x7f41d40ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d8b6f640 1 -- 172.21.15.135:0/1393795470 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260597953 0 0) 0x7f41d406f6d0 con 0x7f41d415ce90 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d8b6f640 1 -- 172.21.15.135:0/1393795470 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c0003520 con 0x7f41d415ce90 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d9370640 1 -- 172.21.15.135:0/1393795470 >> v2:172.21.15.62:3300/0 conn(0x7f41d40ca0e0 msgr2=0x7f41d40ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d9370640 1 --2- 172.21.15.135:0/1393795470 >> v2:172.21.15.62:3300/0 conn(0x7f41d40ca0e0 0x7f41d40ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d9370640 1 -- 172.21.15.135:0/1393795470 >> v1:172.21.15.135:6789/0 conn(0x7f41d415ce90 legacy=0x7f41d406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.278 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d9370640 1 -- 172.21.15.135:0/1393795470 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d406a120 con 0x7f41d406ed30 2023-09-30T13:54:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.277+0000 7f41d9370640 1 --2- 172.21.15.135:0/1393795470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d406f190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097a0 tx=0x7f41d002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2230ef5e6ca2f18a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41d8b6f640 1 -- 172.21.15.135:0/1393795470 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d002d040 con 0x7f41d406ed30 2023-09-30T13:54:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41d8b6f640 1 -- 172.21.15.135:0/1393795470 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0031810 con 0x7f41d406ed30 2023-09-30T13:54:27.282 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41d8b6f640 1 -- 172.21.15.135:0/1393795470 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0031b80 con 0x7f41d406ed30 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 -- 172.21.15.135:0/1393795470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 msgr2=0x7f41d406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/1393795470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d406f190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097a0 tx=0x7f41d002b8b0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 -- 172.21.15.135:0/1393795470 shutdown_connections 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/1393795470 >> v2:172.21.15.62:3300/0 conn(0x7f41d40ca0e0 0x7f41d40ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/1393795470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d406f190 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 -- 172.21.15.135:0/1393795470 >> 172.21.15.135:0/1393795470 conn(0x7f41d40cc180 msgr2=0x7f41d40cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 -- 172.21.15.135:0/1393795470 shutdown_connections 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.278+0000 7f41dbdd5640 1 -- 172.21.15.135:0/1393795470 wait complete. 2023-09-30T13:54:27.283 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.279+0000 7f41dbdd5640 1 Processor -- start 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 -- start start 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d415ce90 0x7f41d4154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415ed90 con 0x7f41d415ce90 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40ae8e0 con 0x7f41d40ca0e0 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41dbdd5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415b600 con 0x7f41d406ed30 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41d9370640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41d9b71640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41d9370640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59194/0 (socket says 172.21.15.135:59194) 2023-09-30T13:54:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41d9370640 1 -- 172.21.15.135:0/2455694580 learned_addr learned my addr 172.21.15.135:0/2455694580 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41d9b71640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:39042/0 (socket says 172.21.15.135:39042) 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.280+0000 7f41da372640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d415ce90 0x7f41d4154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 -- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 msgr2=0x7f41d415b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 -- 172.21.15.135:0/2455694580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d415ce90 msgr2=0x7f41d4154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d415ce90 0x7f41d4154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 -- 172.21.15.135:0/2455694580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0009400 con 0x7f41d406ed30 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9370640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41d9b71640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c400 tx=0x7f41c800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.285 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8005ce0 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8005e40 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d4154ab0 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80072f0 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40aba00 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41c801c440 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.281+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f41c8012980 con 0x7f41d406ed30 2023-09-30T13:54:27.286 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.282+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d406a690 con 0x7f41d406ed30 2023-09-30T13:54:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.284+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f41c8017070 con 0x7f41d406ed30 2023-09-30T13:54:27.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.355+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5dc9c737-1e11-4d7e-933d-a5d65ec69066", "id": 5} v 0) v1 -- 0x7f41d40c2b20 con 0x7f41d406ed30 2023-09-30T13:54:27.360 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.360+0000 7f41c67fc640 1 -- 172.21.15.135:0/2455694580 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5dc9c737-1e11-4d7e-933d-a5d65ec69066", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f41c8012400 con 0x7f41d406ed30 2023-09-30T13:54:27.360 INFO:teuthology.orchestra.run.smithi135.stdout:5 2023-09-30T13:54:27.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 msgr2=0x7f41d415e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.361 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c400 tx=0x7f41c800c8c0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 shutdown_connections 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41d415ce90 0x7f41d4154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41d40ca0e0 0x7f41d415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 --2- 172.21.15.135:0/2455694580 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41d406ed30 0x7f41d415e850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 >> 172.21.15.135:0/2455694580 conn(0x7f41d40cc180 msgr2=0x7f41d40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 shutdown_connections 2023-09-30T13:54:27.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.361+0000 7f41dbdd5640 1 -- 172.21.15.135:0/2455694580 wait complete. 2023-09-30T13:54:27.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 79d2784a-c063-4416-88b3-a4cb20a9e6f6 6 2023-09-30T13:54:27.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.472+0000 7fc311207640 1 Processor -- start 2023-09-30T13:54:27.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.472+0000 7fc311207640 1 -- start start 2023-09-30T13:54:27.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc311207640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc30c0cd830 0x7fc30c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc311207640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc30c0b15e0 0x7fc30c0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc311207640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0d17c0 con 0x7fc30c15e1e0 2023-09-30T13:54:27.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc311207640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0ce2d0 con 0x7fc30c0cd830 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc311207640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0d0360 con 0x7fc30c0b15e0 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc30c0b15e0 0x7fc30c0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc30c0b15e0 0x7fc30c0b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59208/0 (socket says 172.21.15.135:59208) 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 -- 172.21.15.135:0/465002722 learned_addr learned my addr 172.21.15.135:0/465002722 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc303fff640 1 --2- 172.21.15.135:0/465002722 >> v2:172.21.15.62:3300/0 conn(0x7fc30c0cd830 0x7fc30c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 -- 172.21.15.135:0/465002722 >> v2:172.21.15.62:3300/0 conn(0x7fc30c0cd830 msgr2=0x7fc30c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 --2- 172.21.15.135:0/465002722 >> v2:172.21.15.62:3300/0 conn(0x7fc30c0cd830 0x7fc30c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 -- 172.21.15.135:0/465002722 >> v1:172.21.15.62:6789/0 conn(0x7fc30c15e1e0 legacy=0x7fc30c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.473+0000 7fc30b59e640 1 -- 172.21.15.135:0/465002722 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0cc0a0 con 0x7fc30c0b15e0 2023-09-30T13:54:27.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc30b59e640 1 --2- 172.21.15.135:0/465002722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0b15e0 0x7fc30c0b0880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc30c06e120 tx=0x7fc30402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3d6f7c7bcf26199 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.475 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc30a59c640 1 -- 172.21.15.135:0/465002722 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30402cb20 con 0x7fc30c0b15e0 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc30a59c640 1 -- 172.21.15.135:0/465002722 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30402cc80 con 0x7fc30c0b15e0 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc30a59c640 1 -- 172.21.15.135:0/465002722 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040343f0 con 0x7fc30c0b15e0 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc311207640 1 -- 172.21.15.135:0/465002722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0b15e0 msgr2=0x7fc30c0b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.474+0000 7fc311207640 1 --2- 172.21.15.135:0/465002722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0b15e0 0x7fc30c0b0880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc30c06e120 tx=0x7fc30402bf80 comp rx=0 tx=0).stop 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 -- 172.21.15.135:0/465002722 shutdown_connections 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 --2- 172.21.15.135:0/465002722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0b15e0 0x7fc30c0b0880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 --2- 172.21.15.135:0/465002722 >> v2:172.21.15.62:3300/0 conn(0x7fc30c0cd830 0x7fc30c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 -- 172.21.15.135:0/465002722 >> 172.21.15.135:0/465002722 conn(0x7fc30c0d08e0 msgr2=0x7fc30c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 -- 172.21.15.135:0/465002722 shutdown_connections 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.475+0000 7fc311207640 1 -- 172.21.15.135:0/465002722 wait complete. 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.476+0000 7fc311207640 1 Processor -- start 2023-09-30T13:54:27.476 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.476+0000 7fc311207640 1 -- start start 2023-09-30T13:54:27.478 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc30c15e1e0 0x7fc30c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c146240 con 0x7fc30c15e1e0 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0c5970 con 0x7fc30c0cd830 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0c5c40 con 0x7fc30c0b15e0 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc30ad9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59210/0 (socket says 172.21.15.135:59210) 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc30ad9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:39048/0 (socket says 172.21.15.135:39048) 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 -- 172.21.15.135:0/2074205701 learned_addr learned my addr 172.21.15.135:0/2074205701 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:27.479 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc30b59e640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc30c15e1e0 0x7fc30c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 -- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 msgr2=0x7fc30c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 -- 172.21.15.135:0/2074205701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc30c15e1e0 msgr2=0x7fc30c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc30c15e1e0 0x7fc30c0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 -- 172.21.15.135:0/2074205701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009b30 con 0x7fc30c0cd830 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc30ad9d640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc303fff640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e9b0 tx=0x7fc2f400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4009670 con 0x7fc30c0cd830 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400c9a0 con 0x7fc30c0cd830 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0c5f20 con 0x7fc30c0cd830 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400cd50 con 0x7fc30c0cd830 2023-09-30T13:54:27.480 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.477+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0c64e0 con 0x7fc30c0cd830 2023-09-30T13:54:27.481 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.478+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc2f4005c90 con 0x7fc30c0cd830 2023-09-30T13:54:27.481 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.478+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc2f4013a60 con 0x7fc30c0cd830 2023-09-30T13:54:27.481 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.479+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c04e0d0 con 0x7fc30c0cd830 2023-09-30T13:54:27.481 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.481+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc2f4021060 con 0x7fc30c0cd830 2023-09-30T13:54:27.551 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.552+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "79d2784a-c063-4416-88b3-a4cb20a9e6f6", "id": 6} v 0) v1 -- 0x7fc30c066ca0 con 0x7fc30c0cd830 2023-09-30T13:54:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.557+0000 7fc3037fe640 1 -- 172.21.15.135:0/2074205701 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79d2784a-c063-4416-88b3-a4cb20a9e6f6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2f4017070 con 0x7fc30c0cd830 2023-09-30T13:54:27.557 INFO:teuthology.orchestra.run.smithi135.stdout:6 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 msgr2=0x7fc30c1ef830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e9b0 tx=0x7fc2f400ee70 comp rx=0 tx=0).stop 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 shutdown_connections 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc30c15e1e0 0x7fc30c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc30c0cd830 0x7fc30c1ef830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 --2- 172.21.15.135:0/2074205701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc30c0b15e0 0x7fc30c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 >> 172.21.15.135:0/2074205701 conn(0x7fc30c0d08e0 msgr2=0x7fc30c0ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 shutdown_connections 2023-09-30T13:54:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.558+0000 7fc311207640 1 -- 172.21.15.135:0/2074205701 wait complete. 2023-09-30T13:54:27.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new cb2eb449-13b3-444b-886a-170adee249e9 7 2023-09-30T13:54:27.580 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.580+0000 7f6a9fa3b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T13:54:27.599 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.599+0000 7f523da3b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T13:54:27.669 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.669+0000 7f85d26af640 1 Processor -- start 2023-09-30T13:54:27.669 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.669+0000 7f85d26af640 1 -- start start 2023-09-30T13:54:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85d26af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 0x7f85cc15d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85d26af640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0ae7b0 con 0x7f85cc0cbc30 2023-09-30T13:54:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85d26af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0aea90 con 0x7f85cc15d1a0 2023-09-30T13:54:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85d26af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc15d580 con 0x7f85cc06f440 2023-09-30T13:54:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cbfff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f85cc15d1a0 0x7f85cc06ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42116/0 (socket says 172.21.15.135:42116) 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cb7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 0x7f85cc15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cbfff640 1 -- 172.21.15.135:0/2337764574 learned_addr learned my addr 172.21.15.135:0/2337764574 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85caffd640 1 -- 172.21.15.135:0/2337764574 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854025828 0 0) 0x7f85cc0aea90 con 0x7f85cc15d1a0 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cb7fe640 1 -- 172.21.15.135:0/2337764574 >> v1:172.21.15.135:6789/0 conn(0x7f85cc15d1a0 legacy=0x7f85cc06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cb7fe640 1 -- 172.21.15.135:0/2337764574 >> v1:172.21.15.62:6789/0 conn(0x7f85cc0cbc30 legacy=0x7f85cc15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.670+0000 7f85cb7fe640 1 -- 172.21.15.135:0/2337764574 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0aed70 con 0x7f85cc06f440 2023-09-30T13:54:27.672 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.671+0000 7f85cb7fe640 1 --2- 172.21.15.135:0/2337764574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 0x7f85cc15d730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0097d0 tx=0x7f85bc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd67653328af6adc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.672 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.671+0000 7f85caffd640 1 -- 172.21.15.135:0/2337764574 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc031890 con 0x7f85cc06f440 2023-09-30T13:54:27.672 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.671+0000 7f85caffd640 1 -- 172.21.15.135:0/2337764574 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0319f0 con 0x7f85cc06f440 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.671+0000 7f85caffd640 1 -- 172.21.15.135:0/2337764574 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc031d80 con 0x7f85cc06f440 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 -- 172.21.15.135:0/2337764574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 msgr2=0x7f85cc15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 --2- 172.21.15.135:0/2337764574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 0x7f85cc15d730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0097d0 tx=0x7f85bc02b930 comp rx=0 tx=0).stop 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 -- 172.21.15.135:0/2337764574 shutdown_connections 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 --2- 172.21.15.135:0/2337764574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc06f440 0x7f85cc15d730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 -- 172.21.15.135:0/2337764574 >> 172.21.15.135:0/2337764574 conn(0x7f85cc0cc180 msgr2=0x7f85cc0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 -- 172.21.15.135:0/2337764574 shutdown_connections 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.672+0000 7f85d26af640 1 -- 172.21.15.135:0/2337764574 wait complete. 2023-09-30T13:54:27.673 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.673+0000 7f85d26af640 1 Processor -- start 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.673+0000 7f85d26af640 1 -- start start 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc0cbc30 0x7f85cc0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 0x7f85cc159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0b3cb0 con 0x7f85cc0cbc30 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc150840 con 0x7f85cc06f440 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d26af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc150b20 con 0x7f85cc15d1a0 2023-09-30T13:54:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59214/0 (socket says 172.21.15.135:59214) 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 -- 172.21.15.135:0/3430285972 learned_addr learned my addr 172.21.15.135:0/3430285972 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d0c4c640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 0x7f85cc159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cb7fe640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc0cbc30 0x7f85cc0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 -- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 msgr2=0x7f85cc159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 0x7f85cc159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 -- 172.21.15.135:0/3430285972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc0cbc30 msgr2=0x7f85cc0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc0cbc30 0x7f85cc0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 -- 172.21.15.135:0/3430285972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc009400 con 0x7f85cc06f440 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85d0c4c640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 0x7f85cc159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85cbfff640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c4a0 tx=0x7f85c000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.674+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00074e0 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0007640 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc150e00 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0004a00 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc144fc0 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85c001d440 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.675+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f85c0012a60 con 0x7f85cc06f440 2023-09-30T13:54:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.676+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc151320 con 0x7f85cc06f440 2023-09-30T13:54:27.679 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.678+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f85cc151320 con 0x7f85cc06f440 2023-09-30T13:54:27.721 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.721+0000 7f6a9fa3b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T13:54:27.740 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.740+0000 7f523da3b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T13:54:27.749 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.750+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb2eb449-13b3-444b-886a-170adee249e9", "id": 7} v 0) v1 -- 0x7f85cc04e0d0 con 0x7f85cc06f440 2023-09-30T13:54:27.755 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85c8ff9640 1 -- 172.21.15.135:0/3430285972 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb2eb449-13b3-444b-886a-170adee249e9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f85c0018070 con 0x7f85cc06f440 2023-09-30T13:54:27.755 INFO:teuthology.orchestra.run.smithi135.stdout:7 2023-09-30T13:54:27.756 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 msgr2=0x7f85cc144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c4a0 tx=0x7f85c000c960 comp rx=0 tx=0).stop 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 shutdown_connections 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85cc15d1a0 0x7f85cc159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85cc0cbc30 0x7f85cc0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.756+0000 7f85d26af640 1 --2- 172.21.15.135:0/3430285972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85cc06f440 0x7f85cc144a80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.757+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 >> 172.21.15.135:0/3430285972 conn(0x7f85cc0cc180 msgr2=0x7f85cc0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.757+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 shutdown_connections 2023-09-30T13:54:27.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:54:27.757+0000 7f85d26af640 1 -- 172.21.15.135:0/3430285972 wait complete. 2023-09-30T13:54:27.767 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T13:54:27.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T13:54:27.769 INFO:tasks.ceph.osd.0:Started 2023-09-30T13:54:27.769 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T13:54:27.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T13:54:27.771 INFO:tasks.ceph.osd.1:Started 2023-09-30T13:54:27.771 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T13:54:27.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T13:54:27.773 INFO:tasks.ceph.osd.2:Started 2023-09-30T13:54:27.773 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T13:54:27.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T13:54:27.775 INFO:tasks.ceph.osd.3:Started 2023-09-30T13:54:27.776 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-30T13:54:27.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-30T13:54:27.809 INFO:tasks.ceph.osd.4:Started 2023-09-30T13:54:27.810 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-30T13:54:27.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-30T13:54:27.813 INFO:tasks.ceph.osd.5:Started 2023-09-30T13:54:27.813 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-30T13:54:27.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-30T13:54:27.816 INFO:tasks.ceph.osd.6:Started 2023-09-30T13:54:27.816 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-30T13:54:27.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-30T13:54:27.818 INFO:tasks.ceph.osd.7:Started 2023-09-30T13:54:27.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:27.849 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.849+0000 7f6a9fa3b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T13:54:27.890 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.890+0000 7f523da3b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T13:54:27.912 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:27.913+0000 7f6a9fa3b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T13:54:27.938 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:27.939+0000 7f523da3b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T13:54:27.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.943+0000 7f1d90f1d640 1 Processor -- start 2023-09-30T13:54:27.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.943+0000 7f1d90f1d640 1 -- start start 2023-09-30T13:54:27.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.944+0000 7f1d90f1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d8c0ce580 0x7f1d8c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.944+0000 7f1d90f1d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0ce0f0 con 0x7f1d8c160fa0 2023-09-30T13:54:27.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d8c0ce580 0x7f1d8c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d8c0ce580 0x7f1d8c160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36070/0 (socket says 172.21.15.62:36070) 2023-09-30T13:54:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 -- 172.21.15.62:0/1636510962 learned_addr learned my addr 172.21.15.62:0/1636510962 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d8ad9d640 1 --1- 172.21.15.62:0/1636510962 >> v1:172.21.15.62:6789/0 conn(0x7f1d8c160fa0 0x7f1d8c06af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57148/0 (socket says 172.21.15.62:57148) 2023-09-30T13:54:27.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0cd7c0 con 0x7f1d8c0d0eb0 2023-09-30T13:54:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0cdaa0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989253509 0 0) 0x7f1d8c0cd7c0 con 0x7f1d8c0d0eb0 2023-09-30T13:54:27.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d78003520 con 0x7f1d8c0d0eb0 2023-09-30T13:54:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762091025 0 0) 0x7f1d8c0ce0f0 con 0x7f1d8c160fa0 2023-09-30T13:54:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c0cd7c0 con 0x7f1d8c160fa0 2023-09-30T13:54:27.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 -- 172.21.15.62:0/1636510962 >> v1:172.21.15.135:6789/0 conn(0x7f1d8c0d0eb0 legacy=0x7f1d8c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 -- 172.21.15.62:0/1636510962 >> v1:172.21.15.62:6789/0 conn(0x7f1d8c160fa0 legacy=0x7f1d8c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.945+0000 7f1d83fff640 1 -- 172.21.15.62:0/1636510962 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0cdd80 con 0x7f1d8c0ce580 2023-09-30T13:54:27.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.946+0000 7f1d83fff640 1 --2- 172.21.15.62:0/1636510962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c160a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14b3de92071d995 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.946+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7402f850 con 0x7f1d8c0ce580 2023-09-30T13:54:27.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.946+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7402f9b0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.946+0000 7f1d89d9b640 1 -- 172.21.15.62:0/1636510962 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7402fd20 con 0x7f1d8c0ce580 2023-09-30T13:54:27.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ce580 msgr2=0x7f1d8c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 --2- 172.21.15.62:0/1636510962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c160a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009870 tx=0x7f1d7402ba30 comp rx=0 tx=0).stop 2023-09-30T13:54:27.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 shutdown_connections 2023-09-30T13:54:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 --2- 172.21.15.62:0/1636510962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c160a60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 >> 172.21.15.62:0/1636510962 conn(0x7f1d8c089fe0 msgr2=0x7f1d8c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:27.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 shutdown_connections 2023-09-30T13:54:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.947+0000 7f1d90f1d640 1 -- 172.21.15.62:0/1636510962 wait complete. 2023-09-30T13:54:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.948+0000 7f1d90f1d640 1 Processor -- start 2023-09-30T13:54:27.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.948+0000 7f1d90f1d640 1 -- start start 2023-09-30T13:54:27.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 0x7f1d8c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c160fa0 0x7f1d8c09fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:27.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1f2cf0 con 0x7f1d8c160fa0 2023-09-30T13:54:27.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1f2f30 con 0x7f1d8c0ce580 2023-09-30T13:54:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d90f1d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1f3210 con 0x7f1d8c0d0eb0 2023-09-30T13:54:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d83fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 0x7f1d8c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:58958/0 (socket says 172.21.15.62:58958) 2023-09-30T13:54:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d83fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 0x7f1d8c0b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:42248/0 (socket says 172.21.15.62:42248) 2023-09-30T13:54:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 -- 172.21.15.62:0/443462109 learned_addr learned my addr 172.21.15.62:0/443462109 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8ad9d640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c160fa0 0x7f1d8c09fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 -- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 msgr2=0x7f1d8c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 0x7f1d8c0b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 -- 172.21.15.62:0/443462109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c160fa0 msgr2=0x7f1d8c09fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c160fa0 0x7f1d8c09fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.949+0000 7f1d8a59c640 1 -- 172.21.15.62:0/443462109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740094d0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d8a59c640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c390 tx=0x7f1d7c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0052d0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c005430 con 0x7f1d8c0ce580 2023-09-30T13:54:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d90f1d640 1 -- 172.21.15.62:0/443462109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c1f34f0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c003830 con 0x7f1d8c0ce580 2023-09-30T13:54:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d90f1d640 1 -- 172.21.15.62:0/443462109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c1f3ab0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1d7c003c90 con 0x7f1d8c0ce580 2023-09-30T13:54:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.950+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1d7c012420 con 0x7f1d8c0ce580 2023-09-30T13:54:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.951+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c04e0d0 con 0x7f1d8c0ce580 2023-09-30T13:54:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:27.953+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1d7c017070 con 0x7f1d8c0ce580 2023-09-30T13:54:28.009 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:28.009+0000 7f6a9fa3b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T13:54:28.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.014+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8c0b8750 con 0x7f1d8c0ce580 2023-09-30T13:54:28.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.015+0000 7f1d82ffd640 1 -- 172.21.15.62:0/443462109 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1d7c011590 con 0x7f1d8c0ce580 2023-09-30T13:54:28.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:28.015 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:27.751928+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 msgr2=0x7f1d8c1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c390 tx=0x7f1d7c00c850 comp rx=0 tx=0).stop 2023-09-30T13:54:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 shutdown_connections 2023-09-30T13:54:28.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d8c160fa0 0x7f1d8c09fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d8c0d0eb0 0x7f1d8c0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 --2- 172.21.15.62:0/443462109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d8c0ce580 0x7f1d8c1596d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 >> 172.21.15.62:0/443462109 conn(0x7f1d8c089fe0 msgr2=0x7f1d8c15b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:28.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 shutdown_connections 2023-09-30T13:54:28.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:28.016+0000 7f1d80ff9640 1 -- 172.21.15.62:0/443462109 wait complete. 2023-09-30T13:54:28.026 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T13:54:28.026 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T13:54:28.043 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:28.043+0000 7f523da3b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T13:54:28.104 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:28.104+0000 7f6a9fa3b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T13:54:28.141 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:28.142+0000 7f523da3b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T13:54:28.243 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:28.243+0000 7f6a9fa3b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T13:54:28.284 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:28.284+0000 7f6a9fa3b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T13:54:28.287 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:28.287+0000 7f523da3b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T13:54:28.330 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:28.331+0000 7f523da3b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T13:54:28.388 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-09-30T13:54:28.388+0000 7f1bbb624500 -1 Falling back to public interface 2023-09-30T13:54:28.393 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-09-30T13:54:28.394+0000 7f752436c500 -1 Falling back to public interface 2023-09-30T13:54:28.394 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-09-30T13:54:28.395+0000 7f55dc612500 -1 Falling back to public interface 2023-09-30T13:54:28.395 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-09-30T13:54:28.395+0000 7f7523313640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2023-09-30T13:54:28.395 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-09-30T13:54:28.396+0000 7f55daf22640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-09-30T13:54:28.402 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-09-30T13:54:28.402+0000 7f8439b8d500 -1 Falling back to public interface 2023-09-30T13:54:28.413 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-09-30T13:54:28.413+0000 7f9dd7610500 -1 Falling back to public interface 2023-09-30T13:54:28.422 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:28.422+0000 7f6a9fa3b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T13:54:28.423 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-09-30T13:54:28.423+0000 7f4f5cb6e500 -1 Falling back to public interface 2023-09-30T13:54:28.427 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-09-30T13:54:28.427+0000 7f6c41069500 -1 Falling back to public interface 2023-09-30T13:54:28.431 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-09-30T13:54:28.431+0000 7f91aeccf500 -1 Falling back to public interface 2023-09-30T13:54:28.481 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:28.481+0000 7f523da3b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T13:54:28.833 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:28.926 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.926+0000 7f2c34d68640 1 Processor -- start 2023-09-30T13:54:28.926 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 -- start start 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2c300d00f0 0x7f2c300b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c3006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c300b1030 con 0x7f2c3015ccb0 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3006a720 con 0x7f2c300d00f0 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c34d68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3006e900 con 0x7f2c30069d50 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c2e59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2c3015ccb0 0x7f2c3006e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57152/0 (socket says 172.21.15.62:57152) 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.927+0000 7f2c2e59c640 1 -- 172.21.15.62:0/359160022 learned_addr learned my addr 172.21.15.62:0/359160022 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2ed9d640 1 --2- 172.21.15.62:0/359160022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c3006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:28.928 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c27fff640 1 --2- 172.21.15.62:0/359160022 >> v2:172.21.15.135:3300/0 conn(0x7f2c300d00f0 0x7f2c300b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2dd9b640 1 -- 172.21.15.62:0/359160022 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247603114 0 0) 0x7f2c300b1030 con 0x7f2c3015ccb0 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2dd9b640 1 -- 172.21.15.62:0/359160022 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c1c003520 con 0x7f2c3015ccb0 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2ed9d640 1 -- 172.21.15.62:0/359160022 >> v2:172.21.15.135:3300/0 conn(0x7f2c300d00f0 msgr2=0x7f2c300b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2ed9d640 1 --2- 172.21.15.62:0/359160022 >> v2:172.21.15.135:3300/0 conn(0x7f2c300d00f0 0x7f2c300b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2ed9d640 1 -- 172.21.15.62:0/359160022 >> v1:172.21.15.62:6789/0 conn(0x7f2c3015ccb0 legacy=0x7f2c3006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.929 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.928+0000 7f2c2ed9d640 1 -- 172.21.15.62:0/359160022 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3006ebe0 con 0x7f2c30069d50 2023-09-30T13:54:28.930 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c2ed9d640 1 --2- 172.21.15.62:0/359160022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c3006a1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009d90 tx=0x7f2c2802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719ea3c505ab247 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c2dd9b640 1 -- 172.21.15.62:0/359160022 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2802cbc0 con 0x7f2c30069d50 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c2dd9b640 1 -- 172.21.15.62:0/359160022 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2802cd20 con 0x7f2c30069d50 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c2dd9b640 1 -- 172.21.15.62:0/359160022 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28034660 con 0x7f2c30069d50 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 -- 172.21.15.62:0/359160022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 msgr2=0x7f2c3006a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 --2- 172.21.15.62:0/359160022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c3006a1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009d90 tx=0x7f2c2802be10 comp rx=0 tx=0).stop 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 -- 172.21.15.62:0/359160022 shutdown_connections 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 --2- 172.21.15.62:0/359160022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c3006a1e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 --2- 172.21.15.62:0/359160022 >> v2:172.21.15.135:3300/0 conn(0x7f2c300d00f0 0x7f2c300b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 -- 172.21.15.62:0/359160022 >> 172.21.15.62:0/359160022 conn(0x7f2c30098a50 msgr2=0x7f2c300cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.929+0000 7f2c34d68640 1 -- 172.21.15.62:0/359160022 shutdown_connections 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.930+0000 7f2c34d68640 1 -- 172.21.15.62:0/359160022 wait complete. 2023-09-30T13:54:28.931 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.931+0000 7f2c34d68640 1 Processor -- start 2023-09-30T13:54:28.932 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.931+0000 7f2c34d68640 1 -- start start 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c301575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c3015ccb0 0x7f2c300b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30157140 con 0x7f2c300d00f0 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30160220 con 0x7f2c3015ccb0 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c34d68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300b3430 con 0x7f2c30069d50 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:28.934 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c301575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36092/0 (socket says 172.21.15.62:36092) 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c27fff640 1 -- 172.21.15.62:0/1260212134 learned_addr learned my addr 172.21.15.62:0/1260212134 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2ed9d640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c3015ccb0 0x7f2c300b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 -- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c3015ccb0 msgr2=0x7f2c300b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c3015ccb0 0x7f2c300b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 -- 172.21.15.62:0/1260212134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 msgr2=0x7f2c3015fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 -- 172.21.15.62:0/1260212134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28009a70 con 0x7f2c30069d50 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c27fff640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c2e59c640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c301575d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c20001eb0 tx=0x7f2c2000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200074e0 con 0x7f2c30069d50 2023-09-30T13:54:28.935 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20007640 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.932+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200059c0 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.933+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c30156af0 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.933+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c300b3710 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.933+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c2001c440 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.933+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2c20012ad0 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.934+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c300b1510 con 0x7f2c30069d50 2023-09-30T13:54:28.936 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.936+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2c20017070 con 0x7f2c30069d50 2023-09-30T13:54:28.996 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.997+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c30073e70 con 0x7f2c30069d50 2023-09-30T13:54:28.997 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c26ffd640 1 -- 172.21.15.62:0/1260212134 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2c20012400 con 0x7f2c30069d50 2023-09-30T13:54:28.997 INFO:teuthology.misc.health.smithi062.stdout: 2023-09-30T13:54:28.997 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:27.751928+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:28.998 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 msgr2=0x7f2c301575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:28.998 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c34d68640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c301575d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c20001eb0 tx=0x7f2c2000c820 comp rx=0 tx=0).stop 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 shutdown_connections 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c34d68640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c3015ccb0 0x7f2c300b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.998+0000 7f2c34d68640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c300d00f0 0x7f2c3015fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.999+0000 7f2c34d68640 1 --2- 172.21.15.62:0/1260212134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2c30069d50 0x7f2c301575d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.999+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 >> 172.21.15.62:0/1260212134 conn(0x7f2c30098a50 msgr2=0x7f2c300cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.999+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 shutdown_connections 2023-09-30T13:54:28.999 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:28.999+0000 7f2c34d68640 1 -- 172.21.15.62:0/1260212134 wait complete. 2023-09-30T13:54:29.007 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-30T13:54:29.221 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:29.221+0000 7f6a9fa3b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T13:54:29.324 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:29.324+0000 7f523da3b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T13:54:29.492 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:29.492+0000 7f6a9fa3b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T13:54:29.544 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:29.545+0000 7f6a9fa3b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T13:54:29.608 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:29.608+0000 7f523da3b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T13:54:29.645 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:29.645+0000 7f6a9fa3b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T13:54:29.661 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:29.662+0000 7f523da3b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T13:54:29.768 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-09-30T13:54:29.768+0000 7f523da3b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T13:54:30.677 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:30.675+0000 7f6a40ed0640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T13:54:30.678 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-09-30T13:54:30.675+0000 7f6a40ed0640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T13:54:31.860 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-09-30T13:54:31.861+0000 7f1bbb624500 -1 osd.1 0 log_to_monitors true 2023-09-30T13:54:31.911 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-09-30T13:54:31.911+0000 7f9dd7610500 -1 osd.6 0 log_to_monitors true 2023-09-30T13:54:31.914 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-09-30T13:54:31.914+0000 7f8439b8d500 -1 osd.3 0 log_to_monitors true 2023-09-30T13:54:31.918 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-09-30T13:54:31.919+0000 7f752436c500 -1 osd.2 0 log_to_monitors true 2023-09-30T13:54:31.919 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-09-30T13:54:31.920+0000 7f55dc612500 -1 osd.0 0 log_to_monitors true 2023-09-30T13:54:31.920 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-09-30T13:54:31.921+0000 7f4f5cb6e500 -1 osd.5 0 log_to_monitors true 2023-09-30T13:54:31.946 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-09-30T13:54:31.946+0000 7f6c41069500 -1 osd.7 0 log_to_monitors true 2023-09-30T13:54:31.946 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-09-30T13:54:31.946+0000 7f91aeccf500 -1 osd.4 0 log_to_monitors true 2023-09-30T13:54:35.787 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-09-30T13:54:35.787+0000 7f7520b0e640 -1 osd.2 0 waiting for initial osdmap 2023-09-30T13:54:35.813 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:35.814 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-09-30T13:54:35.814+0000 7f7518119640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.816 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-09-30T13:54:35.815+0000 7f55d7f07640 -1 osd.0 0 waiting for initial osdmap 2023-09-30T13:54:35.817 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-09-30T13:54:35.816+0000 7f1bb777c640 -1 osd.1 0 waiting for initial osdmap 2023-09-30T13:54:35.824 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-09-30T13:54:35.824+0000 7f4f58afa640 -1 osd.5 0 waiting for initial osdmap 2023-09-30T13:54:35.827 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-09-30T13:54:35.828+0000 7f55cfd28640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.831 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-09-30T13:54:35.832+0000 7f1baed87640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.838 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-09-30T13:54:35.839+0000 7f4f5091b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.849 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-09-30T13:54:35.849+0000 7f8435b19640 -1 osd.3 0 waiting for initial osdmap 2023-09-30T13:54:35.849 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-09-30T13:54:35.849+0000 7f9dd2f07640 -1 osd.6 0 waiting for initial osdmap 2023-09-30T13:54:35.853 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-09-30T13:54:35.854+0000 7f6c3cff5640 -1 osd.7 0 waiting for initial osdmap 2023-09-30T13:54:35.855 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-09-30T13:54:35.856+0000 7f91aac5b640 -1 osd.4 0 waiting for initial osdmap 2023-09-30T13:54:35.861 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-09-30T13:54:35.862+0000 7f842d93a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.864 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-09-30T13:54:35.865+0000 7f9dcad28640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.868 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-09-30T13:54:35.869+0000 7f91a2a7c640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.869 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-09-30T13:54:35.869+0000 7f6c34e16640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T13:54:35.908 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 Processor -- start 2023-09-30T13:54:35.908 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 -- start start 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53d806d760 0x7f53d80c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d815ac60 con 0x7f53d815a880 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d806dbf0 con 0x7f53d806d760 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.909+0000 7f53dcf5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b49d0 con 0x7f53d80cbcb0 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53d806d760 0x7f53d80c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53d806d760 0x7f53d80c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36126/0 (socket says 172.21.15.62:36126) 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 -- 172.21.15.62:0/931005984 learned_addr learned my addr 172.21.15.62:0/931005984 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:35.910 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53cdd9b640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 -- 172.21.15.62:0/931005984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 msgr2=0x7f53d815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 -- 172.21.15.62:0/931005984 >> v1:172.21.15.135:6789/0 conn(0x7f53d815a880 legacy=0x7f53d80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d6d9d640 1 -- 172.21.15.62:0/931005984 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d815f2e0 con 0x7f53d806d760 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53d5d9b640 1 -- 172.21.15.62:0/931005984 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318806184 0 0) 0x7f53d815ac60 con 0x7f53d815a880 2023-09-30T13:54:35.911 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.910+0000 7f53cdd9b640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:35.912 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53d6d9d640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d806d760 0x7f53d80c9e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009e50 tx=0x7f53d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e065a668e50ed6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:35.912 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53d5d9b640 1 -- 172.21.15.62:0/931005984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d002ca70 con 0x7f53d806d760 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53d5d9b640 1 -- 172.21.15.62:0/931005984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d002cbd0 con 0x7f53d806d760 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53d5d9b640 1 -- 172.21.15.62:0/931005984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00343f0 con 0x7f53d806d760 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 -- 172.21.15.62:0/931005984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d806d760 msgr2=0x7f53d80c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d806d760 0x7f53d80c9e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009e50 tx=0x7f53d002bed0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 -- 172.21.15.62:0/931005984 shutdown_connections 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d806d760 0x7f53d80c9e60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/931005984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 -- 172.21.15.62:0/931005984 >> 172.21.15.62:0/931005984 conn(0x7f53d80b08f0 msgr2=0x7f53d80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 -- 172.21.15.62:0/931005984 shutdown_connections 2023-09-30T13:54:35.913 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.911+0000 7f53dcf5a640 1 -- 172.21.15.62:0/931005984 wait complete. 2023-09-30T13:54:35.914 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 Processor -- start 2023-09-30T13:54:35.914 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 -- start start 2023-09-30T13:54:35.916 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 0x7f53d80cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.916 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d80c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.916 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.916 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8156c00 con 0x7f53d815a880 2023-09-30T13:54:35.916 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cd6e0 con 0x7f53d806d760 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.913+0000 7f53dcf5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8155d10 con 0x7f53d80cbcb0 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36130/0 (socket says 172.21.15.62:36130) 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 -- 172.21.15.62:0/2087766471 learned_addr learned my addr 172.21.15.62:0/2087766471 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53cdd9b640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d80c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d659c640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 0x7f53d80cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 -- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 msgr2=0x7f53d80c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d80c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 -- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 msgr2=0x7f53d80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 0x7f53d80cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:35.917 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 -- 172.21.15.62:0/2087766471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009400 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d659c640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 0x7f53d80cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53d6d9d640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009e50 tx=0x7f53d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0009510 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d003e450 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0009b30 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d003e800 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.914+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81562d0 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.915+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d8156db0 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.916+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 88999+0+0 (secure 0 0 0) 0x7f53d003e960 con 0x7f53d815a880 2023-09-30T13:54:35.918 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.916+0000 7f53cf7fe640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 0x7f53b806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:35.919 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.916+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f53d00aafc0 con 0x7f53d815a880 2023-09-30T13:54:35.919 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.916+0000 7f53d659c640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 0x7f53b806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:35.919 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.917+0000 7f53d659c640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 0x7f53b806cf60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f53c8000f60 tx=0x7f53c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:35.920 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:35.921+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f53d00ddad0 con 0x7f53d815a880 2023-09-30T13:54:36.097 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.097+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d8073e70 con 0x7f53d815a880 2023-09-30T13:54:36.097 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.098+0000 7f53cf7fe640 1 -- 172.21.15.62:0/2087766471 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f53d8156db0 con 0x7f53d815a880 2023-09-30T13:54:36.098 INFO:teuthology.misc.health.smithi062.stdout: 2023-09-30T13:54:36.098 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":12,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:33.676138+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 msgr2=0x7f53b806cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 0x7f53b806cf60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f53c8000f60 tx=0x7f53c8009040 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 msgr2=0x7f53d8158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53d0009e50 tx=0x7f53d0004a40 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 shutdown_connections 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f53b806aaa0 0x7f53b806cf60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53d815a880 0x7f53d8158ec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53d80cbcb0 0x7f53d80c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 --2- 172.21.15.62:0/2087766471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d806d760 0x7f53d80cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 >> 172.21.15.62:0/2087766471 conn(0x7f53d80b08f0 msgr2=0x7f53d80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:36.100 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 shutdown_connections 2023-09-30T13:54:36.101 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:36.100+0000 7f53dcf5a640 1 -- 172.21.15.62:0/2087766471 wait complete. 2023-09-30T13:54:36.109 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-30T13:54:42.916 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:43.017 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.018+0000 7f3115c34640 1 Processor -- start 2023-09-30T13:54:43.018 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.018+0000 7f3115c34640 1 -- start start 2023-09-30T13:54:43.019 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f3115c34640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.019 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f3115c34640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f311006dfd0 0x7f31100b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.019 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f3115c34640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100cc7d0 con 0x7f31100b2720 2023-09-30T13:54:43.019 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f3115c34640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100b2b90 con 0x7f311006dfd0 2023-09-30T13:54:43.019 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f3115c34640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100cb330 con 0x7f311015cdc0 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f310effd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f311006dfd0 0x7f31100b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:51856/0 (socket says 172.21.15.62:51856) 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.019+0000 7f310f7fe640 1 -- 172.21.15.62:0/298711782 learned_addr learned my addr 172.21.15.62:0/298711782 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.020+0000 7f310f7fe640 1 -- 172.21.15.62:0/298711782 >> v2:172.21.15.135:3300/0 conn(0x7f311006dfd0 msgr2=0x7f31100b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.020+0000 7f310f7fe640 1 --2- 172.21.15.62:0/298711782 >> v2:172.21.15.135:3300/0 conn(0x7f311006dfd0 0x7f31100b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.020+0000 7f310f7fe640 1 -- 172.21.15.62:0/298711782 >> v1:172.21.15.135:6789/0 conn(0x7f31100b2720 legacy=0x7f31100ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.020 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.020+0000 7f310f7fe640 1 -- 172.21.15.62:0/298711782 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100cb000 con 0x7f311015cdc0 2023-09-30T13:54:43.021 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.020+0000 7f310f7fe640 1 --2- 172.21.15.62:0/298711782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3100009870 tx=0x7f310002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f0ff5f0859d6e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f310e7fc640 1 -- 172.21.15.62:0/298711782 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100030840 con 0x7f311015cdc0 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f310e7fc640 1 -- 172.21.15.62:0/298711782 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31000309a0 con 0x7f311015cdc0 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f310e7fc640 1 -- 172.21.15.62:0/298711782 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100030d30 con 0x7f311015cdc0 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 -- 172.21.15.62:0/298711782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 msgr2=0x7f31101613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 --2- 172.21.15.62:0/298711782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3100009870 tx=0x7f310002b980 comp rx=0 tx=0).stop 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 -- 172.21.15.62:0/298711782 shutdown_connections 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 --2- 172.21.15.62:0/298711782 >> v2:172.21.15.135:3300/0 conn(0x7f311006dfd0 0x7f31100b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 --2- 172.21.15.62:0/298711782 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f311015cdc0 0x7f31101613c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 -- 172.21.15.62:0/298711782 >> 172.21.15.62:0/298711782 conn(0x7f31100cd1e0 msgr2=0x7f31100cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.022 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 -- 172.21.15.62:0/298711782 shutdown_connections 2023-09-30T13:54:43.023 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.021+0000 7f3115c34640 1 -- 172.21.15.62:0/298711782 wait complete. 2023-09-30T13:54:43.023 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.022+0000 7f3115c34640 1 Processor -- start 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 -- start start 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31100b2720 0x7f31100c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 0x7f31100c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31101f35e0 con 0x7f311006dfd0 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110149c20 con 0x7f311015cdc0 2023-09-30T13:54:43.025 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f3115c34640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110149f00 con 0x7f31100b2720 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.023+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55526/0 (socket says 172.21.15.62:55526) 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 -- 172.21.15.62:0/3276968158 learned_addr learned my addr 172.21.15.62:0/3276968158 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310ffff640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 0x7f31100c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310effd640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31100b2720 0x7f31100c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 -- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31100b2720 msgr2=0x7f31100c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31100b2720 0x7f31100c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 -- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 msgr2=0x7f31100c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 0x7f31100c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 -- 172.21.15.62:0/3276968158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094d0 con 0x7f311006dfd0 2023-09-30T13:54:43.026 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310ffff640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 0x7f31100c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f310f7fe640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f310002b9c0 tx=0x7f3100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310003e040 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3100039cb0 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311014a1e0 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100044630 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.024+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311014a7a0 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.025+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31100cd5c0 con 0x7f311006dfd0 2023-09-30T13:54:43.027 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.026+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f310004d3b0 con 0x7f311006dfd0 2023-09-30T13:54:43.028 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.026+0000 7f30f7fff640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 0x7f30fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.028 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.026+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31000ab510 con 0x7f311006dfd0 2023-09-30T13:54:43.028 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.026+0000 7f310effd640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 0x7f30fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.028 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.027+0000 7f310effd640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 0x7f30fc06cff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31100b3580 tx=0x7f3104008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.030 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.031+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3100076bc0 con 0x7f311006dfd0 2023-09-30T13:54:43.206 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.207+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3110073e70 con 0x7f311006dfd0 2023-09-30T13:54:43.207 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.208+0000 7f30f7fff640 1 -- 172.21.15.62:0/3276968158 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f310007a1e0 con 0x7f311006dfd0 2023-09-30T13:54:43.207 INFO:teuthology.misc.health.smithi062.stdout: 2023-09-30T13:54:43.208 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":16,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:39.834152+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:43.209 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 msgr2=0x7f30fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.209 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 0x7f30fc06cff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31100b3580 tx=0x7f3104008040 comp rx=0 tx=0).stop 2023-09-30T13:54:43.209 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 msgr2=0x7f31101f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f310002b9c0 tx=0x7f3100004730 comp rx=0 tx=0).stop 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 shutdown_connections 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f30fc06ab30 0x7f30fc06cff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311015cdc0 0x7f31100c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31100b2720 0x7f31100c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 --2- 172.21.15.62:0/3276968158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311006dfd0 0x7f31101f30a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 >> 172.21.15.62:0/3276968158 conn(0x7f31100cd1e0 msgr2=0x7f311015abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 shutdown_connections 2023-09-30T13:54:43.210 INFO:teuthology.misc.health.smithi062.stderr:2023-09-30T13:54:43.210+0000 7f3115c34640 1 -- 172.21.15.62:0/3276968158 wait complete. 2023-09-30T13:54:43.218 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-30T13:54:43.219 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T13:54:43.219 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T13:54:43.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T13:54:43.221 INFO:tasks.ceph.mds.a:Started 2023-09-30T13:54:43.221 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T13:54:43.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T13:54:43.223 INFO:tasks.ceph.mds.c:Started 2023-09-30T13:54:43.223 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T13:54:43.224 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T13:54:43.226 INFO:tasks.ceph.mds.b:Started 2023-09-30T13:54:43.227 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T13:54:43.227 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T13:54:43.229 INFO:tasks.ceph.mds.d:Started 2023-09-30T13:54:43.229 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T13:54:43.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:43.302 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-09-30T13:54:43.302 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-09-30T13:54:43.312 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-09-30T13:54:43.313 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-09-30T13:54:43.313 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-09-30T13:54:43.313+0000 7fcaf1428640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-09-30T13:54:43.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.339+0000 7f9771815640 1 Processor -- start 2023-09-30T13:54:43.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.339+0000 7f9771815640 1 -- start start 2023-09-30T13:54:43.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9771815640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f976c0d1410 0x7f976c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9771815640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9771815640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0cf450 con 0x7f976c15cbe0 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9771815640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0cfcf0 con 0x7f976c0d1410 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9771815640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0cf730 con 0x7f976c06b650 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976a7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f976c0d1410 0x7f976c0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976affd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f976c15cbe0 0x7f976c0d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:57496/0 (socket says 172.21.15.62:57496) 2023-09-30T13:54:43.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:51926/0 (socket says 172.21.15.62:51926) 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976affd640 1 -- 172.21.15.62:0/228984420 learned_addr learned my addr 172.21.15.62:0/228984420 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 -- 172.21.15.62:0/228984420 >> v2:172.21.15.135:3300/0 conn(0x7f976c0d1410 msgr2=0x7f976c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 --2- 172.21.15.62:0/228984420 >> v2:172.21.15.135:3300/0 conn(0x7f976c0d1410 0x7f976c0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f9769ffb640 1 -- 172.21.15.62:0/228984420 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428554821 0 0) 0x7f976c0cf450 con 0x7f976c15cbe0 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 -- 172.21.15.62:0/228984420 >> v1:172.21.15.135:6789/0 conn(0x7f976c15cbe0 legacy=0x7f976c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.340+0000 7f976b7fe640 1 -- 172.21.15.62:0/228984420 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0cfa10 con 0x7f976c06b650 2023-09-30T13:54:43.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.341+0000 7f976b7fe640 1 --2- 172.21.15.62:0/228984420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99cd57f789617d59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.341+0000 7f9769ffb640 1 -- 172.21.15.62:0/228984420 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c02cce0 con 0x7f976c06b650 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.341+0000 7f9769ffb640 1 -- 172.21.15.62:0/228984420 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c02ce40 con 0x7f976c06b650 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.341+0000 7f9769ffb640 1 -- 172.21.15.62:0/228984420 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c034660 con 0x7f976c06b650 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 -- 172.21.15.62:0/228984420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 msgr2=0x7f976c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 --2- 172.21.15.62:0/228984420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c02bf30 comp rx=0 tx=0).stop 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 -- 172.21.15.62:0/228984420 shutdown_connections 2023-09-30T13:54:43.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 --2- 172.21.15.62:0/228984420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c06b650 0x7f976c06bae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 --2- 172.21.15.62:0/228984420 >> v2:172.21.15.135:3300/0 conn(0x7f976c0d1410 0x7f976c0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 -- 172.21.15.62:0/228984420 >> 172.21.15.62:0/228984420 conn(0x7f976c089fe0 msgr2=0x7f976c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 -- 172.21.15.62:0/228984420 shutdown_connections 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.342+0000 7f9771815640 1 -- 172.21.15.62:0/228984420 wait complete. 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.343+0000 7f9771815640 1 Processor -- start 2023-09-30T13:54:43.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.343+0000 7f9771815640 1 -- start start 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f976c06b650 0x7f976c0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c0d1410 0x7f976c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c159180 con 0x7f976c15cbe0 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c159460 con 0x7f976c06b650 2023-09-30T13:54:43.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f9771815640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c159740 con 0x7f976c0d1410 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55568/0 (socket says 172.21.15.62:55568) 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f976b7fe640 1 -- 172.21.15.62:0/348978028 learned_addr learned my addr 172.21.15.62:0/348978028 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f976affd640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f976c06b650 0x7f976c0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.344+0000 7f976a7fc640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c0d1410 0x7f976c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 -- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c0d1410 msgr2=0x7f976c0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c0d1410 0x7f976c0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 -- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f976c06b650 msgr2=0x7f976c0b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f976c06b650 0x7f976c0b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 -- 172.21.15.62:0/348978028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009a70 con 0x7f976c15cbe0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f976b7fe640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c003b90 con 0x7f976c15cbe0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c003cf0 con 0x7f976c15cbe0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c004250 con 0x7f976c15cbe0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c159a20 con 0x7f976c15cbe0 2023-09-30T13:54:43.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.345+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c15a620 con 0x7f976c15cbe0 2023-09-30T13:54:43.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.346+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c159f40 con 0x7f976c15cbe0 2023-09-30T13:54:43.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.347+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f975c03b050 con 0x7f976c15cbe0 2023-09-30T13:54:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.347+0000 7f9763fff640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 0x7f974c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.347+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f975c0ab350 con 0x7f976c15cbe0 2023-09-30T13:54:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.347+0000 7f976affd640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 0x7f974c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.348+0000 7f976affd640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 0x7f974c06cff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9764000fb0 tx=0x7f9764004a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.351+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f976c159f40 con 0x7f976c15cbe0 2023-09-30T13:54:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.527+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f976c159f40 con 0x7f976c15cbe0 2023-09-30T13:54:43.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.528+0000 7f9763fff640 1 -- 172.21.15.62:0/348978028 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f976c159f40 con 0x7f976c15cbe0 2023-09-30T13:54:43.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:43.528 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:39.834152+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 msgr2=0x7f974c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 0x7f974c06cff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9764000fb0 tx=0x7f9764004a10 comp rx=0 tx=0).stop 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 msgr2=0x7f976c0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f975c009d90 tx=0x7f975c004a40 comp rx=0 tx=0).stop 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 shutdown_connections 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f974c06ab30 0x7f974c06cff0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f976c15cbe0 0x7f976c0b3d10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f976c0d1410 0x7f976c0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 --2- 172.21.15.62:0/348978028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f976c06b650 0x7f976c0b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 >> 172.21.15.62:0/348978028 conn(0x7f976c089fe0 msgr2=0x7f976c15d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 shutdown_connections 2023-09-30T13:54:43.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.530+0000 7f9771815640 1 -- 172.21.15.62:0/348978028 wait complete. 2023-09-30T13:54:43.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:54:43.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:54:43.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.649+0000 7f5cc7761640 1 Processor -- start 2023-09-30T13:54:43.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.649+0000 7f5cc7761640 1 -- start start 2023-09-30T13:54:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc7761640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 0x7f5cc00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc7761640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc015f570 con 0x7f5cc00b15e0 2023-09-30T13:54:43.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc7761640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00b1350 con 0x7f5cc00cd660 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc7761640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00ce2d0 con 0x7f5cc015e1e0 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc4cfc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5cc00b15e0 0x7f5cc015e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58948/0 (socket says 172.21.15.62:58948) 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc4cfc640 1 -- 172.21.15.62:0/1459627522 learned_addr learned my addr 172.21.15.62:0/1459627522 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cc54fd640 1 --2- 172.21.15.62:0/1459627522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 0x7f5cc00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.650+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884876847 0 0) 0x7f5cc015f570 con 0x7f5cc00b15e0 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cac003520 con 0x7f5cc00b15e0 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765815604 0 0) 0x7f5cc00b1350 con 0x7f5cc00cd660 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc015f570 con 0x7f5cc00cd660 2023-09-30T13:54:43.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cc54fd640 1 -- 172.21.15.62:0/1459627522 >> v1:172.21.15.135:6789/0 conn(0x7f5cc00cd660 legacy=0x7f5cc015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cc54fd640 1 -- 172.21.15.62:0/1459627522 >> v1:172.21.15.62:6789/0 conn(0x7f5cc00b15e0 legacy=0x7f5cc015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cc54fd640 1 -- 172.21.15.62:0/1459627522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00d17c0 con 0x7f5cc015e1e0 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.651+0000 7f5cc54fd640 1 --2- 172.21.15.62:0/1459627522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 0x7f5cc00cd120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80097d0 tx=0x7f5cb802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274a9a050861c00c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8031890 con 0x7f5cc015e1e0 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb80319f0 con 0x7f5cc015e1e0 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cb7fff640 1 -- 172.21.15.62:0/1459627522 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8031d80 con 0x7f5cc015e1e0 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 -- 172.21.15.62:0/1459627522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 msgr2=0x7f5cc00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 --2- 172.21.15.62:0/1459627522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 0x7f5cc00cd120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80097d0 tx=0x7f5cb802b930 comp rx=0 tx=0).stop 2023-09-30T13:54:43.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 -- 172.21.15.62:0/1459627522 shutdown_connections 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 --2- 172.21.15.62:0/1459627522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc015e1e0 0x7f5cc00cd120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 -- 172.21.15.62:0/1459627522 >> 172.21.15.62:0/1459627522 conn(0x7f5cc00d08e0 msgr2=0x7f5cc00d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 -- 172.21.15.62:0/1459627522 shutdown_connections 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.652+0000 7f5cc7761640 1 -- 172.21.15.62:0/1459627522 wait complete. 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.653+0000 7f5cc7761640 1 Processor -- start 2023-09-30T13:54:43.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.653+0000 7f5cc7761640 1 -- start start 2023-09-30T13:54:43.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc00b15e0 0x7f5cc0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 0x7f5cc00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c4ec0 con 0x7f5cc00cd660 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c42b0 con 0x7f5cc015e1e0 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc7761640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c4590 con 0x7f5cc00b15e0 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc4cfc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc4cfc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55582/0 (socket says 172.21.15.62:55582) 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc4cfc640 1 -- 172.21.15.62:0/3819797855 learned_addr learned my addr 172.21.15.62:0/3819797855 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc54fd640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc00b15e0 0x7f5cc0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc5cfe640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 0x7f5cc00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc4cfc640 1 -- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc00b15e0 msgr2=0x7f5cc0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.654+0000 7f5cc4cfc640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc00b15e0 0x7f5cc0154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc4cfc640 1 -- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 msgr2=0x7f5cc00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc4cfc640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 0x7f5cc00ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc4cfc640 1 -- 172.21.15.62:0/3819797855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009400 con 0x7f5cc00cd660 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc5cfe640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 0x7f5cc00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc4cfc640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c430 tx=0x7f5cb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0005ce0 con 0x7f5cc00cd660 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0005e40 con 0x7f5cc00cd660 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc00c4870 con 0x7f5cc00cd660 2023-09-30T13:54:43.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00072f0 con 0x7f5cc00cd660 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.655+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc0154eb0 con 0x7f5cc00cd660 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.656+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc004e0d0 con 0x7f5cc00cd660 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.657+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5cb0007450 con 0x7f5cc00cd660 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.657+0000 7f5cb5ffb640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 0x7f5ca406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.657+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5cb0088490 con 0x7f5cc00cd660 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.657+0000 7f5cc54fd640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 0x7f5ca406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.658+0000 7f5cc54fd640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 0x7f5ca406d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8036000 tx=0x7f5cb803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.661+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5cb0053ac0 con 0x7f5cc00cd660 2023-09-30T13:54:43.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.840+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cc0066ca0 con 0x7f5cc00cd660 2023-09-30T13:54:43.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.840+0000 7f5cb5ffb640 1 -- 172.21.15.62:0/3819797855 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cb0017020 con 0x7f5cc00cd660 2023-09-30T13:54:43.840 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:54:43.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 msgr2=0x7f5ca406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 0x7f5ca406d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8036000 tx=0x7f5cb803c040 comp rx=0 tx=0).stop 2023-09-30T13:54:43.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 msgr2=0x7f5cc00ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c430 tx=0x7f5cb000c8f0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 shutdown_connections 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ca406ab60 0x7f5ca406d020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cc015e1e0 0x7f5cc00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc00cd660 0x7f5cc00ca1c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 --2- 172.21.15.62:0/3819797855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cc00b15e0 0x7f5cc0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 >> 172.21.15.62:0/3819797855 conn(0x7f5cc00d08e0 msgr2=0x7f5cc00cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.842+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 shutdown_connections 2023-09-30T13:54:43.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.843+0000 7f5cc7761640 1 -- 172.21.15.62:0/3819797855 wait complete. 2023-09-30T13:54:43.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:54:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.958+0000 7f76195dc640 1 Processor -- start 2023-09-30T13:54:43.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.958+0000 7f76195dc640 1 -- start start 2023-09-30T13:54:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76195dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7614159880 0x7f7614071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76195dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76140b51f0 0x7f76140cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76195dc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7614072310 con 0x7f76140cd780 2023-09-30T13:54:43.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76195dc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7614159c60 con 0x7f76140b51f0 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76195dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140cb0d0 con 0x7f7614159880 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76127fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76140b51f0 0x7f76140cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76137fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76140cd780 0x7f76140b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58962/0 (socket says 172.21.15.62:58962) 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.959+0000 7f76137fe640 1 -- 172.21.15.62:0/3919784542 learned_addr learned my addr 172.21.15.62:0/3919784542 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f7612ffd640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7614159880 0x7f7614071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f76127fc640 1 -- 172.21.15.62:0/3919784542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7614159880 msgr2=0x7f7614071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f76127fc640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7614159880 0x7f7614071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f76127fc640 1 -- 172.21.15.62:0/3919784542 >> v1:172.21.15.62:6789/0 conn(0x7f76140cd780 legacy=0x7f76140b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f76127fc640 1 -- 172.21.15.62:0/3919784542 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140cb3b0 con 0x7f76140b51f0 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.960+0000 7f76127fc640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76140b51f0 0x7f76140cd240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0097a0 tx=0x7f75fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bec60cbe7deba0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f7611ffb640 1 -- 172.21.15.62:0/3919784542 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc031830 con 0x7f76140b51f0 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f7611ffb640 1 -- 172.21.15.62:0/3919784542 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc031990 con 0x7f76140b51f0 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f7611ffb640 1 -- 172.21.15.62:0/3919784542 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc031d20 con 0x7f76140b51f0 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 -- 172.21.15.62:0/3919784542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76140b51f0 msgr2=0x7f76140cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76140b51f0 0x7f76140cd240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0097a0 tx=0x7f75fc02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 -- 172.21.15.62:0/3919784542 shutdown_connections 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76140b51f0 0x7f76140cd240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 --2- 172.21.15.62:0/3919784542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7614159880 0x7f7614071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 -- 172.21.15.62:0/3919784542 >> 172.21.15.62:0/3919784542 conn(0x7f761406eb90 msgr2=0x7f761406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 -- 172.21.15.62:0/3919784542 shutdown_connections 2023-09-30T13:54:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.961+0000 7f76195dc640 1 -- 172.21.15.62:0/3919784542 wait complete. 2023-09-30T13:54:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.962+0000 7f76195dc640 1 Processor -- start 2023-09-30T13:54:43.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.962+0000 7f76195dc640 1 -- start start 2023-09-30T13:54:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 0x7f76140c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 0x7f7614157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761415a310 con 0x7f7614159880 2023-09-30T13:54:43.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761415a5f0 con 0x7f76140b51f0 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76195dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761415a8d0 con 0x7f76140cd780 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76137fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76137fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55604/0 (socket says 172.21.15.62:55604) 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76137fe640 1 -- 172.21.15.62:0/97728433 learned_addr learned my addr 172.21.15.62:0/97728433 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f7612ffd640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 0x7f76140c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76127fc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 0x7f7614157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.963+0000 7f76137fe640 1 -- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 msgr2=0x7f7614157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76137fe640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 0x7f7614157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76137fe640 1 -- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 msgr2=0x7f76140c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76137fe640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 0x7f76140c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:43.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76137fe640 1 -- 172.21.15.62:0/97728433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009400 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f7612ffd640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 0x7f76140c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76127fc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 0x7f7614157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76137fe640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f760400caa0 tx=0x7f760400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400aba0 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400ad00 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761415abb0 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604012620 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.964+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7614153d70 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.965+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761415b0d0 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.965+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f760401b3b0 con 0x7f7614159880 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.966+0000 7f760b7fe640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 0x7f75f406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:43.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.966+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7604088d40 con 0x7f7614159880 2023-09-30T13:54:43.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.966+0000 7f7612ffd640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 0x7f75f406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:43.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.967+0000 7f7612ffd640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 0x7f75f406cff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f760c006fd0 tx=0x7f760c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:43.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:43.970+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f761415b0d0 con 0x7f7614159880 2023-09-30T13:54:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.184+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f761415b0d0 con 0x7f7614159880 2023-09-30T13:54:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.184+0000 7f760b7fe640 1 -- 172.21.15.62:0/97728433 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f7604017540 con 0x7f7614159880 2023-09-30T13:54:44.184 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:44.184 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-30T13:54:44.184 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 2 2023-09-30T13:54:44.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 msgr2=0x7f75f406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:44.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 0x7f75f406cff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f760c006fd0 tx=0x7f760c008040 comp rx=0 tx=0).stop 2023-09-30T13:54:44.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 msgr2=0x7f76141547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f760400caa0 tx=0x7f760400cf60 comp rx=0 tx=0).stop 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 shutdown_connections 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f75f406ab30 0x7f75f406cff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7614159880 0x7f76141547c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76140cd780 0x7f7614157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 --2- 172.21.15.62:0/97728433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76140b51f0 0x7f76140c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 >> 172.21.15.62:0/97728433 conn(0x7f761406eb90 msgr2=0x7f76140b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 shutdown_connections 2023-09-30T13:54:44.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:44.186+0000 7f76195dc640 1 -- 172.21.15.62:0/97728433 wait complete. 2023-09-30T13:54:46.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:54:46.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.315+0000 7f610cb6c640 1 Processor -- start 2023-09-30T13:54:46.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.315+0000 7f610cb6c640 1 -- start start 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f610cb6c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61080d1410 0x7f61080d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f610cb6c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080cf450 con 0x7f610806b650 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f610cb6c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080cf730 con 0x7f610815cbe0 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f610cb6c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080cfcf0 con 0x7f61080d1410 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f6106d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f610806b650 0x7f610806bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58964/0 (socket says 172.21.15.62:58964) 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.316+0000 7f6106d9d640 1 -- 172.21.15.62:0/1045716162 learned_addr learned my addr 172.21.15.62:0/1045716162 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:46.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 --2- 172.21.15.62:0/1045716162 >> v2:172.21.15.135:3300/0 conn(0x7f61080d1410 0x7f61080d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966940141 0 0) 0x7f61080cf450 con 0x7f610806b650 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003520 con 0x7f610806b650 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419985408 0 0) 0x7f60f4003520 con 0x7f610806b650 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 >> v2:172.21.15.135:3300/0 conn(0x7f61080d1410 msgr2=0x7f61080d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 --2- 172.21.15.62:0/1045716162 >> v2:172.21.15.135:3300/0 conn(0x7f61080d1410 0x7f61080d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 >> v1:172.21.15.135:6789/0 conn(0x7f610815cbe0 legacy=0x7f61080d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080cfa10 con 0x7f610806b650 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f61000019f0 con 0x7f610806b650 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 >> v1:172.21.15.62:6789/0 conn(0x7f610806b650 legacy=0x7f610806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60f4003970 0x7f60f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 0x7f60f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f4005180 0x7f60f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080cfcf0 con 0x7f60f40047c0 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400c030 con 0x7f60f4005180 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400c1f0 con 0x7f60f4003970 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 0x7f60f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f6106d9d640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f4005180 0x7f60f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f610659c640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60f4003970 0x7f60f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 -- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60f4003970 msgr2=0x7f60f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60f4003970 0x7f60f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 -- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f4005180 msgr2=0x7f60f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.317+0000 7f60fffff640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f4005180 0x7f60f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f6106d9d640 1 -- 172.21.15.62:0/1045716162 reap_dead start 2023-09-30T13:54:46.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f60fffff640 1 -- 172.21.15.62:0/1045716162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4003520 con 0x7f60f40047c0 2023-09-30T13:54:46.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f60fffff640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 0x7f60f4004c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009ac0 tx=0x7f60f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92daffd304394e2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f002c6b0 con 0x7f60f40047c0 2023-09-30T13:54:46.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f002c810 con 0x7f60f40047c0 2023-09-30T13:54:46.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.318+0000 7f6105d9b640 1 -- 172.21.15.62:0/1045716162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f002cba0 con 0x7f60f40047c0 2023-09-30T13:54:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 -- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 msgr2=0x7f60f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 0x7f60f4004c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009ac0 tx=0x7f60f40057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 -- 172.21.15.62:0/1045716162 shutdown_connections 2023-09-30T13:54:46.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 --2- 172.21.15.62:0/1045716162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60f40047c0 0x7f60f4004c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 -- 172.21.15.62:0/1045716162 >> 172.21.15.62:0/1045716162 conn(0x7f6108089fe0 msgr2=0x7f61080d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 -- 172.21.15.62:0/1045716162 shutdown_connections 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.319+0000 7f610cb6c640 1 -- 172.21.15.62:0/1045716162 wait complete. 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.320+0000 7f610cb6c640 1 Processor -- start 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.320+0000 7f610cb6c640 1 -- start start 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f40047c0 0x7f61080cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61080b7080 0x7f61080ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61081498b0 con 0x7f61080b7f30 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108149b90 con 0x7f60f40047c0 2023-09-30T13:54:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610cb6c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6108149e70 con 0x7f61080b7080 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f60fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f60fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55622/0 (socket says 172.21.15.62:55622) 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f60fffff640 1 -- 172.21.15.62:0/2102239666 learned_addr learned my addr 172.21.15.62:0/2102239666 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f610659c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f40047c0 0x7f61080cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.321+0000 7f6106d9d640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61080b7080 0x7f61080ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 -- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61080b7080 msgr2=0x7f61080ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61080b7080 0x7f61080ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 -- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f40047c0 msgr2=0x7f61080cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f40047c0 0x7f61080cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 -- 172.21.15.62:0/2102239666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610814a150 con 0x7f61080b7f30 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60fffff640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60f002c250 tx=0x7f60f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0003810 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0003970 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610814a430 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0003d00 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.322+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61080cc4b0 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.323+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610804e0d0 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.323+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f60f0034440 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.324+0000 7f60feffd640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 0x7f60e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.324+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60f00aac90 con 0x7f61080b7f30 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.324+0000 7f610659c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 0x7f60e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.325+0000 7f610659c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 0x7f60e806cff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.328+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f60f00ddad0 con 0x7f61080b7f30 2023-09-30T13:54:46.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.540+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61080b1a30 con 0x7f61080b7f30 2023-09-30T13:54:46.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.541+0000 7f60feffd640 1 -- 172.21.15.62:0/2102239666 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f60f004ce90 con 0x7f61080b7f30 2023-09-30T13:54:46.541 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:46.541 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-30T13:54:46.541 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 msgr2=0x7f60e806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 0x7f60e806cff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f8009040 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 msgr2=0x7f61080b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60f002c250 tx=0x7f60f0004730 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 shutdown_connections 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f60e806ab30 0x7f60e806cff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61080b7080 0x7f61080ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61080b7f30 0x7f61080b6b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 --2- 172.21.15.62:0/2102239666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f40047c0 0x7f61080cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 >> 172.21.15.62:0/2102239666 conn(0x7f6108089fe0 msgr2=0x7f61080b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 shutdown_connections 2023-09-30T13:54:46.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.543+0000 7f610cb6c640 1 -- 172.21.15.62:0/2102239666 wait complete. 2023-09-30T13:54:46.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.659+0000 7fe2da3d5640 1 Processor -- start 2023-09-30T13:54:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.659+0000 7fe2da3d5640 1 -- start start 2023-09-30T13:54:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2da3d5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe2d40d1410 0x7fe2d40d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2da3d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40cf450 con 0x7fe2d406b650 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2da3d5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40cf730 con 0x7fe2d415cbe0 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2da3d5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d40cfcf0 con 0x7fe2d40d1410 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2d8972640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe2d406b650 0x7fe2d406bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58976/0 (socket says 172.21.15.62:58976) 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.660+0000 7fe2d8972640 1 -- 172.21.15.62:0/3721626122 learned_addr learned my addr 172.21.15.62:0/3721626122 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249123600 0 0) 0x7fe2d40cf450 con 0x7fe2d406b650 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc003520 con 0x7fe2d406b650 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d37fe640 1 --2- 172.21.15.62:0/3721626122 >> v2:172.21.15.135:3300/0 conn(0x7fe2d40d1410 0x7fe2d40d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156825436 0 0) 0x7fe2bc003520 con 0x7fe2d406b650 2023-09-30T13:54:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 >> v2:172.21.15.135:3300/0 conn(0x7fe2d40d1410 msgr2=0x7fe2d40d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 --2- 172.21.15.62:0/3721626122 >> v2:172.21.15.135:3300/0 conn(0x7fe2d40d1410 0x7fe2d40d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 >> v1:172.21.15.135:6789/0 conn(0x7fe2d415cbe0 legacy=0x7fe2d40d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40cfa10 con 0x7fe2d406b650 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fe2cc0019f0 con 0x7fe2d406b650 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 >> v1:172.21.15.62:6789/0 conn(0x7fe2d406b650 legacy=0x7fe2d406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 0x7fe2bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2bc0047c0 0x7fe2bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc005180 0x7fe2bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40cfcf0 con 0x7fe2bc003970 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00c030 con 0x7fe2bc0047c0 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00c1f0 con 0x7fe2bc005180 2023-09-30T13:54:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 0x7fe2bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d37fe640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2bc0047c0 0x7fe2bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d8972640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc005180 0x7fe2bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 -- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc005180 msgr2=0x7fe2bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc005180 0x7fe2bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 -- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2bc0047c0 msgr2=0x7fe2bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2bc0047c0 0x7fe2bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d3fff640 1 -- 172.21.15.62:0/3721626122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc003520 con 0x7fe2bc003970 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d8972640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc005180 0x7fe2bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.661+0000 7fe2d8972640 1 -- 172.21.15.62:0/3721626122 reap_dead start 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.662+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 0x7fe2bc003d90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4001770 tx=0x7fe2bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f1bc91d362b8a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.662+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40052d0 con 0x7fe2bc003970 2023-09-30T13:54:46.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.662+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c402e050 con 0x7fe2bc003970 2023-09-30T13:54:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.662+0000 7fe2d2ffd640 1 -- 172.21.15.62:0/3721626122 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4003640 con 0x7fe2bc003970 2023-09-30T13:54:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 -- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 msgr2=0x7fe2bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 0x7fe2bc003d90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4001770 tx=0x7fe2bc0057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 -- 172.21.15.62:0/3721626122 shutdown_connections 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/3721626122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2bc003970 0x7fe2bc003d90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 -- 172.21.15.62:0/3721626122 >> 172.21.15.62:0/3721626122 conn(0x7fe2d4089fe0 msgr2=0x7fe2d40d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 -- 172.21.15.62:0/3721626122 shutdown_connections 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.663+0000 7fe2da3d5640 1 -- 172.21.15.62:0/3721626122 wait complete. 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.664+0000 7fe2da3d5640 1 Processor -- start 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.664+0000 7fe2da3d5640 1 -- start start 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc003970 0x7fe2d415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2d40cbe80 0x7fe2d415f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d415a970 con 0x7fe2d415e100 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40cc900 con 0x7fe2d40cbe80 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2da3d5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40cc340 con 0x7fe2bc003970 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55644/0 (socket says 172.21.15.62:55644) 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 -- 172.21.15.62:0/4157524419 learned_addr learned my addr 172.21.15.62:0/4157524419 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc003970 0x7fe2d415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d8972640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2d40cbe80 0x7fe2d415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 -- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc003970 msgr2=0x7fe2d415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc003970 0x7fe2d415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 -- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2d40cbe80 msgr2=0x7fe2d415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2d40cbe80 0x7fe2d415f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 -- 172.21.15.62:0/4157524419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40cc620 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.665+0000 7fe2d37fe640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8011a70 tx=0x7fe2c8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.666+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8009680 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.666+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c800fb50 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.666+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d40b63b0 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.666+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800fee0 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.666+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d415fd70 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.667+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d404e0d0 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.667+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe2c801d400 con 0x7fe2d415e100 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.667+0000 7fe2d0ff9640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 0x7fe2c006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.668+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2c80895e0 con 0x7fe2d415e100 2023-09-30T13:54:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.668+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 0x7fe2c006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.668+0000 7fe2d3fff640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 0x7fe2c006cff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4033000 tx=0x7fe2c4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.672+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe2c8054c30 con 0x7fe2d415e100 2023-09-30T13:54:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.847+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d40b1a30 con 0x7fe2d415e100 2023-09-30T13:54:46.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.848+0000 7fe2d0ff9640 1 -- 172.21.15.62:0/4157524419 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fe2c8058250 con 0x7fe2d415e100 2023-09-30T13:54:46.848 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:39.834152+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 msgr2=0x7fe2c006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 0x7fe2c006cff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4033000 tx=0x7fe2c4009030 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 msgr2=0x7fe2d40cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8011a70 tx=0x7fe2c8011f30 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 shutdown_connections 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe2c006ab30 0x7fe2c006cff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2d40cbe80 0x7fe2d415f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d415e100 0x7fe2d40cb940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 --2- 172.21.15.62:0/4157524419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2bc003970 0x7fe2d415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 >> 172.21.15.62:0/4157524419 conn(0x7fe2d4089fe0 msgr2=0x7fe2d40b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 shutdown_connections 2023-09-30T13:54:46.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.850+0000 7fe2da3d5640 1 -- 172.21.15.62:0/4157524419 wait complete. 2023-09-30T13:54:46.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:54:46.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:54:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.970+0000 7fbbad9a9640 1 Processor -- start 2023-09-30T13:54:46.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.970+0000 7fbbad9a9640 1 -- start start 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbbad9a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba815cbc0 0x7fbba80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbbad9a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbba80b8760 0x7fbba80d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbbad9a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba80d1410 con 0x7fbba80cd8c0 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbbad9a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80d16f0 con 0x7fbba80b8760 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbbad9a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80d19d0 con 0x7fbba815cbc0 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba67fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbba80b8760 0x7fbba80d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbba80cd8c0 0x7fbba80b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58992/0 (socket says 172.21.15.62:58992) 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba77fe640 1 -- 172.21.15.62:0/1298641595 learned_addr learned my addr 172.21.15.62:0/1298641595 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba6ffd640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba815cbc0 0x7fbba80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba67fc640 1 -- 172.21.15.62:0/1298641595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba815cbc0 msgr2=0x7fbba80d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba67fc640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba815cbc0 0x7fbba80d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba67fc640 1 -- 172.21.15.62:0/1298641595 >> v1:172.21.15.62:6789/0 conn(0x7fbba80cd8c0 legacy=0x7fbba80b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba67fc640 1 -- 172.21.15.62:0/1298641595 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80d1cb0 con 0x7fbba80b8760 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.971+0000 7fbba5ffb640 1 -- 172.21.15.62:0/1298641595 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956513243 0 0) 0x7fbba80d1410 con 0x7fbba80cd8c0 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.972+0000 7fbba67fc640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba80b8760 0x7fbba80d0be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb900097a0 tx=0x7fbb9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba55cfb14618aa22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.972+0000 7fbba5ffb640 1 -- 172.21.15.62:0/1298641595 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90031830 con 0x7fbba80b8760 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.972+0000 7fbba5ffb640 1 -- 172.21.15.62:0/1298641595 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90031990 con 0x7fbba80b8760 2023-09-30T13:54:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.972+0000 7fbba5ffb640 1 -- 172.21.15.62:0/1298641595 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90031d20 con 0x7fbba80b8760 2023-09-30T13:54:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1298641595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba80b8760 msgr2=0x7fbba80d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba80b8760 0x7fbba80d0be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb900097a0 tx=0x7fbb9002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1298641595 shutdown_connections 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba80b8760 0x7fbba80d0be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1298641595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba815cbc0 0x7fbba80d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1298641595 >> 172.21.15.62:0/1298641595 conn(0x7fbba80718a0 msgr2=0x7fbba8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1298641595 shutdown_connections 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.973+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1298641595 wait complete. 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.974+0000 7fbbad9a9640 1 Processor -- start 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.974+0000 7fbbad9a9640 1 -- start start 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba80b8760 0x7fbba8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 0x7fbba815e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b5180 con 0x7fbba815cbc0 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815eb60 con 0x7fbba80b8760 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbbad9a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8155e80 con 0x7fbba80cd8c0 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55660/0 (socket says 172.21.15.62:55660) 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 -- 172.21.15.62:0/1061261321 learned_addr learned my addr 172.21.15.62:0/1061261321 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba6ffd640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba80b8760 0x7fbba8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba67fc640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 0x7fbba815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 -- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 msgr2=0x7fbba815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 0x7fbba815e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 -- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba80b8760 msgr2=0x7fbba8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba80b8760 0x7fbba8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba77fe640 1 -- 172.21.15.62:0/1061261321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009400 con 0x7fbba815cbc0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.975+0000 7fbba67fc640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 0x7fbba815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbba77fe640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c7d0 tx=0x7fbb9800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800a640 con 0x7fbba815cbc0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800a7a0 con 0x7fbba815cbc0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800ab90 con 0x7fbba815cbc0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba815ede0 con 0x7fbba815cbc0 2023-09-30T13:54:46.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.976+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba815f3a0 con 0x7fbba815cbc0 2023-09-30T13:54:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.977+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba804e0d0 con 0x7fbba815cbc0 2023-09-30T13:54:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.977+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbb9800acf0 con 0x7fbba815cbc0 2023-09-30T13:54:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.978+0000 7fbb9ffff640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 0x7fbb8806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.978+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb98088320 con 0x7fbba815cbc0 2023-09-30T13:54:46.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.978+0000 7fbba6ffd640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 0x7fbb8806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:46.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.978+0000 7fbba6ffd640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 0x7fbb8806cff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbba00079a0 tx=0x7fbba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:46.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:46.982+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbb98053a00 con 0x7fbba815cbc0 2023-09-30T13:54:47.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.157+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbba80c9d40 con 0x7fbba815cbc0 2023-09-30T13:54:47.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.157+0000 7fbb9ffff640 1 -- 172.21.15.62:0/1061261321 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb980180a0 con 0x7fbba815cbc0 2023-09-30T13:54:47.157 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:54:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.159+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 msgr2=0x7fbb8806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.159+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 0x7fbb8806cff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbba00079a0 tx=0x7fbba0008040 comp rx=0 tx=0).stop 2023-09-30T13:54:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.159+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 msgr2=0x7fbba8155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.159+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c7d0 tx=0x7fbb9800cc90 comp rx=0 tx=0).stop 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.159+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 shutdown_connections 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb8806ab30 0x7fbb8806cff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbba815cbc0 0x7fbba8155940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbba80cd8c0 0x7fbba815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 --2- 172.21.15.62:0/1061261321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba80b8760 0x7fbba8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 >> 172.21.15.62:0/1061261321 conn(0x7fbba80718a0 msgr2=0x7fbba80b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 shutdown_connections 2023-09-30T13:54:47.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.160+0000 7fbbad9a9640 1 -- 172.21.15.62:0/1061261321 wait complete. 2023-09-30T13:54:47.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T13:54:47.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.276+0000 7f84ff3fb640 1 Processor -- start 2023-09-30T13:54:47.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.276+0000 7f84ff3fb640 1 -- start start 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84ff3fb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84f80ace50 0x7f84f80b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84ff3fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84f80b31c0 0x7f84f80cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84ff3fb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f815b9a0 con 0x7f84f80cef70 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84ff3fb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f80cf400 con 0x7f84f80ace50 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84ff3fb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f80b2e50 con 0x7f84f80b31c0 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd197640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84f80ace50 0x7f84f80b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd998640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f84f80cef70 0x7f84f815e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59002/0 (socket says 172.21.15.62:59002) 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd998640 1 -- 172.21.15.62:0/2246773422 learned_addr learned my addr 172.21.15.62:0/2246773422 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fc996640 1 --2- 172.21.15.62:0/2246773422 >> v2:172.21.15.135:3300/0 conn(0x7f84f80b31c0 0x7f84f80cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd197640 1 -- 172.21.15.62:0/2246773422 >> v2:172.21.15.135:3300/0 conn(0x7f84f80b31c0 msgr2=0x7f84f80cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd197640 1 --2- 172.21.15.62:0/2246773422 >> v2:172.21.15.135:3300/0 conn(0x7f84f80b31c0 0x7f84f80cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd197640 1 -- 172.21.15.62:0/2246773422 >> v1:172.21.15.62:6789/0 conn(0x7f84f80cef70 legacy=0x7f84f815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84fd197640 1 -- 172.21.15.62:0/2246773422 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80cc950 con 0x7f84f80ace50 2023-09-30T13:54:47.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.277+0000 7f84effff640 1 -- 172.21.15.62:0/2246773422 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973441818 0 0) 0x7f84f815b9a0 con 0x7f84f80cef70 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.278+0000 7f84fd197640 1 --2- 172.21.15.62:0/2246773422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f80b2910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84f80b1f10 tx=0x7f84f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f50e644d33936e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.278+0000 7f84effff640 1 -- 172.21.15.62:0/2246773422 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f402e070 con 0x7f84f80ace50 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.278+0000 7f84effff640 1 -- 172.21.15.62:0/2246773422 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40315a0 con 0x7f84f80ace50 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.278+0000 7f84effff640 1 -- 172.21.15.62:0/2246773422 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4031930 con 0x7f84f80ace50 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2246773422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 msgr2=0x7f84f80b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2246773422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f80b2910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84f80b1f10 tx=0x7f84f402b840 comp rx=0 tx=0).stop 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2246773422 shutdown_connections 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2246773422 >> v2:172.21.15.135:3300/0 conn(0x7f84f80b31c0 0x7f84f80cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2246773422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f80b2910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2246773422 >> 172.21.15.62:0/2246773422 conn(0x7f84f806a170 msgr2=0x7f84f806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2246773422 shutdown_connections 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.279+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2246773422 wait complete. 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.280+0000 7f84ff3fb640 1 Processor -- start 2023-09-30T13:54:47.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.280+0000 7f84ff3fb640 1 -- start start 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f80b31c0 0x7f84f806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f80cef70 0x7f84f81f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8156290 con 0x7f84f80ace50 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f81558c0 con 0x7f84f80b31c0 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8154a10 con 0x7f84f80cef70 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55668/0 (socket says 172.21.15.62:55668) 2023-09-30T13:54:47.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 -- 172.21.15.62:0/2496946650 learned_addr learned my addr 172.21.15.62:0/2496946650 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 -- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f80cef70 msgr2=0x7f84f81f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f80cef70 0x7f84f81f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fc996640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f80b31c0 0x7f84f806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 -- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f80b31c0 msgr2=0x7f84f806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f80b31c0 0x7f84f806d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 -- 172.21.15.62:0/2496946650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40093a0 con 0x7f84f80ace50 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84fd197640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84f4034040 tx=0x7f84f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4004230 con 0x7f84f80ace50 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4004390 con 0x7f84f80ace50 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f8154cb0 con 0x7f84f80ace50 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.281+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4005bd0 con 0x7f84f80ace50 2023-09-30T13:54:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.282+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f8155270 con 0x7f84f80ace50 2023-09-30T13:54:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.282+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f815adb0 con 0x7f84f80ace50 2023-09-30T13:54:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.283+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f84f4032640 con 0x7f84f80ace50 2023-09-30T13:54:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.283+0000 7f84edffb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 0x7f84dc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.283+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84f40aaca0 con 0x7f84f80ace50 2023-09-30T13:54:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.284+0000 7f84fc996640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 0x7f84dc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.284+0000 7f84fc996640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 0x7f84dc06cff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84f809c5a0 tx=0x7f84e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.288+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f84f815adb0 con 0x7f84f80ace50 2023-09-30T13:54:47.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.467+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84f815adb0 con 0x7f84f80ace50 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.467+0000 7f84edffb640 1 -- 172.21.15.62:0/2496946650 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f84f815adb0 con 0x7f84f80ace50 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-09-30T13:54:47.467 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-09-30T13:54:47.468 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:54:47.468 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 msgr2=0x7f84dc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 0x7f84dc06cff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84f809c5a0 tx=0x7f84e8008040 comp rx=0 tx=0).stop 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 msgr2=0x7f84f8155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84f4034040 tx=0x7f84f40046c0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 shutdown_connections 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84dc06ab30 0x7f84dc06cff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f80cef70 0x7f84f81f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f80b31c0 0x7f84f806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 --2- 172.21.15.62:0/2496946650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84f80ace50 0x7f84f8155d50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 >> 172.21.15.62:0/2496946650 conn(0x7f84f806a170 msgr2=0x7f84f815af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 shutdown_connections 2023-09-30T13:54:47.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.469+0000 7f84ff3fb640 1 -- 172.21.15.62:0/2496946650 wait complete. 2023-09-30T13:54:47.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T13:54:47.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T13:54:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.589+0000 7f26d2b0f640 1 Processor -- start 2023-09-30T13:54:47.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.589+0000 7f26d2b0f640 1 -- start start 2023-09-30T13:54:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc15ccb0 0x7f26cc0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 0x7f26cc0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26cc0d0830 0x7f26cc0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0d1200 con 0x7f26cc0d0830 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06b9a0 con 0x7f26cc0ce8e0 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d2b0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ce150 con 0x7f26cc15ccb0 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26cc0d0830 0x7f26cc0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26cc0d0830 0x7f26cc0d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52568/0 (socket says 172.21.15.62:52568) 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 -- 172.21.15.62:0/562571193 learned_addr learned my addr 172.21.15.62:0/562571193 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26cbfff640 1 --2- 172.21.15.62:0/562571193 >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 0x7f26cc0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d08ab640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc15ccb0 0x7f26cc0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 -- 172.21.15.62:0/562571193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc15ccb0 msgr2=0x7f26cc0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc15ccb0 0x7f26cc0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 -- 172.21.15.62:0/562571193 >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 msgr2=0x7f26cc0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 --2- 172.21.15.62:0/562571193 >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 0x7f26cc0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26d10ac640 1 -- 172.21.15.62:0/562571193 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0ceda0 con 0x7f26cc0d0830 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.590+0000 7f26cbfff640 1 --2- 172.21.15.62:0/562571193 >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 0x7f26cc0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.591+0000 7f26d10ac640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc0d0830 0x7f26cc0d0cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0ce430 tx=0x7f26bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7b336e9af17baa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.591+0000 7f26cb7fe640 1 -- 172.21.15.62:0/562571193 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc031870 con 0x7f26cc0d0830 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.591+0000 7f26cb7fe640 1 -- 172.21.15.62:0/562571193 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc0319d0 con 0x7f26cc0d0830 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.591+0000 7f26cb7fe640 1 -- 172.21.15.62:0/562571193 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc031d60 con 0x7f26cc0d0830 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 -- 172.21.15.62:0/562571193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc0d0830 msgr2=0x7f26cc0d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc0d0830 0x7f26cc0d0cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0ce430 tx=0x7f26bc02b910 comp rx=0 tx=0).stop 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 -- 172.21.15.62:0/562571193 shutdown_connections 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc0d0830 0x7f26cc0d0cc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/562571193 >> v2:172.21.15.135:3300/0 conn(0x7f26cc0ce8e0 0x7f26cc0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/562571193 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc15ccb0 0x7f26cc0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 -- 172.21.15.62:0/562571193 >> 172.21.15.62:0/562571193 conn(0x7f26cc089fe0 msgr2=0x7f26cc099c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 -- 172.21.15.62:0/562571193 shutdown_connections 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.592+0000 7f26d2b0f640 1 -- 172.21.15.62:0/562571193 wait complete. 2023-09-30T13:54:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.593+0000 7f26d2b0f640 1 Processor -- start 2023-09-30T13:54:47.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.593+0000 7f26d2b0f640 1 -- start start 2023-09-30T13:54:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26cc0ce8e0 0x7f26cc15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0d0830 0x7f26cc1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc159930 con 0x7f26cc15ccb0 2023-09-30T13:54:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15d650 con 0x7f26cc0ce8e0 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d2b0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15d930 con 0x7f26cc0d0830 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52572/0 (socket says 172.21.15.62:52572) 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 -- 172.21.15.62:0/1034740656 learned_addr learned my addr 172.21.15.62:0/1034740656 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d08ab640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26cc0ce8e0 0x7f26cc15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26cbfff640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0d0830 0x7f26cc1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 -- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0d0830 msgr2=0x7f26cc1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0d0830 0x7f26cc1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 -- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26cc0ce8e0 msgr2=0x7f26cc15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26cc0ce8e0 0x7f26cc15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 -- 172.21.15.62:0/1034740656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0094d0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.594+0000 7f26d10ac640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0090b0 tx=0x7f26bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.595+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc03ad20 con 0x7f26cc15ccb0 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.595+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc0443f0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.595+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc03aea0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.595+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc15dc10 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.595+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc15e1d0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.596+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc15e3c0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.596+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f26bc04d450 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.597+0000 7f26c97fa640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 0x7f26ac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.597+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f26bc02d040 con 0x7f26cc15ccb0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.597+0000 7f26d08ab640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 0x7f26ac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.597+0000 7f26d08ab640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 0x7f26ac06cff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009a30 tx=0x7f26c4003cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.601+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f26bc076ac0 con 0x7f26cc15ccb0 2023-09-30T13:54:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:47.779+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f26cc073e70 con 0x7f26cc15ccb0 2023-09-30T13:54:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.397+0000 7f26c97fa640 1 -- 172.21.15.62:0/1034740656 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f26bc07a0e0 con 0x7f26cc15ccb0 2023-09-30T13:54:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 msgr2=0x7f26ac06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 0x7f26ac06cff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009a30 tx=0x7f26c4003cd0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 msgr2=0x7f26cc0b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0090b0 tx=0x7f26bc0046c0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 shutdown_connections 2023-09-30T13:54:48.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26ac06ab30 0x7f26ac06cff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26cc15ccb0 0x7f26cc0b4c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0d0830 0x7f26cc1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 --2- 172.21.15.62:0/1034740656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26cc0ce8e0 0x7f26cc15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 >> 172.21.15.62:0/1034740656 conn(0x7f26cc089fe0 msgr2=0x7f26cc0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 shutdown_connections 2023-09-30T13:54:48.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.400+0000 7f26d2b0f640 1 -- 172.21.15.62:0/1034740656 wait complete. 2023-09-30T13:54:48.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-09-30T13:54:48.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.536+0000 7fbf3e74c640 1 Processor -- start 2023-09-30T13:54:48.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.536+0000 7fbf3e74c640 1 -- start start 2023-09-30T13:54:48.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 0x7fbf3806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 0x7fbf380caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf381605d0 0x7fbf380cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380cf7a0 con 0x7fbf381605d0 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380ce120 con 0x7fbf381601f0 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3e74c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380cf150 con 0x7fbf380cdc60 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf381605d0 0x7fbf380cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf381605d0 0x7fbf380cfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52582/0 (socket says 172.21.15.62:52582) 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 -- 172.21.15.62:0/3489424372 learned_addr learned my addr 172.21.15.62:0/3489424372 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf377fe640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 0x7fbf380caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf37fff640 1 --2- 172.21.15.62:0/3489424372 >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 0x7fbf3806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 -- 172.21.15.62:0/3489424372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 msgr2=0x7fbf380caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 0x7fbf380caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 -- 172.21.15.62:0/3489424372 >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 msgr2=0x7fbf3806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 --2- 172.21.15.62:0/3489424372 >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 0x7fbf3806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf3cce9640 1 -- 172.21.15.62:0/3489424372 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380cf430 con 0x7fbf381605d0 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf377fe640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 0x7fbf380caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.537+0000 7fbf37fff640 1 --2- 172.21.15.62:0/3489424372 >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 0x7fbf3806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.538+0000 7fbf3cce9640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381605d0 0x7fbf380cfc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf380ce440 tx=0x7fbf3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0399476e7a98b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.538+0000 7fbf36ffd640 1 -- 172.21.15.62:0/3489424372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3002ca70 con 0x7fbf381605d0 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.538+0000 7fbf36ffd640 1 -- 172.21.15.62:0/3489424372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3002cbd0 con 0x7fbf381605d0 2023-09-30T13:54:48.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.538+0000 7fbf36ffd640 1 -- 172.21.15.62:0/3489424372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300343f0 con 0x7fbf381605d0 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3489424372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381605d0 msgr2=0x7fbf380cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381605d0 0x7fbf380cfc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf380ce440 tx=0x7fbf3002bed0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3489424372 shutdown_connections 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381605d0 0x7fbf380cfc30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3489424372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf380cdc60 0x7fbf380caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3489424372 >> v2:172.21.15.135:3300/0 conn(0x7fbf381601f0 0x7fbf3806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3489424372 >> 172.21.15.62:0/3489424372 conn(0x7fbf380d0940 msgr2=0x7fbf380d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3489424372 shutdown_connections 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.539+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3489424372 wait complete. 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.540+0000 7fbf3e74c640 1 Processor -- start 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.540+0000 7fbf3e74c640 1 -- start start 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf380cdc60 0x7fbf3815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf381605d0 0x7fbf380d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381f28f0 con 0x7fbf381601f0 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381f69b0 con 0x7fbf380cdc60 2023-09-30T13:54:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3e74c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381f66d0 con 0x7fbf381605d0 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52596/0 (socket says 172.21.15.62:52596) 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 -- 172.21.15.62:0/3416698507 learned_addr learned my addr 172.21.15.62:0/3416698507 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf37fff640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf380cdc60 0x7fbf3815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf3cce9640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf381605d0 0x7fbf380d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 -- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf381605d0 msgr2=0x7fbf380d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf381605d0 0x7fbf380d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 -- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf380cdc60 msgr2=0x7fbf3815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf380cdc60 0x7fbf3815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 -- 172.21.15.62:0/3416698507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30009b30 con 0x7fbf381601f0 2023-09-30T13:54:48.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.541+0000 7fbf377fe640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c820 tx=0x7fbf2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28007a30 con 0x7fbf381601f0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf28007b90 con 0x7fbf381601f0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf380c6560 con 0x7fbf381601f0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800ce10 con 0x7fbf381601f0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf380c6b20 con 0x7fbf381601f0 2023-09-30T13:54:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.542+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3804e0d0 con 0x7fbf381601f0 2023-09-30T13:54:48.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.543+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbf280113f0 con 0x7fbf381601f0 2023-09-30T13:54:48.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.543+0000 7fbf34ff9640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 0x7fbf1806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:48.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.543+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbf28089150 con 0x7fbf381601f0 2023-09-30T13:54:48.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.544+0000 7fbf37fff640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 0x7fbf1806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:48.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.544+0000 7fbf37fff640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 0x7fbf1806cff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf20006fd0 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:48.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.548+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbf28054500 con 0x7fbf381601f0 2023-09-30T13:54:48.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:48.724+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fbf38066d70 con 0x7fbf381601f0 2023-09-30T13:54:49.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:54:49.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:54:49.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.402+0000 7fbf34ff9640 1 -- 172.21.15.62:0/3416698507 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fbf28057b20 con 0x7fbf381601f0 2023-09-30T13:54:49.402 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-09-30T13:54:49.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.405+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 msgr2=0x7fbf1806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.405+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 0x7fbf1806cff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf20006fd0 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.405+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 msgr2=0x7fbf380c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c820 tx=0x7fbf2800cce0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 shutdown_connections 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbf1806ab30 0x7fbf1806cff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf381605d0 0x7fbf380d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf381601f0 0x7fbf380c7040 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 --2- 172.21.15.62:0/3416698507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf380cdc60 0x7fbf3815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.406+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 >> 172.21.15.62:0/3416698507 conn(0x7fbf380d0940 msgr2=0x7fbf3815afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:49.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.407+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 shutdown_connections 2023-09-30T13:54:49.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.408+0000 7fbf3e74c640 1 -- 172.21.15.62:0/3416698507 wait complete. 2023-09-30T13:54:49.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T13:54:49.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.542+0000 7f4c1eec9640 1 Processor -- start 2023-09-30T13:54:49.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.542+0000 7f4c1eec9640 1 -- start start 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1eec9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c1815cbc0 0x7f4c180d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1eec9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c180d1410 con 0x7f4c180cd8c0 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1eec9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c180d16f0 con 0x7f4c180b8760 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1eec9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c180d19d0 con 0x7f4c1815cbc0 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1d466640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4c180cd8c0 0x7f4c180b5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53078/0 (socket says 172.21.15.62:53078) 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.543+0000 7f4c1d466640 1 -- 172.21.15.62:0/850405697 learned_addr learned my addr 172.21.15.62:0/850405697 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280047666 0 0) 0x7f4c180d1410 con 0x7f4c180cd8c0 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1cc65640 1 --2- 172.21.15.62:0/850405697 >> v2:172.21.15.135:3300/0 conn(0x7f4c1815cbc0 0x7f4c180d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c00003520 con 0x7f4c180cd8c0 2023-09-30T13:54:49.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4184830820 0 0) 0x7f4c00003520 con 0x7f4c180cd8c0 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 >> v2:172.21.15.135:3300/0 conn(0x7f4c1815cbc0 msgr2=0x7f4c180d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 --2- 172.21.15.62:0/850405697 >> v2:172.21.15.135:3300/0 conn(0x7f4c1815cbc0 0x7f4c180d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 >> v1:172.21.15.135:6789/0 conn(0x7f4c180b8760 legacy=0x7f4c180d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180d1cb0 con 0x7f4c180cd8c0 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f4c08001670 con 0x7f4c180cd8c0 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 >> v1:172.21.15.62:6789/0 conn(0x7f4c180cd8c0 legacy=0x7f4c180b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c00003970 0x7f4c00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c000047c0 0x7f4c00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180d19d0 con 0x7f4c00005180 2023-09-30T13:54:49.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0000c020 con 0x7f4c000047c0 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0000c1e0 con 0x7f4c00003970 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1cc65640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c00003970 0x7f4c00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c17fff640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c000047c0 0x7f4c00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 -- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c00003970 msgr2=0x7f4c00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c00003970 0x7f4c00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 -- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c000047c0 msgr2=0x7f4c00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c000047c0 0x7f4c00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.544+0000 7f4c1d466640 1 -- 172.21.15.62:0/850405697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00003520 con 0x7f4c00005180 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.545+0000 7f4c1d466640 1 -- 172.21.15.62:0/850405697 reap_dead start 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.545+0000 7f4c1d466640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c0000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c240 tx=0x7f4c000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da49a4a6488e3c07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.545+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005ad0 con 0x7f4c00005180 2023-09-30T13:54:49.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.545+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08005c50 con 0x7f4c00005180 2023-09-30T13:54:49.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.545+0000 7f4c177fe640 1 -- 172.21.15.62:0/850405697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0802c8b0 con 0x7f4c00005180 2023-09-30T13:54:49.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 -- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 msgr2=0x7f4c0000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c0000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c240 tx=0x7f4c000057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 -- 172.21.15.62:0/850405697 shutdown_connections 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/850405697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c0000b980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 -- 172.21.15.62:0/850405697 >> 172.21.15.62:0/850405697 conn(0x7f4c180718a0 msgr2=0x7f4c18071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 -- 172.21.15.62:0/850405697 shutdown_connections 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.546+0000 7f4c1eec9640 1 -- 172.21.15.62:0/850405697 wait complete. 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.547+0000 7f4c1eec9640 1 Processor -- start 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.547+0000 7f4c1eec9640 1 -- start start 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c181503c0 0x7f4c1815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c181544f0 0x7f4c18154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1815e770 con 0x7f4c00005180 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18154eb0 con 0x7f4c181544f0 2023-09-30T13:54:49.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1eec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1815daf0 con 0x7f4c181503c0 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52610/0 (socket says 172.21.15.62:52610) 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 -- 172.21.15.62:0/738942618 learned_addr learned my addr 172.21.15.62:0/738942618 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c17fff640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c181503c0 0x7f4c1815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1d466640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c181544f0 0x7f4c18154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 -- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c181503c0 msgr2=0x7f4c1815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c181503c0 0x7f4c1815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 -- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c181544f0 msgr2=0x7f4c18154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c181544f0 0x7f4c18154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 -- 172.21.15.62:0/738942618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1815ddd0 con 0x7f4c00005180 2023-09-30T13:54:49.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.548+0000 7f4c1cc65640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009fc0 tx=0x7f4c1000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.549+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000e040 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.549+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000f040 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.549+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1815e0b0 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.549+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10015870 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.549+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1815d7e0 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.550+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1804e0d0 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.550+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4c100159d0 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.550+0000 7f4c157fa640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 0x7f4c0406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.551+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4c10089fb0 con 0x7f4c00005180 2023-09-30T13:54:49.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.551+0000 7f4c17fff640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 0x7f4c0406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:49.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.551+0000 7f4c17fff640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 0x7f4c0406cff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c000c00 tx=0x7f4c0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:49.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.555+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4c100bcad0 con 0x7f4c00005180 2023-09-30T13:54:49.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:49.766+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c180b71b0 con 0x7f4c00005180 2023-09-30T13:54:50.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.412+0000 7f4c157fa640 1 -- 172.21.15.62:0/738942618 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c10058cf0 con 0x7f4c00005180 2023-09-30T13:54:50.412 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 2 and data pool 3 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 msgr2=0x7f4c0406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 0x7f4c0406cff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c000c00 tx=0x7f4c0c009040 comp rx=0 tx=0).stop 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 msgr2=0x7f4c1814fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009fc0 tx=0x7f4c1000f580 comp rx=0 tx=0).stop 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 shutdown_connections 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c0406ab30 0x7f4c0406cff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c181544f0 0x7f4c18154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c181503c0 0x7f4c1815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 --2- 172.21.15.62:0/738942618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c00005180 0x7f4c1814fd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 >> 172.21.15.62:0/738942618 conn(0x7f4c180718a0 msgr2=0x7f4c18071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:50.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 shutdown_connections 2023-09-30T13:54:50.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.416+0000 7f4c1eec9640 1 -- 172.21.15.62:0/738942618 wait complete. 2023-09-30T13:54:50.432 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-09-30T13:54:50.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-09-30T13:54:50.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.548+0000 7faf354a9640 1 Processor -- start 2023-09-30T13:54:50.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.548+0000 7faf354a9640 1 -- start start 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf354a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf300d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf354a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300d31a0 con 0x7faf300cf970 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf354a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300cdf60 con 0x7faf3015cca0 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf354a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300cda90 con 0x7faf300b20c0 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faf300cf970 0x7faf300d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53080/0 (socket says 172.21.15.62:53080) 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2f7fe640 1 -- 172.21.15.62:0/149421824 learned_addr learned my addr 172.21.15.62:0/149421824 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:50.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf27fff640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf300d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875390259 0 0) 0x7faf300d31a0 con 0x7faf300cf970 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf1c003520 con 0x7faf300cf970 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1466827876 0 0) 0x7faf1c003520 con 0x7faf300cf970 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 msgr2=0x7faf300d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf300d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 >> v1:172.21.15.135:6789/0 conn(0x7faf3015cca0 legacy=0x7faf300cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300cdc80 con 0x7faf300cf970 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7faf280019f0 con 0x7faf300cf970 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 >> v1:172.21.15.62:6789/0 conn(0x7faf300cf970 legacy=0x7faf300d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c0039a0 0x7faf1c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c004d00 0x7faf1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c00ba30 con 0x7faf1c004d00 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c00bb70 con 0x7faf1c0039a0 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.549+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c00bd30 con 0x7faf300b20c0 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c004d00 0x7faf1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf27fff640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2effd640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c0039a0 0x7faf1c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 -- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 msgr2=0x7faf1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300b20c0 0x7faf1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 -- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c0039a0 msgr2=0x7faf1c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c0039a0 0x7faf1c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.550+0000 7faf2f7fe640 1 -- 172.21.15.62:0/149421824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c003520 con 0x7faf1c004d00 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c004d00 0x7faf1c005180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a830 tx=0x7faf1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ea735070c9e903 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2802cea0 con 0x7faf1c004d00 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2802f070 con 0x7faf1c004d00 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf2e7fc640 1 -- 172.21.15.62:0/149421824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28034890 con 0x7faf1c004d00 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 -- 172.21.15.62:0/149421824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c004d00 msgr2=0x7faf1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 --2- 172.21.15.62:0/149421824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf1c004d00 0x7faf1c005180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a830 tx=0x7faf1c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf2f7fe640 1 -- 172.21.15.62:0/149421824 reap_dead start 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 -- 172.21.15.62:0/149421824 shutdown_connections 2023-09-30T13:54:50.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 -- 172.21.15.62:0/149421824 >> 172.21.15.62:0/149421824 conn(0x7faf30071660 msgr2=0x7faf30071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 -- 172.21.15.62:0/149421824 shutdown_connections 2023-09-30T13:54:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.551+0000 7faf354a9640 1 -- 172.21.15.62:0/149421824 wait complete. 2023-09-30T13:54:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 Processor -- start 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 -- start start 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c004d00 0x7faf3015fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300c9bf0 0x7faf3015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3015f8c0 con 0x7faf300cb670 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300ca170 con 0x7faf1c004d00 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf354a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3015d110 con 0x7faf300c9bf0 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52616/0 (socket says 172.21.15.62:52616) 2023-09-30T13:54:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.553+0000 7faf2f7fe640 1 -- 172.21.15.62:0/4198929487 learned_addr learned my addr 172.21.15.62:0/4198929487 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf27fff640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300c9bf0 0x7faf3015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2effd640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c004d00 0x7faf3015fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 -- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300c9bf0 msgr2=0x7faf3015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300c9bf0 0x7faf3015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 -- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c004d00 msgr2=0x7faf3015fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c004d00 0x7faf3015fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 -- 172.21.15.62:0/4198929487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300b3d40 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf2f7fe640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a950 tx=0x7faf28001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28034840 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280019e0 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf300b4020 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28034ba0 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.554+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf300cc030 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.555+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf30073e70 con 0x7faf300cb670 2023-09-30T13:54:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.555+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7faf28031030 con 0x7faf300cb670 2023-09-30T13:54:50.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.556+0000 7faf277fe640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 0x7faf1006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:50.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.556+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf280aa700 con 0x7faf300cb670 2023-09-30T13:54:50.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.556+0000 7faf2effd640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 0x7faf1006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:50.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.557+0000 7faf2effd640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 0x7faf1006d020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf20001910 tx=0x7faf20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:50.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.560+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7faf28075a90 con 0x7faf300cb670 2023-09-30T13:54:50.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:50.745+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7faf3015c170 con 0x7faf300cb670 2023-09-30T13:54:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.393+0000 7faf277fe640 1 -- 172.21.15.62:0/4198929487 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7faf280011c0 con 0x7faf300cb670 2023-09-30T13:54:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 msgr2=0x7faf1006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 0x7faf1006d020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf20001910 tx=0x7faf20009040 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 msgr2=0x7faf300cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a950 tx=0x7faf28001d80 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 shutdown_connections 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1006ab60 0x7faf1006d020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf300cb670 0x7faf300cbaf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf300c9bf0 0x7faf3015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.395+0000 7faf354a9640 1 --2- 172.21.15.62:0/4198929487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1c004d00 0x7faf3015fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.396+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 >> 172.21.15.62:0/4198929487 conn(0x7faf30071660 msgr2=0x7faf300cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.396+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 shutdown_connections 2023-09-30T13:54:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.396+0000 7faf354a9640 1 -- 172.21.15.62:0/4198929487 wait complete. 2023-09-30T13:54:51.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T13:54:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.530+0000 7fcaad0a2640 1 Processor -- start 2023-09-30T13:54:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.530+0000 7fcaad0a2640 1 -- start start 2023-09-30T13:54:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaad0a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcaa80cd440 0x7fcaa80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaad0a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaad0a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa80cec80 con 0x7fcaa80b3cb0 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaad0a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa80ce6a0 con 0x7fcaa80cd440 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaad0a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80b62b0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.531+0000 7fcaa659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa6d9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcaa80cd440 0x7fcaa80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:45878/0 (socket says 172.21.15.62:45878) 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 -- 172.21.15.62:0/1649409616 learned_addr learned my addr 172.21.15.62:0/1649409616 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa759e640 1 --1- 172.21.15.62:0/1649409616 >> v1:172.21.15.135:6789/0 conn(0x7fcaa80b3cb0 0x7fcaa80cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:53500/0 (socket says 172.21.15.62:53500) 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 -- 172.21.15.62:0/1649409616 >> v2:172.21.15.135:3300/0 conn(0x7fcaa80cd440 msgr2=0x7fcaa80cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:51.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 --2- 172.21.15.62:0/1649409616 >> v2:172.21.15.135:3300/0 conn(0x7fcaa80cd440 0x7fcaa80cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 -- 172.21.15.62:0/1649409616 >> v1:172.21.15.135:6789/0 conn(0x7fcaa80b3cb0 legacy=0x7fcaa80cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.532+0000 7fcaa659c640 1 -- 172.21.15.62:0/1649409616 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa80ce910 con 0x7fcaa80cfd60 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaa659c640 1 --2- 172.21.15.62:0/1649409616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009870 tx=0x7fca9c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5162af090653824 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaa5d9b640 1 -- 172.21.15.62:0/1649409616 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c030840 con 0x7fcaa80cfd60 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaa5d9b640 1 -- 172.21.15.62:0/1649409616 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0309a0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaa5d9b640 1 -- 172.21.15.62:0/1649409616 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c030d30 con 0x7fcaa80cfd60 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1649409616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 msgr2=0x7fcaa80b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1649409616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009870 tx=0x7fca9c02b980 comp rx=0 tx=0).stop 2023-09-30T13:54:51.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1649409616 shutdown_connections 2023-09-30T13:54:51.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1649409616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cfd60 0x7fcaa80b3770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1649409616 >> v2:172.21.15.135:3300/0 conn(0x7fcaa80cd440 0x7fcaa80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1649409616 >> 172.21.15.62:0/1649409616 conn(0x7fcaa806e380 msgr2=0x7fcaa806e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:51.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1649409616 shutdown_connections 2023-09-30T13:54:51.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.533+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1649409616 wait complete. 2023-09-30T13:54:51.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.535+0000 7fcaad0a2640 1 Processor -- start 2023-09-30T13:54:51.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.535+0000 7fcaad0a2640 1 -- start start 2023-09-30T13:54:51.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.535+0000 7fcaad0a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa80b3cb0 0x7fcaa80b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.535+0000 7fcaad0a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 0x7fcaa80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaad0a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaad0a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa806cf30 con 0x7fcaa80cfd60 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaad0a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81f5980 con 0x7fcaa80b3cb0 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaad0a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81f5c60 con 0x7fcaa80cd440 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52624/0 (socket says 172.21.15.62:52624) 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 0x7fcaa80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 -- 172.21.15.62:0/1660461876 learned_addr learned my addr 172.21.15.62:0/1660461876 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa80b3cb0 0x7fcaa80b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 -- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 msgr2=0x7fcaa80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 0x7fcaa80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 -- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa80b3cb0 msgr2=0x7fcaa80b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa80b3cb0 0x7fcaa80b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 -- 172.21.15.62:0/1660461876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0094d0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa659c640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 0x7fcaa80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaa759e640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c7a0 tx=0x7fcaa000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000a640 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa000a7a0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa81f5f40 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.536+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000ab10 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.537+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa81f55a0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.538+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8073e70 con 0x7fcaa80cfd60 2023-09-30T13:54:51.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.538+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fcaa000ac70 con 0x7fcaa80cfd60 2023-09-30T13:54:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.538+0000 7fca8f7fe640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 0x7fca9406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.538+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fcaa00889f0 con 0x7fcaa80cfd60 2023-09-30T13:54:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.538+0000 7fcaa6d9d640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 0x7fca9406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.539+0000 7fcaa6d9d640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 0x7fca9406d020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca98009b40 tx=0x7fca98009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:51.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.542+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fcaa0053c20 con 0x7fcaa80cfd60 2023-09-30T13:54:51.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:51.721+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcaa80c4180 con 0x7fcaa80cfd60 2023-09-30T13:54:53.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.429+0000 7fca8f7fe640 1 -- 172.21.15.62:0/1660461876 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fcaa0057240 con 0x7fcaa80cfd60 2023-09-30T13:54:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' created 2023-09-30T13:54:53.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 msgr2=0x7fca9406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 0x7fca9406d020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca98009b40 tx=0x7fca98009190 comp rx=0 tx=0).stop 2023-09-30T13:54:53.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 msgr2=0x7fcaa815d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c7a0 tx=0x7fcaa000cc60 comp rx=0 tx=0).stop 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 shutdown_connections 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fca9406ab60 0x7fca9406d020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.432+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaa80cfd60 0x7fcaa815d640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.433+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa80cd440 0x7fcaa80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.433+0000 7fcaad0a2640 1 --2- 172.21.15.62:0/1660461876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa80b3cb0 0x7fcaa80b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.433+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 >> 172.21.15.62:0/1660461876 conn(0x7fcaa806e380 msgr2=0x7fcaa8156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.433+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 shutdown_connections 2023-09-30T13:54:53.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.433+0000 7fcaad0a2640 1 -- 172.21.15.62:0/1660461876 wait complete. 2023-09-30T13:54:53.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-09-30T13:54:53.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.568+0000 7f5df64c9640 1 Processor -- start 2023-09-30T13:54:53.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.568+0000 7f5df64c9640 1 -- start start 2023-09-30T13:54:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df64c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5df00cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df64c9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00b5a50 con 0x7f5df00cdc30 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df64c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00d3150 con 0x7f5df015c980 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df64c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00d39f0 con 0x7f5df015cd60 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df4a66640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5df00cdc30 0x7f5df00b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53084/0 (socket says 172.21.15.62:53084) 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5df4a66640 1 -- 172.21.15.62:0/3603963188 learned_addr learned my addr 172.21.15.62:0/3603963188 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5df00cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.569+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865885788 0 0) 0x7f5df00b5a50 con 0x7f5df00cdc30 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd8003520 con 0x7f5df00cdc30 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213070951 0 0) 0x7f5dd8003520 con 0x7f5df00cdc30 2023-09-30T13:54:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 msgr2=0x7f5df00cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5df00cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 >> v1:172.21.15.135:6789/0 conn(0x7f5df015c980 legacy=0x7f5df00d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00d3430 con 0x7f5df00cdc30 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f5de80019f0 con 0x7f5df00cdc30 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 >> v1:172.21.15.62:6789/0 conn(0x7f5df00cdc30 legacy=0x7f5df00b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80039a0 0x7f5dd8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd8004350 0x7f5dd8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5dd8005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00d39f0 con 0x7f5dd8004350 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd800ba30 con 0x7f5dd80039a0 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd800bbf0 con 0x7f5df015cd60 2023-09-30T13:54:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd8004350 0x7f5dd8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5deffff640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80039a0 0x7f5dd8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5df4a66640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5dd8005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 -- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 msgr2=0x7f5dd8005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df015cd60 0x7f5dd8005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 -- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80039a0 msgr2=0x7f5dd8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd80039a0 0x7f5dd8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.570+0000 7f5def7fe640 1 -- 172.21.15.62:0/3603963188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8003520 con 0x7f5dd8004350 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.571+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd8004350 0x7f5dd8004820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009ac0 tx=0x7f5dd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bbc995a8717a6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.571+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de002c6b0 con 0x7f5dd8004350 2023-09-30T13:54:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.571+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de002c810 con 0x7f5dd8004350 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.571+0000 7f5deeffd640 1 -- 172.21.15.62:0/3603963188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de002cba0 con 0x7f5dd8004350 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 -- 172.21.15.62:0/3603963188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd8004350 msgr2=0x7f5dd8004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3603963188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dd8004350 0x7f5dd8004820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009ac0 tx=0x7f5dd80057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df4a66640 1 -- 172.21.15.62:0/3603963188 reap_dead start 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 -- 172.21.15.62:0/3603963188 shutdown_connections 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 -- 172.21.15.62:0/3603963188 >> 172.21.15.62:0/3603963188 conn(0x7f5df0071660 msgr2=0x7f5df0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 -- 172.21.15.62:0/3603963188 shutdown_connections 2023-09-30T13:54:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.572+0000 7f5df64c9640 1 -- 172.21.15.62:0/3603963188 wait complete. 2023-09-30T13:54:53.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.573+0000 7f5df64c9640 1 Processor -- start 2023-09-30T13:54:53.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.573+0000 7f5df64c9640 1 -- start start 2023-09-30T13:54:53.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 0x7f5df00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 0x7f5df0153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01517a0 con 0x7f5df0153480 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00ca450 con 0x7f5dd8004350 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00ca730 con 0x7f5df0155b30 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52640/0 (socket says 172.21.15.62:52640) 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 -- 172.21.15.62:0/3346943155 learned_addr learned my addr 172.21.15.62:0/3346943155 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5deffff640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 0x7f5df00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df4a66640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 0x7f5df0153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 -- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 msgr2=0x7f5df0153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 0x7f5df0153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 -- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 msgr2=0x7f5df00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 0x7f5df00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 -- 172.21.15.62:0/3346943155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df01519f0 con 0x7f5df0153480 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5deffff640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 0x7f5df00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df4a66640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 0x7f5df0153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5def7fe640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009ac0 tx=0x7f5de0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0003810 con 0x7f5df0153480 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0003970 con 0x7f5df0153480 2023-09-30T13:54:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df0151cd0 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.574+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0003d00 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.575+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0155fb0 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.576+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0073e70 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.576+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5de0040450 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.576+0000 7f5decff9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 0x7f5ddc06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.577+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f5de00ab3c0 con 0x7f5df0153480 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.577+0000 7f5deffff640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 0x7f5ddc06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:53.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.577+0000 7f5deffff640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 0x7f5ddc06d020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5df01f5590 tx=0x7f5de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:53.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.581+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5de00763d0 con 0x7f5df0153480 2023-09-30T13:54:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:53.756+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f5df015f8d0 con 0x7f5df0153480 2023-09-30T13:54:54.319 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-09-30T13:54:54.319+0000 7f28cf92a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T13:54:54.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.436+0000 7f5decff9640 1 -- 172.21.15.62:0/3346943155 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5de00044e0 con 0x7f5df0153480 2023-09-30T13:54:54.436 INFO:teuthology.orchestra.run.smithi062.stderr:set pool 4 allow_ec_overwrites to true 2023-09-30T13:54:54.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.440+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 msgr2=0x7f5ddc06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:54.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.440+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 0x7f5ddc06d020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5df01f5590 tx=0x7f5de4009040 comp rx=0 tx=0).stop 2023-09-30T13:54:54.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.440+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 msgr2=0x7f5df0151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:54.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.440+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009ac0 tx=0x7f5de0004730 comp rx=0 tx=0).stop 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 shutdown_connections 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5ddc06ab60 0x7f5ddc06d020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5df0155b30 0x7f5df0153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5df0153480 0x7f5df0151010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 --2- 172.21.15.62:0/3346943155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dd8004350 0x7f5df00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.444+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 >> 172.21.15.62:0/3346943155 conn(0x7f5df0071660 msgr2=0x7f5df0155270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:54.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.447+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 shutdown_connections 2023-09-30T13:54:54.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.449+0000 7f5df64c9640 1 -- 172.21.15.62:0/3346943155 wait complete. 2023-09-30T13:54:54.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-09-30T13:54:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.587+0000 7f9a21490640 1 Processor -- start 2023-09-30T13:54:54.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.587+0000 7f9a21490640 1 -- start start 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a1c0cd960 0x7f9a1c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c06b070 0x7f9a1c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0cdd40 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0d0050 con 0x7f9a1c0cd960 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a21490640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c06b500 con 0x7f9a1c06b070 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52648/0 (socket says 172.21.15.62:52648) 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/4127895199 learned_addr learned my addr 172.21.15.62:0/4127895199 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1a7fc640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c06b070 0x7f9a1c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1affd640 1 --2- 172.21.15.62:0/4127895199 >> v2:172.21.15.135:3300/0 conn(0x7f9a1c0cd960 0x7f9a1c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/4127895199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c06b070 msgr2=0x7f9a1c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c06b070 0x7f9a1c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/4127895199 >> v2:172.21.15.135:3300/0 conn(0x7f9a1c0cd960 msgr2=0x7f9a1c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/4127895199 >> v2:172.21.15.135:3300/0 conn(0x7f9a1c0cd960 0x7f9a1c06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.588+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/4127895199 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0cf720 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.589+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c070cf0 tx=0x7f9a0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf277a7ef51b36fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.589+0000 7f9a19ffb640 1 -- 172.21.15.62:0/4127895199 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c02ca70 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.589+0000 7f9a19ffb640 1 -- 172.21.15.62:0/4127895199 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c02cbd0 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.589+0000 7f9a19ffb640 1 -- 172.21.15.62:0/4127895199 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0343f0 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 -- 172.21.15.62:0/4127895199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c0b18a0 msgr2=0x7f9a1c1609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c070cf0 tx=0x7f9a0c02bed0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 -- 172.21.15.62:0/4127895199 shutdown_connections 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c0b18a0 0x7f9a1c1609f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 --2- 172.21.15.62:0/4127895199 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c06b070 0x7f9a1c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 --2- 172.21.15.62:0/4127895199 >> v2:172.21.15.135:3300/0 conn(0x7f9a1c0cd960 0x7f9a1c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 -- 172.21.15.62:0/4127895199 >> 172.21.15.62:0/4127895199 conn(0x7f9a1c0d08e0 msgr2=0x7f9a1c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 -- 172.21.15.62:0/4127895199 shutdown_connections 2023-09-30T13:54:54.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.590+0000 7f9a21490640 1 -- 172.21.15.62:0/4127895199 wait complete. 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.591+0000 7f9a21490640 1 Processor -- start 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.591+0000 7f9a21490640 1 -- start start 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c0b18a0 0x7f9a1c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a1c0cd960 0x7f9a1c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c09af40 con 0x7f9a1c09e290 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c09b130 con 0x7f9a1c0cd960 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a21490640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c09b410 con 0x7f9a1c0b18a0 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52660/0 (socket says 172.21.15.62:52660) 2023-09-30T13:54:54.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/1108246004 learned_addr learned my addr 172.21.15.62:0/1108246004 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1affd640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c0b18a0 0x7f9a1c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1a7fc640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a1c0cd960 0x7f9a1c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c0b18a0 msgr2=0x7f9a1c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c0b18a0 0x7f9a1c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a1c0cd960 msgr2=0x7f9a1c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a1c0cd960 0x7f9a1c0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.592+0000 7f9a1b7fe640 1 -- 172.21.15.62:0/1108246004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c009b30 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a1b7fe640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c036040 tx=0x7f9a0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c009510 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c03e450 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c09b6f0 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c03e7e0 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.593+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c09bcb0 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.594+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c04e0d0 con 0x7f9a1c09e290 2023-09-30T13:54:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.594+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9a0c03e940 con 0x7f9a1c09e290 2023-09-30T13:54:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.595+0000 7f9a137fe640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 0x7f99fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.595+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9a0c0abf20 con 0x7f9a1c09e290 2023-09-30T13:54:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.595+0000 7f9a1affd640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 0x7f99fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.595+0000 7f9a1affd640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 0x7f99fc06cff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009b40 tx=0x7f9a14009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:54.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.599+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9a0c076fe0 con 0x7f9a1c09e290 2023-09-30T13:54:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:54.815+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9a1c066ca0 con 0x7f9a1c09e290 2023-09-30T13:54:55.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.447+0000 7f9a137fe640 1 -- 172.21.15.62:0/1108246004 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9a0c07a600 con 0x7f9a1c09e290 2023-09-30T13:54:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:added data pool 4 to fsmap 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 msgr2=0x7f99fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 0x7f99fc06cff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009b40 tx=0x7f9a14009190 comp rx=0 tx=0).stop 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 msgr2=0x7f9a1c1f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c036040 tx=0x7f9a0c004a40 comp rx=0 tx=0).stop 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 shutdown_connections 2023-09-30T13:54:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f99fc06ab30 0x7f99fc06cff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a1c09e290 0x7f9a1c1f1e40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a1c0cd960 0x7f9a1c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 --2- 172.21.15.62:0/1108246004 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a1c0b18a0 0x7f9a1c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 >> 172.21.15.62:0/1108246004 conn(0x7f9a1c0d08e0 msgr2=0x7f9a1c15f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 shutdown_connections 2023-09-30T13:54:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.449+0000 7f9a21490640 1 -- 172.21.15.62:0/1108246004 wait complete. 2023-09-30T13:54:55.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:54:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.574+0000 7f26db3e9640 1 Processor -- start 2023-09-30T13:54:55.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.574+0000 7f26db3e9640 1 -- start start 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26db3e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d415cbb0 0x7f26d406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26db3e9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26d406b070 0x7f26d406bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26db3e9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d40cb810 con 0x7f26d40d1410 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26db3e9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40cccb0 con 0x7f26d406b070 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26db3e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40caee0 con 0x7f26d415cbb0 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d8984640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26d406b070 0x7f26d406bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d9986640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f26d40d1410 0x7f26d40af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53086/0 (socket says 172.21.15.62:53086) 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d9986640 1 -- 172.21.15.62:0/2437737046 learned_addr learned my addr 172.21.15.62:0/2437737046 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d9185640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d415cbb0 0x7f26d406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d8984640 1 -- 172.21.15.62:0/2437737046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d415cbb0 msgr2=0x7f26d406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d8984640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d415cbb0 0x7f26d406b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d8984640 1 -- 172.21.15.62:0/2437737046 >> v1:172.21.15.62:6789/0 conn(0x7f26d40d1410 legacy=0x7f26d40af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26d8984640 1 -- 172.21.15.62:0/2437737046 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40cb1c0 con 0x7f26d406b070 2023-09-30T13:54:55.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.575+0000 7f26cbfff640 1 -- 172.21.15.62:0/2437737046 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746563088 0 0) 0x7f26d40cb810 con 0x7f26d40d1410 2023-09-30T13:54:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26d8984640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d406b070 0x7f26d406bb20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26c40097a0 tx=0x7f26c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d3e8f2c98e442 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26cbfff640 1 -- 172.21.15.62:0/2437737046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4031830 con 0x7f26d406b070 2023-09-30T13:54:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26cbfff640 1 -- 172.21.15.62:0/2437737046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c4031990 con 0x7f26d406b070 2023-09-30T13:54:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26cbfff640 1 -- 172.21.15.62:0/2437737046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4031d20 con 0x7f26d406b070 2023-09-30T13:54:55.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 -- 172.21.15.62:0/2437737046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d406b070 msgr2=0x7f26d406bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d406b070 0x7f26d406bb20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26c40097a0 tx=0x7f26c402b8d0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 -- 172.21.15.62:0/2437737046 shutdown_connections 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d406b070 0x7f26d406bb20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 --2- 172.21.15.62:0/2437737046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d415cbb0 0x7f26d406b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.576+0000 7f26db3e9640 1 -- 172.21.15.62:0/2437737046 >> 172.21.15.62:0/2437737046 conn(0x7f26d4089fe0 msgr2=0x7f26d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.577+0000 7f26db3e9640 1 -- 172.21.15.62:0/2437737046 shutdown_connections 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.577+0000 7f26db3e9640 1 -- 172.21.15.62:0/2437737046 wait complete. 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 Processor -- start 2023-09-30T13:54:55.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 -- start start 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d406b070 0x7f26d4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d415cbb0 0x7f26d40d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c5950 con 0x7f26d40d1410 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c5bf0 con 0x7f26d415cbb0 2023-09-30T13:54:55.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.578+0000 7f26db3e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c5ed0 con 0x7f26d406b070 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52692/0 (socket says 172.21.15.62:52692) 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 -- 172.21.15.62:0/1723962451 learned_addr learned my addr 172.21.15.62:0/1723962451 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d9986640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d415cbb0 0x7f26d40d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 -- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d406b070 msgr2=0x7f26d4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d406b070 0x7f26d4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 -- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d415cbb0 msgr2=0x7f26d40d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d415cbb0 0x7f26d40d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 -- 172.21.15.62:0/1723962451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c4009400 con 0x7f26d40d1410 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26d8984640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c40098c0 tx=0x7f26c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c403ba70 con 0x7f26d40d1410 2023-09-30T13:54:55.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c403bbf0 con 0x7f26d40d1410 2023-09-30T13:54:55.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40453f0 con 0x7f26d40d1410 2023-09-30T13:54:55.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d406e4a0 con 0x7f26d40d1410 2023-09-30T13:54:55.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.579+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d40c6490 con 0x7f26d40d1410 2023-09-30T13:54:55.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.580+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d40c7560 con 0x7f26d40d1410 2023-09-30T13:54:55.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.581+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f26c404e450 con 0x7f26d40d1410 2023-09-30T13:54:55.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.581+0000 7f26c9ffb640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 0x7f26b806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.581+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26c40ab6c0 con 0x7f26d40d1410 2023-09-30T13:54:55.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.582+0000 7f26d9185640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 0x7f26b806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.582+0000 7f26d9185640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 0x7f26b806cff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f26d0006fd0 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.585+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f26c4076630 con 0x7f26d40d1410 2023-09-30T13:54:55.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.797+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26d40c6680 con 0x7f26d40d1410 2023-09-30T13:54:55.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.797+0000 7f26c9ffb640 1 -- 172.21.15.62:0/1723962451 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f26c4079c50 con 0x7f26d40d1410 2023-09-30T13:54:55.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:55.797 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:54:54.816830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-30T13:54:55.797 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 msgr2=0x7f26b806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 0x7f26b806cff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f26d0006fd0 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 msgr2=0x7f26d40c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c40098c0 tx=0x7f26c40046c0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 shutdown_connections 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f26b806ab30 0x7f26b806cff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d415cbb0 0x7f26d40d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26d40d1410 0x7f26d40c69b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 --2- 172.21.15.62:0/1723962451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26d406b070 0x7f26d4159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 >> 172.21.15.62:0/1723962451 conn(0x7f26d4089fe0 msgr2=0x7f26d415bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 shutdown_connections 2023-09-30T13:54:55.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.799+0000 7f26db3e9640 1 -- 172.21.15.62:0/1723962451 wait complete. 2023-09-30T13:54:55.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:55.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.915+0000 7f0bc2aa9640 1 Processor -- start 2023-09-30T13:54:55.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.915+0000 7f0bc2aa9640 1 -- start start 2023-09-30T13:54:55.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bc2aa9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0bbc0cf4e0 0x7f0bbc165710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bc2aa9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc06e3b0 con 0x7f0bbc0ce640 2023-09-30T13:54:55.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bc2aa9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0cbd00 con 0x7f0bbc15acc0 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bc2aa9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cbfe0 con 0x7f0bbc0cf4e0 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bbbfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0bbc0ce640 0x7f0bbc0cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53094/0 (socket says 172.21.15.62:53094) 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bbbfff640 1 -- 172.21.15.62:0/4119037454 learned_addr learned my addr 172.21.15.62:0/4119037454 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bc1046640 1 --2- 172.21.15.62:0/4119037454 >> v2:172.21.15.135:3300/0 conn(0x7f0bbc0cf4e0 0x7f0bbc165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.916+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807443350 0 0) 0x7f0bbc06e3b0 con 0x7f0bbc0ce640 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba8003520 con 0x7f0bbc0ce640 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182982570 0 0) 0x7f0ba8003520 con 0x7f0bbc0ce640 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 >> v2:172.21.15.135:3300/0 conn(0x7f0bbc0cf4e0 msgr2=0x7f0bbc165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 --2- 172.21.15.62:0/4119037454 >> v2:172.21.15.135:3300/0 conn(0x7f0bbc0cf4e0 0x7f0bbc165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 >> v1:172.21.15.135:6789/0 conn(0x7f0bbc15acc0 legacy=0x7f0bbc0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0cc2c0 con 0x7f0bbc0ce640 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f0bac001670 con 0x7f0bbc0ce640 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 >> v1:172.21.15.62:6789/0 conn(0x7f0bbc0ce640 legacy=0x7f0bbc0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 0x7f0ba8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba80047c0 0x7f0ba8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8005180 0x7f0ba800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cbfe0 con 0x7f0ba8003970 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800c020 con 0x7f0ba8005180 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800c1e0 con 0x7f0ba80047c0 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 0x7f0ba8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc1046640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8005180 0x7f0ba800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bbbfff640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba80047c0 0x7f0ba8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 -- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba80047c0 msgr2=0x7f0ba8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ba80047c0 0x7f0ba8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 -- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8005180 msgr2=0x7f0ba800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8005180 0x7f0ba800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc0845640 1 -- 172.21.15.62:0/4119037454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8003520 con 0x7f0ba8003970 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc1046640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8005180 0x7f0ba800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.917+0000 7f0bc1046640 1 -- 172.21.15.62:0/4119037454 reap_dead start 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.918+0000 7f0bc0845640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 0x7f0ba8003d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4001e50 tx=0x7f0ba80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3640787c2c4b4470 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.918+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4003b70 con 0x7f0ba8003970 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.918+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4003cd0 con 0x7f0ba8003970 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.918+0000 7f0bbb7fe640 1 -- 172.21.15.62:0/4119037454 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4005310 con 0x7f0ba8003970 2023-09-30T13:54:55.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 msgr2=0x7f0ba8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 0x7f0ba8003d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4001e50 tx=0x7f0ba80057f0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/4119037454 shutdown_connections 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/4119037454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ba8003970 0x7f0ba8003d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/4119037454 >> 172.21.15.62:0/4119037454 conn(0x7f0bbc089fe0 msgr2=0x7f0bbc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/4119037454 shutdown_connections 2023-09-30T13:54:55.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.919+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/4119037454 wait complete. 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.920+0000 7f0bc2aa9640 1 Processor -- start 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.920+0000 7f0bc2aa9640 1 -- start start 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8003970 0x7f0bbc0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bbc14f830 0x7f0bbc0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cabb0 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0c4620 con 0x7f0ba8003970 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc2aa9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc06ca10 con 0x7f0bbc14f830 2023-09-30T13:54:55.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52716/0 (socket says 172.21.15.62:52716) 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 -- 172.21.15.62:0/1064755670 learned_addr learned my addr 172.21.15.62:0/1064755670 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc0845640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8003970 0x7f0bbc0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bc1046640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bbc14f830 0x7f0bbc0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 -- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bbc14f830 msgr2=0x7f0bbc0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bbc14f830 0x7f0bbc0c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 -- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8003970 msgr2=0x7f0bbc0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8003970 0x7f0bbc0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 -- 172.21.15.62:0/1064755670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0b45e0 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.921+0000 7f0bbbfff640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bac001200 tx=0x7f0bac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.922+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00c870 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.922+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac00c9d0 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.922+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00cd80 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.922+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc06cc70 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.922+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc0b4b80 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.923+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc04e0d0 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.923+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0bac01d460 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.924+0000 7f0bb97fa640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 0x7f0b9c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.924+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0bac089350 con 0x7f0bbc06b5e0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.924+0000 7f0bc0845640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 0x7f0b9c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:55.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.924+0000 7f0bc0845640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 0x7f0b9c06cff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4034000 tx=0x7f0bb403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:55.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:55.928+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0bac054360 con 0x7f0bbc06b5e0 2023-09-30T13:54:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.106+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bbc0b4d40 con 0x7f0bbc06b5e0 2023-09-30T13:54:56.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.107+0000 7f0bb97fa640 1 -- 172.21.15.62:0/1064755670 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f0bac057980 con 0x7f0bbc06b5e0 2023-09-30T13:54:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:56.107 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 msgr2=0x7f0b9c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 0x7f0b9c06cff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4034000 tx=0x7f0bb403b040 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 msgr2=0x7f0bbc06c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0bac001200 tx=0x7f0bac00ec60 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 shutdown_connections 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b9c06ab30 0x7f0b9c06cff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0bbc14f830 0x7f0bbc0c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bbc06b5e0 0x7f0bbc06c4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 --2- 172.21.15.62:0/1064755670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba8003970 0x7f0bbc0c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 >> 172.21.15.62:0/1064755670 conn(0x7f0bbc089fe0 msgr2=0x7f0bbc0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 shutdown_connections 2023-09-30T13:54:56.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.109+0000 7f0bc2aa9640 1 -- 172.21.15.62:0/1064755670 wait complete. 2023-09-30T13:54:56.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.226+0000 7f45a2ea2640 1 Processor -- start 2023-09-30T13:54:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.226+0000 7f45a2ea2640 1 -- start start 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a2ea2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f459c0ce580 0x7f459c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a2ea2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0ce0f0 con 0x7f459c160fa0 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a2ea2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0cd7c0 con 0x7f459c0d0eb0 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a2ea2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0cdaa0 con 0x7f459c0ce580 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f459bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f459c0ce580 0x7f459c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a143f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f459c160fa0 0x7f459c06af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53098/0 (socket says 172.21.15.62:53098) 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f45a143f640 1 -- 172.21.15.62:0/1352800910 learned_addr learned my addr 172.21.15.62:0/1352800910 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f459bfff640 1 -- 172.21.15.62:0/1352800910 >> v1:172.21.15.135:6789/0 conn(0x7f459c0d0eb0 legacy=0x7f459c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f459bfff640 1 -- 172.21.15.62:0/1352800910 >> v1:172.21.15.62:6789/0 conn(0x7f459c160fa0 legacy=0x7f459c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.227+0000 7f459bfff640 1 -- 172.21.15.62:0/1352800910 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0cdd80 con 0x7f459c0ce580 2023-09-30T13:54:56.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f459bfff640 1 --2- 172.21.15.62:0/1352800910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c0ce580 0x7f459c160a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45880097a0 tx=0x7f458802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f06e783e0a00c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f459b7fe640 1 -- 172.21.15.62:0/1352800910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588030610 con 0x7f459c0ce580 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f459b7fe640 1 -- 172.21.15.62:0/1352800910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588030770 con 0x7f459c0ce580 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f459b7fe640 1 -- 172.21.15.62:0/1352800910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588030b00 con 0x7f459c0ce580 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f45a2ea2640 1 -- 172.21.15.62:0/1352800910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c0ce580 msgr2=0x7f459c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/1352800910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c0ce580 0x7f459c160a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45880097a0 tx=0x7f458802b960 comp rx=0 tx=0).stop 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.228+0000 7f45a2ea2640 1 -- 172.21.15.62:0/1352800910 shutdown_connections 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.229+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/1352800910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c0ce580 0x7f459c160a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.229+0000 7f45a2ea2640 1 -- 172.21.15.62:0/1352800910 >> 172.21.15.62:0/1352800910 conn(0x7f459c089fe0 msgr2=0x7f459c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.229+0000 7f45a2ea2640 1 -- 172.21.15.62:0/1352800910 shutdown_connections 2023-09-30T13:54:56.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.229+0000 7f45a2ea2640 1 -- 172.21.15.62:0/1352800910 wait complete. 2023-09-30T13:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.230+0000 7f45a2ea2640 1 Processor -- start 2023-09-30T13:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.230+0000 7f45a2ea2640 1 -- start start 2023-09-30T13:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 0x7f459c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 0x7f459c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0cc110 con 0x7f459c160fa0 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c158390 con 0x7f459c0d0eb0 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0cb4d0 con 0x7f459c0ce580 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52728/0 (socket says 172.21.15.62:52728) 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 -- 172.21.15.62:0/4054040339 learned_addr learned my addr 172.21.15.62:0/4054040339 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f459bfff640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 0x7f459c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a0c3e640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 0x7f459c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 -- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 msgr2=0x7f459c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 0x7f459c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 -- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 msgr2=0x7f459c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 0x7f459c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 -- 172.21.15.62:0/4054040339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009400 con 0x7f459c160fa0 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f459bfff640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 0x7f459c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a0c3e640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 0x7f459c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a143f640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f459400ca80 tx=0x7f459400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400ac30 con 0x7f459c160fa0 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400ad90 con 0x7f459c160fa0 2023-09-30T13:54:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594012600 con 0x7f459c160fa0 2023-09-30T13:54:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c0cb770 con 0x7f459c160fa0 2023-09-30T13:54:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.231+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c0cbd30 con 0x7f459c160fa0 2023-09-30T13:54:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.232+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c0cc250 con 0x7f459c160fa0 2023-09-30T13:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.233+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4594007070 con 0x7f459c160fa0 2023-09-30T13:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.233+0000 7f45997fa640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 0x7f458006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.234+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4594089240 con 0x7f459c160fa0 2023-09-30T13:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.234+0000 7f45a0c3e640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 0x7f458006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.234+0000 7f45a0c3e640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 0x7f458006d020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.238+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f459c0cc250 con 0x7f459c160fa0 2023-09-30T13:54:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.413+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f459c0cc250 con 0x7f459c160fa0 2023-09-30T13:54:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.414+0000 7f45997fa640 1 -- 172.21.15.62:0/4054040339 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f459c0cc250 con 0x7f459c160fa0 2023-09-30T13:54:56.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:56.414 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 msgr2=0x7f458006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 0x7f458006d020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 msgr2=0x7f459c1595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f459400ca80 tx=0x7f459400cf40 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 shutdown_connections 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f458006ab60 0x7f458006d020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f459c160fa0 0x7f459c1595c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0d0eb0 0x7f459c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 --2- 172.21.15.62:0/4054040339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f459c0ce580 0x7f459c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 >> 172.21.15.62:0/4054040339 conn(0x7f459c089fe0 msgr2=0x7f459c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 shutdown_connections 2023-09-30T13:54:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.416+0000 7f45a2ea2640 1 -- 172.21.15.62:0/4054040339 wait complete. 2023-09-30T13:54:56.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:54:56.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.547+0000 7fb98ab1d640 1 Processor -- start 2023-09-30T13:54:56.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.547+0000 7fb98ab1d640 1 -- start start 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb98ab1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb98415cbb0 0x7fb98406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb98ab1d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb98406b070 0x7fb98406bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb98ab1d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9840cb810 con 0x7fb9840d1410 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb98ab1d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9840cccb0 con 0x7fb98415cbb0 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb98ab1d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9840caee0 con 0x7fb98406b070 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb98415cbb0 0x7fb98406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb98415cbb0 0x7fb98406b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52734/0 (socket says 172.21.15.62:52734) 2023-09-30T13:54:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 -- 172.21.15.62:0/2046384314 learned_addr learned my addr 172.21.15.62:0/2046384314 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb983fff640 1 --2- 172.21.15.62:0/2046384314 >> v2:172.21.15.135:3300/0 conn(0x7fb98406b070 0x7fb98406bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 -- 172.21.15.62:0/2046384314 >> v2:172.21.15.135:3300/0 conn(0x7fb98406b070 msgr2=0x7fb98406bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 --2- 172.21.15.62:0/2046384314 >> v2:172.21.15.135:3300/0 conn(0x7fb98406b070 0x7fb98406bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 -- 172.21.15.62:0/2046384314 >> v1:172.21.15.135:6789/0 conn(0x7fb9840d1410 legacy=0x7fb9840af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.548+0000 7fb9888b9640 1 -- 172.21.15.62:0/2046384314 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840cb1c0 con 0x7fb98415cbb0 2023-09-30T13:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb9888b9640 1 --2- 172.21.15.62:0/2046384314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98415cbb0 0x7fb98406b5e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9840b68a0 tx=0x7fb97802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d607735daf9439 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb9837fe640 1 -- 172.21.15.62:0/2046384314 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978030860 con 0x7fb98415cbb0 2023-09-30T13:54:56.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb9837fe640 1 -- 172.21.15.62:0/2046384314 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9780309c0 con 0x7fb98415cbb0 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb9837fe640 1 -- 172.21.15.62:0/2046384314 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978030d50 con 0x7fb98415cbb0 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb98ab1d640 1 -- 172.21.15.62:0/2046384314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98415cbb0 msgr2=0x7fb98406b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.549+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/2046384314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98415cbb0 0x7fb98406b5e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9840b68a0 tx=0x7fb97802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 -- 172.21.15.62:0/2046384314 shutdown_connections 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/2046384314 >> v2:172.21.15.135:3300/0 conn(0x7fb98406b070 0x7fb98406bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/2046384314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98415cbb0 0x7fb98406b5e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 -- 172.21.15.62:0/2046384314 >> 172.21.15.62:0/2046384314 conn(0x7fb984089fe0 msgr2=0x7fb9840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 -- 172.21.15.62:0/2046384314 shutdown_connections 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.550+0000 7fb98ab1d640 1 -- 172.21.15.62:0/2046384314 wait complete. 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.551+0000 7fb98ab1d640 1 Processor -- start 2023-09-30T13:54:56.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.551+0000 7fb98ab1d640 1 -- start start 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9840d1410 0x7fb9841585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 0x7fb9840b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98415e8c0 con 0x7fb98406b070 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98415f720 con 0x7fb9840d1410 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9840ca2a0 con 0x7fb98415cbb0 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52748/0 (socket says 172.21.15.62:52748) 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 -- 172.21.15.62:0/3490938238 learned_addr learned my addr 172.21.15.62:0/3490938238 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:56.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb983fff640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9840d1410 0x7fb9841585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9890ba640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 0x7fb9840b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 -- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 msgr2=0x7fb9840b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 0x7fb9840b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 -- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9840d1410 msgr2=0x7fb9841585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9840d1410 0x7fb9841585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 -- 172.21.15.62:0/3490938238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780094d0 con 0x7fb98406b070 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9890ba640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 0x7fb9840b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9888b9640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb978000c00 tx=0x7fb978004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978039b60 con 0x7fb98406b070 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978039ce0 con 0x7fb98406b070 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.552+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98406e4a0 con 0x7fb98406b070 2023-09-30T13:54:56.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.553+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978043650 con 0x7fb98406b070 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.553+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98415eaa0 con 0x7fb98406b070 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.554+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98415f860 con 0x7fb98406b070 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.554+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb97804c3b0 con 0x7fb98406b070 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.554+0000 7fb9817fa640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 0x7fb96806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.554+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9780abab0 con 0x7fb98406b070 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.555+0000 7fb983fff640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 0x7fb96806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.555+0000 7fb983fff640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 0x7fb96806cff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb98415ae70 tx=0x7fb970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.559+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb978076aa0 con 0x7fb98406b070 2023-09-30T13:54:56.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.769+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb98406e2a0 con 0x7fb98406b070 2023-09-30T13:54:56.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.769+0000 7fb9817fa640 1 -- 172.21.15.62:0/3490938238 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fb978034090 con 0x7fb98406b070 2023-09-30T13:54:56.769 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:56.769 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:54:54.816830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-30T13:54:56.770 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-09-30T13:54:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 msgr2=0x7fb96806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 0x7fb96806cff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb98415ae70 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-09-30T13:54:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 msgr2=0x7fb9840c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb978000c00 tx=0x7fb978004730 comp rx=0 tx=0).stop 2023-09-30T13:54:56.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 shutdown_connections 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb96806ab30 0x7fb96806cff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb98415cbb0 0x7fb9840b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9840d1410 0x7fb9841585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 --2- 172.21.15.62:0/3490938238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb98406b070 0x7fb9840c9d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 >> 172.21.15.62:0/3490938238 conn(0x7fb984089fe0 msgr2=0x7fb98406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 shutdown_connections 2023-09-30T13:54:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.771+0000 7fb98ab1d640 1 -- 172.21.15.62:0/3490938238 wait complete. 2023-09-30T13:54:56.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:54:56.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.888+0000 7f4aaf1cc640 1 Processor -- start 2023-09-30T13:54:56.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aaf1cc640 1 -- start start 2023-09-30T13:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aaf1cc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4aa815c9e0 0x7f4aa80d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aaf1cc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80d0aa0 con 0x7f4aa815cdc0 2023-09-30T13:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aaf1cc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80d0d80 con 0x7f4aa80cf2e0 2023-09-30T13:54:56.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aaf1cc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80d1060 con 0x7f4aa815c9e0 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aacf68640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4aa815c9e0 0x7f4aa80d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aa7fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4aa815cdc0 0x7f4aa80ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53100/0 (socket says 172.21.15.62:53100) 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.889+0000 7f4aa7fff640 1 -- 172.21.15.62:0/1167096768 learned_addr learned my addr 172.21.15.62:0/1167096768 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.890+0000 7f4aacf68640 1 -- 172.21.15.62:0/1167096768 >> v1:172.21.15.135:6789/0 conn(0x7f4aa80cf2e0 legacy=0x7f4aa80b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.890+0000 7f4aacf68640 1 -- 172.21.15.62:0/1167096768 >> v1:172.21.15.62:6789/0 conn(0x7f4aa815cdc0 legacy=0x7f4aa80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.890+0000 7f4aacf68640 1 -- 172.21.15.62:0/1167096768 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80d1340 con 0x7f4aa815c9e0 2023-09-30T13:54:56.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.890+0000 7f4aacf68640 1 --2- 172.21.15.62:0/1167096768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815c9e0 0x7f4aa80d04c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009790 tx=0x7f4a9c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba59509b9213abc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aa77fe640 1 -- 172.21.15.62:0/1167096768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c031780 con 0x7f4aa815c9e0 2023-09-30T13:54:56.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aa77fe640 1 -- 172.21.15.62:0/1167096768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0318e0 con 0x7f4aa815c9e0 2023-09-30T13:54:56.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aa77fe640 1 -- 172.21.15.62:0/1167096768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c031c70 con 0x7f4aa815c9e0 2023-09-30T13:54:56.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/1167096768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815c9e0 msgr2=0x7f4aa80d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/1167096768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815c9e0 0x7f4aa80d04c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009790 tx=0x7f4a9c02b820 comp rx=0 tx=0).stop 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/1167096768 shutdown_connections 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/1167096768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815c9e0 0x7f4aa80d04c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/1167096768 >> 172.21.15.62:0/1167096768 conn(0x7f4aa8089fe0 msgr2=0x7f4aa80d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/1167096768 shutdown_connections 2023-09-30T13:54:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.891+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/1167096768 wait complete. 2023-09-30T13:54:56.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.892+0000 7f4aaf1cc640 1 Processor -- start 2023-09-30T13:54:56.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.892+0000 7f4aaf1cc640 1 -- start start 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 0x7f4aa8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 0x7f4aa81e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81e69d0 con 0x7f4aa815cdc0 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81e5d50 con 0x7f4aa815c9e0 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aaf1cc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81e6030 con 0x7f4aa80cf2e0 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aad769640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aad769640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52756/0 (socket says 172.21.15.62:52756) 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.893+0000 7f4aad769640 1 -- 172.21.15.62:0/3997258909 learned_addr learned my addr 172.21.15.62:0/3997258909 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aa7fff640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 0x7f4aa81e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aacf68640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 0x7f4aa8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 -- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 msgr2=0x7f4aa8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 0x7f4aa8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 -- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 msgr2=0x7f4aa81e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 0x7f4aa81e5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 -- 172.21.15.62:0/3997258909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0093a0 con 0x7f4aa815cdc0 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aa7fff640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 0x7f4aa81e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aacf68640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 0x7f4aa8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aad769640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000b970 tx=0x7f4aa000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000cb40 con 0x7f4aa815cdc0 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000cca0 con 0x7f4aa815cdc0 2023-09-30T13:54:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa81e6310 con 0x7f4aa815cdc0 2023-09-30T13:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0014680 con 0x7f4aa815cdc0 2023-09-30T13:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.894+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa814b050 con 0x7f4aa815cdc0 2023-09-30T13:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.895+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa81e6b10 con 0x7f4aa815cdc0 2023-09-30T13:54:56.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.895+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4aa001d3b0 con 0x7f4aa815cdc0 2023-09-30T13:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.896+0000 7f4aa57fa640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 0x7f4a8c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.896+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4aa0089300 con 0x7f4aa815cdc0 2023-09-30T13:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.896+0000 7f4aacf68640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 0x7f4a8c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:56.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.896+0000 7f4aacf68640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 0x7f4a8c06cff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c036000 tx=0x7f4a9c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:56.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:56.900+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4aa81e6b10 con 0x7f4aa815cdc0 2023-09-30T13:54:57.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.075+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aa81e6b10 con 0x7f4aa815cdc0 2023-09-30T13:54:57.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.077+0000 7f4aa57fa640 1 -- 172.21.15.62:0/3997258909 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f4aa81e6b10 con 0x7f4aa815cdc0 2023-09-30T13:54:57.076 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:57.077 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:54:57.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 msgr2=0x7f4a8c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 0x7f4a8c06cff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c036000 tx=0x7f4a9c03d040 comp rx=0 tx=0).stop 2023-09-30T13:54:57.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 msgr2=0x7f4aa81e6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000b970 tx=0x7f4aa000be30 comp rx=0 tx=0).stop 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 shutdown_connections 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a8c06ab30 0x7f4a8c06cff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4aa815cdc0 0x7f4aa81e6f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aa815c9e0 0x7f4aa81e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 --2- 172.21.15.62:0/3997258909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4aa80cf2e0 0x7f4aa8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.078+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 >> 172.21.15.62:0/3997258909 conn(0x7f4aa8089fe0 msgr2=0x7f4aa80c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.079+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 shutdown_connections 2023-09-30T13:54:57.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.079+0000 7f4aaf1cc640 1 -- 172.21.15.62:0/3997258909 wait complete. 2023-09-30T13:54:57.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T13:54:49.768336+0000', 'modified': '2023-09-30T13:54:54.816830+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/2869657877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2869657877}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 2869657877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-09-30T13:54:57.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T13:54:57.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T13:54:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.601+0000 7f261b621640 1 Processor -- start 2023-09-30T13:54:57.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 -- start start 2023-09-30T13:54:57.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26140b5790 0x7f26140cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26140b5bf0 0x7f26140ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26140cda60 con 0x7f2614160160 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140d18a0 con 0x7f26140b5790 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f261b621640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614160540 con 0x7f26140b5bf0 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f2618bbc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26140b5790 0x7f26140cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f26193bd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2614160160 0x7f26140d30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47096/0 (socket says 172.21.15.62:47096) 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.602+0000 7f26193bd640 1 -- 172.21.15.62:0/735849004 learned_addr learned my addr 172.21.15.62:0/735849004 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2619bbe640 1 --2- 172.21.15.62:0/735849004 >> v2:172.21.15.135:3300/0 conn(0x7f26140b5bf0 0x7f26140ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2618bbc640 1 -- 172.21.15.62:0/735849004 >> v2:172.21.15.135:3300/0 conn(0x7f26140b5bf0 msgr2=0x7f26140ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2618bbc640 1 --2- 172.21.15.62:0/735849004 >> v2:172.21.15.135:3300/0 conn(0x7f26140b5bf0 0x7f26140ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2618bbc640 1 -- 172.21.15.62:0/735849004 >> v1:172.21.15.62:6789/0 conn(0x7f2614160160 legacy=0x7f26140d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2618bbc640 1 -- 172.21.15.62:0/735849004 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140cd450 con 0x7f26140b5790 2023-09-30T13:54:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f260bfff640 1 -- 172.21.15.62:0/735849004 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214998889 0 0) 0x7f26140cda60 con 0x7f2614160160 2023-09-30T13:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.603+0000 7f2618bbc640 1 --2- 172.21.15.62:0/735849004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f26140cdef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f261408c2d0 tx=0x7f260402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a6ccbcb0fd4624 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f260bfff640 1 -- 172.21.15.62:0/735849004 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604031830 con 0x7f26140b5790 2023-09-30T13:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f260bfff640 1 -- 172.21.15.62:0/735849004 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604031990 con 0x7f26140b5790 2023-09-30T13:54:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f260bfff640 1 -- 172.21.15.62:0/735849004 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604031d20 con 0x7f26140b5790 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 -- 172.21.15.62:0/735849004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 msgr2=0x7f26140cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 --2- 172.21.15.62:0/735849004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f26140cdef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f261408c2d0 tx=0x7f260402b8d0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 -- 172.21.15.62:0/735849004 shutdown_connections 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 --2- 172.21.15.62:0/735849004 >> v2:172.21.15.135:3300/0 conn(0x7f26140b5bf0 0x7f26140ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 --2- 172.21.15.62:0/735849004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f26140cdef0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 -- 172.21.15.62:0/735849004 >> 172.21.15.62:0/735849004 conn(0x7f2614089fe0 msgr2=0x7f26140d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 -- 172.21.15.62:0/735849004 shutdown_connections 2023-09-30T13:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.604+0000 7f261b621640 1 -- 172.21.15.62:0/735849004 wait complete. 2023-09-30T13:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.605+0000 7f261b621640 1 Processor -- start 2023-09-30T13:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.605+0000 7f261b621640 1 -- start start 2023-09-30T13:54:57.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26140b5bf0 0x7f261415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2614160160 0x7f261406c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614158e50 con 0x7f26140b5790 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141594f0 con 0x7f26140b5bf0 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f261b621640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2614158b70 con 0x7f2614160160 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40820/0 (socket says 172.21.15.62:40820) 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 -- 172.21.15.62:0/473911771 learned_addr learned my addr 172.21.15.62:0/473911771 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 -- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2614160160 msgr2=0x7f261406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2614160160 0x7f261406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 -- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26140b5bf0 msgr2=0x7f261415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26140b5bf0 0x7f261415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.606+0000 7f26193bd640 1 -- 172.21.15.62:0/473911771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009400 con 0x7f26140b5790 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f26193bd640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f261000c430 tx=0x7f261000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f2609ffb640 1 -- 172.21.15.62:0/473911771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100074e0 con 0x7f26140b5790 2023-09-30T13:54:57.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f2609ffb640 1 -- 172.21.15.62:0/473911771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610007660 con 0x7f26140b5790 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f2609ffb640 1 -- 172.21.15.62:0/473911771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610004a20 con 0x7f26140b5790 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261415cb40 con 0x7f26140b5790 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.607+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261415d100 con 0x7f26140b5790 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.608+0000 7f2609ffb640 1 -- 172.21.15.62:0/473911771 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2610004b80 con 0x7f26140b5790 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.609+0000 7f2609ffb640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 0x7f25f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.609+0000 7f2609ffb640 1 -- 172.21.15.62:0/473911771 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2610089340 con 0x7f26140b5790 2023-09-30T13:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.609+0000 7f2618bbc640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 0x7f25f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.610+0000 7f2618bbc640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 0x7f25f806cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2604036000 tx=0x7f2604030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.610+0000 7f261e1bb740 1 Processor -- start 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.610+0000 7f261e1bb740 1 -- start start 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028295f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556028266620 0x5560282964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560281d8770 con 0x5560282931e0 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560281d5e60 con 0x5560282935c0 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560281d1750 con 0x556028266620 2023-09-30T13:54:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40832/0 (socket says 172.21.15.62:40832) 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 -- 172.21.15.62:0/3922691603 learned_addr learned my addr 172.21.15.62:0/3922691603 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f2618bbc640 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028295f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f2619bbe640 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556028266620 0x5560282964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 -- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556028266620 msgr2=0x5560282964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556028266620 0x5560282964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 -- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 msgr2=0x556028295f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028295f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 -- 172.21.15.62:0/3922691603 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560281cfdd0 con 0x5560282931e0 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f26193bd640 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2610001120 tx=0x7f261000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463d17ae10c830f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f25f6ffd640 1 -- 172.21.15.62:0/3922691603 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261005c0b0 con 0x5560282931e0 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f25f6ffd640 1 -- 172.21.15.62:0/3922691603 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610060260 con 0x5560282931e0 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.611+0000 7f25f6ffd640 1 -- 172.21.15.62:0/3922691603 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610056300 con 0x5560282931e0 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- 172.21.15.62:0/3922691603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 msgr2=0x5560282660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2610001120 tx=0x7f261000f000 comp rx=0 tx=0).stop 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- 172.21.15.62:0/3922691603 shutdown_connections 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556028266620 0x5560282964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028295f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3922691603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282660e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- 172.21.15.62:0/3922691603 >> 172.21.15.62:0/3922691603 conn(0x5560282683f0 msgr2=0x5560282b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- 172.21.15.62:0/3922691603 shutdown_connections 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- 172.21.15.62:0/3922691603 wait complete. 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.612+0000 7f261e1bb740 1 -- start start 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 Processor -- start 2023-09-30T13:54:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282931e0 0x556028281400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x556028298a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55602816f820 con 0x5560282abbd0 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55602816f4c0 con 0x5560282931e0 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.613+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x556028152240 con 0x5560282935c0 2023-09-30T13:54:57.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f261e1bb740 10 client.0 _ll_register_callbacks cb 0x5560281919d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40840/0 (socket says 172.21.15.62:40840) 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 -- 172.21.15.62:0/3150103420 learned_addr learned my addr 172.21.15.62:0/3150103420 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f26193bd640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282931e0 0x556028281400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2618bbc640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x556028298a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 -- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 msgr2=0x556028298a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x556028298a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 -- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282931e0 msgr2=0x556028281400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282931e0 0x556028281400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 -- 172.21.15.62:0/3150103420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261415d100 con 0x5560282abbd0 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f2619bbe640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f260c0078f0 tx=0x7f260c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f02b7313a9116e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f25effff640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00fb40 con 0x5560282abbd0 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f260c00fca0 con 0x5560282abbd0 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560281f71b0 con 0x5560282abbd0 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260c00fe60 con 0x5560282abbd0 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f261e1bb740 10 client.4416 fetch_fsmap learned FSMap version 7 2023-09-30T13:54:57.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5560281ac470 con 0x5560282abbd0 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.614+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5560281f71b0 con 0x5560282abbd0 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f260c01e350 con 0x5560282abbd0 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 10 client.4416 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 20 client.4416 populate_metadata read hostname 'smithi062' 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x5560282caaa0 0x5560282ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 4 client.4416 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 --> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560281a4e60 con 0x5560282caaa0 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f26193bd640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x5560282caaa0 0x5560282ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f26193bd640 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x5560282caaa0 0x5560282ce830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3678198f33d065f server_cookie=684c78cf47ee8c10 in_seq=0 out_seq=0 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.615+0000 7f25effff640 10 client.4416 ms_handle_connect on v2:172.21.15.135:6834/2869657877 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f25effff640 1 -- 172.21.15.62:0/3150103420 <== mds.0 v2:172.21.15.135:6834/2869657877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5560281a4e60 con 0x5560282caaa0 2023-09-30T13:54:57.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f25effff640 10 client.4416 handle_command_reply: tid=0 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 client.4416 shutdown 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 msgr2=0x556028287130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f260c0078f0 tx=0x7f260c007db0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 shutdown_connections 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x5560282caaa0 0x5560282ce830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282abbd0 0x556028287130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x556028298a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f25effff640 0 client.4416 ms_handle_reset on v2:172.21.15.135:6834/2869657877 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 --2- 172.21.15.62:0/3150103420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282931e0 0x556028281400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 >> 172.21.15.62:0/3150103420 conn(0x556028266620 msgr2=0x5560282b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 shutdown_connections 2023-09-30T13:54:57.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 1 -- 172.21.15.62:0/3150103420 wait complete. 2023-09-30T13:54:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.616+0000 7f261e1bb740 20 client.4416 trim_cache size 0 max 16384 2023-09-30T13:54:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 Processor -- start 2023-09-30T13:54:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 -- start start 2023-09-30T13:54:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028298440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282abbd0 0x556028298980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560282a8850 con 0x5560282931e0 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560282b1300 con 0x5560282935c0 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.632+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560282ab960 con 0x5560282abbd0 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40844/0 (socket says 172.21.15.62:40844) 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 -- 172.21.15.62:0/1225121690 learned_addr learned my addr 172.21.15.62:0/1225121690 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 -- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282abbd0 msgr2=0x556028298980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282abbd0 0x556028298980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 -- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 msgr2=0x556028298440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028298440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 -- 172.21.15.62:0/1225121690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556028200500 con 0x5560282931e0 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f26193bd640 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f261000cdf0 tx=0x7f2610057bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6191c9ee4e7ad51f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f25f77fe640 1 -- 172.21.15.62:0/1225121690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610087040 con 0x5560282931e0 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f25f77fe640 1 -- 172.21.15.62:0/1225121690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100542a0 con 0x5560282931e0 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f25f77fe640 1 -- 172.21.15.62:0/1225121690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261005c0b0 con 0x5560282931e0 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 -- 172.21.15.62:0/1225121690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 msgr2=0x5560282b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f261000cdf0 tx=0x7f2610057bd0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 -- 172.21.15.62:0/1225121690 shutdown_connections 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282abbd0 0x556028298980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282935c0 0x556028298440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 --2- 172.21.15.62:0/1225121690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x5560282b44e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.633+0000 7f261e1bb740 1 -- 172.21.15.62:0/1225121690 >> 172.21.15.62:0/1225121690 conn(0x556028266620 msgr2=0x5560282ab250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.634+0000 7f261e1bb740 1 -- 172.21.15.62:0/1225121690 shutdown_connections 2023-09-30T13:54:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.634+0000 7f261e1bb740 1 -- 172.21.15.62:0/1225121690 wait complete. 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.634+0000 7f261e1bb740 1 -- start start 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.634+0000 7f261e1bb740 1 Processor -- start 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x5560282980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 0x556028298630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55602826b2c0 con 0x5560282931e0 2023-09-30T13:54:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560282c8380 con 0x5560282abbd0 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560282c5f40 con 0x5560282935c0 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f261e1bb740 10 client.0 _ll_register_callbacks cb 0x7f260c0097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40858/0 (socket says 172.21.15.62:40858) 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 -- 172.21.15.62:0/2075529611 learned_addr learned my addr 172.21.15.62:0/2075529611 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f2618bbc640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x5560282980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f2619bbe640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 0x556028298630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 -- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 msgr2=0x5560282980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x5560282980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 -- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 msgr2=0x556028298630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 0x556028298630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f26193bd640 1 -- 172.21.15.62:0/2075529611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560281cfdd0 con 0x5560282931e0 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f2619bbe640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 0x556028298630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.635+0000 7f2618bbc640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x5560282980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f26193bd640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26100875d0 tx=0x7f2610000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edcaea9192bfd47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610087280 con 0x5560282931e0 2023-09-30T13:54:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2610086040 con 0x5560282931e0 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2610060260 con 0x5560282931e0 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2610056300 con 0x5560282931e0 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 10 client.4422 fetch_fsmap learned FSMap version 7 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55602816ecd0 con 0x5560282931e0 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610060260 con 0x5560282931e0 2023-09-30T13:54:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f261001b060 con 0x5560282931e0 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 20 client.4422 populate_metadata read hostname 'smithi062' 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55602826b6e0 0x55602826bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 4 client.4422 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 --> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5560281ca730 con 0x55602826b6e0 2023-09-30T13:54:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.636+0000 7f2618bbc640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55602826b6e0 0x55602826bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f2618bbc640 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55602826b6e0 0x55602826bac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8855c9a04efb7fa3 server_cookie=c690b058f013e0e5 in_seq=0 out_seq=0 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f25effff640 10 client.4422 ms_handle_connect on v2:172.21.15.135:6834/2869657877 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f25effff640 1 -- 172.21.15.62:0/2075529611 <== mds.0 v2:172.21.15.135:6834/2869657877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5560281ca730 con 0x55602826b6e0 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f25effff640 10 client.4422 handle_command_reply: tid=0 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 client.4422 shutdown 2023-09-30T13:54:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 msgr2=0x55602831c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26100875d0 tx=0x7f2610000ed0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 shutdown_connections 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55602826b6e0 0x55602826bac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560282abbd0 0x556028298630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5560282935c0 0x5560282980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f25effff640 0 client.4422 ms_handle_reset on v2:172.21.15.135:6834/2869657877 2023-09-30T13:54:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 --2- 172.21.15.62:0/2075529611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560282931e0 0x55602831c7a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 >> 172.21.15.62:0/2075529611 conn(0x556028266620 msgr2=0x5560282d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 shutdown_connections 2023-09-30T13:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 1 -- 172.21.15.62:0/2075529611 wait complete. 2023-09-30T13:54:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.637+0000 7f261e1bb740 20 client.4422 trim_cache size 0 max 16384 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "79595c1b-6895-4c76-9183-336503666b5b", 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4285, 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-09-30T13:54:57.652 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 7.2202333999999997, 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 7, 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 24, 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 24, 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 14.322467031 2023-09-30T13:54:57.653 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 msgr2=0x7f25f806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 0x7f25f806cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2604036000 tx=0x7f2604030000 comp rx=0 tx=0).stop 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 msgr2=0x7f2614158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f261000c430 tx=0x7f261000c8f0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 shutdown_connections 2023-09-30T13:54:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f25f806ab30 0x7f25f806cff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2614160160 0x7f261406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26140b5bf0 0x7f261415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 --2- 172.21.15.62:0/473911771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26140b5790 0x7f2614158fb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 >> 172.21.15.62:0/473911771 conn(0x7f2614089fe0 msgr2=0x7f26140b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 shutdown_connections 2023-09-30T13:54:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.638+0000 7f261b621640 1 -- 172.21.15.62:0/473911771 wait complete. 2023-09-30T13:54:57.657 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T13:54:57.657 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:57.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.763+0000 7f822c733640 1 Processor -- start 2023-09-30T13:54:57.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.763+0000 7f822c733640 1 -- start start 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822c733640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82240ccc20 0x7f82240c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822c733640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82240b1e20 con 0x7f82241598c0 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822c733640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82240cd090 con 0x7f82240cf140 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822c733640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82240b1530 con 0x7f82240ccc20 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822a4cf640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f82241598c0 0x7f82240cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47098/0 (socket says 172.21.15.62:47098) 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822a4cf640 1 -- 172.21.15.62:0/3000030293 learned_addr learned my addr 172.21.15.62:0/3000030293 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f822acd0640 1 --2- 172.21.15.62:0/3000030293 >> v2:172.21.15.62:3300/0 conn(0x7f82240ccc20 0x7f82240c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f82294cd640 1 -- 172.21.15.62:0/3000030293 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497062882 0 0) 0x7f82240b1e20 con 0x7f82241598c0 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.764+0000 7f82294cd640 1 -- 172.21.15.62:0/3000030293 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c003520 con 0x7f82241598c0 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f822acd0640 1 -- 172.21.15.62:0/3000030293 >> v1:172.21.15.135:6789/0 conn(0x7f82240cf140 legacy=0x7f82240c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f822acd0640 1 -- 172.21.15.62:0/3000030293 >> v1:172.21.15.62:6789/0 conn(0x7f82241598c0 legacy=0x7f82240cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f822acd0640 1 -- 172.21.15.62:0/3000030293 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82240b17d0 con 0x7f82240ccc20 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f822acd0640 1 --2- 172.21.15.62:0/3000030293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f82240c93a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097d0 tx=0x7f821c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dfe11970e770d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f82294cd640 1 -- 172.21.15.62:0/3000030293 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c030610 con 0x7f82240ccc20 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f82294cd640 1 -- 172.21.15.62:0/3000030293 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c030770 con 0x7f82240ccc20 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.765+0000 7f82294cd640 1 -- 172.21.15.62:0/3000030293 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c030ae0 con 0x7f82240ccc20 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 -- 172.21.15.62:0/3000030293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 msgr2=0x7f82240c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 --2- 172.21.15.62:0/3000030293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f82240c93a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097d0 tx=0x7f821c02b960 comp rx=0 tx=0).stop 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 -- 172.21.15.62:0/3000030293 shutdown_connections 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 --2- 172.21.15.62:0/3000030293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f82240c93a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 -- 172.21.15.62:0/3000030293 >> 172.21.15.62:0/3000030293 conn(0x7f822406a170 msgr2=0x7f822406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 -- 172.21.15.62:0/3000030293 shutdown_connections 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.766+0000 7f822c733640 1 -- 172.21.15.62:0/3000030293 wait complete. 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.767+0000 7f822c733640 1 Processor -- start 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.767+0000 7f822c733640 1 -- start start 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 0x7f8224151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82241598c0 0x7f82240c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82240c4910 con 0x7f82240ccc20 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224151970 con 0x7f82240cf140 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822c733640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822415cde0 con 0x7f82241598c0 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40880/0 (socket says 172.21.15.62:40880) 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 -- 172.21.15.62:0/150025506 learned_addr learned my addr 172.21.15.62:0/150025506 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822acd0640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82241598c0 0x7f82240c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f8229cce640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 0x7f8224151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 -- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82241598c0 msgr2=0x7f82240c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82241598c0 0x7f82240c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 -- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 msgr2=0x7f8224151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 0x7f8224151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 -- 172.21.15.62:0/150025506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c009400 con 0x7f82240ccc20 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f8229cce640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 0x7f8224151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:54:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.768+0000 7f822a4cf640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f821400c840 tx=0x7f821400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.769+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400a640 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.769+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400a7a0 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.769+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8224159d40 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.769+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400ab50 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.769+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822415a300 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.770+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82240ca420 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.770+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f821400acb0 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.770+0000 7f8222ffd640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 0x7f821006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.771+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8214088d20 con 0x7f82240ccc20 2023-09-30T13:54:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.771+0000 7f8229cce640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 0x7f821006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:54:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.771+0000 7f8229cce640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 0x7f821006cff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82240b2080 tx=0x7f8218009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:54:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.775+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8214053d10 con 0x7f82240ccc20 2023-09-30T13:54:57.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.989+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f822404e0d0 con 0x7f82240ccc20 2023-09-30T13:54:57.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.989+0000 7f8222ffd640 1 -- 172.21.15.62:0/150025506 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8214017020 con 0x7f82240ccc20 2023-09-30T13:54:57.989 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 msgr2=0x7f821006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 0x7f821006cff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82240b2080 tx=0x7f8218009040 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 msgr2=0x7f822406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f821400c840 tx=0x7f821400cd00 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 shutdown_connections 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f821006ab30 0x7f821006cff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82241598c0 0x7f82240c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82240cf140 0x7f8224151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 --2- 172.21.15.62:0/150025506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82240ccc20 0x7f822406c880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 >> 172.21.15.62:0/150025506 conn(0x7f822406a170 msgr2=0x7f82240cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:54:57.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 shutdown_connections 2023-09-30T13:54:57.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:57.991+0000 7f822c733640 1 -- 172.21.15.62:0/150025506 wait complete. 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:54:58.001 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-09-30T13:54:58.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.002 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:54:58.017 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:54:58.018 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:54:58.019 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42696sec preferred_lft 42696sec 2023-09-30T13:54:58.019 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:54:58.019 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:54:58.019 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T13:54:58.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.019 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T13:54:58.020 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:54:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.206 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:54:58.237 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:54:58.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.239 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:54:58.308 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:54:58.308 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:54:58.308 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:54:58.308 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:54:58.308 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:54:58.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:54:58.309 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:54:58.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.571 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:54:58.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.587 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-09-30T13:54:58.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.642 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:54:58.642 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:54:58.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:54:58.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-09-30T13:54:58.642 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:54:58.730 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-09-30T13:54:58.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-09-30T13:54:58.731 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:54:58.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:58.850 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:54:58.850 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:54:58.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-09-30T13:54:58.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T13:54:58.851 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:54:58.899 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-09-30T13:54:58.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:54:58.899 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:58.914 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-09-30T13:54:58.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:54:58.914 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:58.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:54:59.040 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:54:59.096 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:54:59.096 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:54:59.097 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:54:59.098 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:54:59.098 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:54:59.098 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:54:59.098 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:54:59.098 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:54:59.099 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:54:59.100 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:54:59.100 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:54:59.100 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:54:59.100 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:54:59.100 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:54:59.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.102 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:54:59.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:54:59.151 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-09-30T13:54:59.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:54:59.229 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:54:59.285 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:54:59.285 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:54:59.285 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:54:59.285 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:54:59.286 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:54:59.287 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:54:59.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.288 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:54:59.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:2023-09-30T13:54:59.299+0000 7f9fb064b480 -1 init, newargv = 0x55f116bcf170 newargc=15 2023-09-30T13:54:59.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[94491]: starting ceph client 2023-09-30T13:54:59.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[94491]: starting fuse 2023-09-30T13:54:59.314 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:54:59.314 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:54:59.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:54:59.314 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:54:59.314 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:54:59.315 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.admin")) 2023-09-30T13:54:59.316 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:54:59.439 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.admin.94491.asok 2023-09-30T13:54:59.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:54:59.450 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94491.asok 2023-09-30T13:54:59.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94491.asok status 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "admin", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "94491", 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:54:59.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4434, 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4434 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:54:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 445056622 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 445056622 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4434 192.168.0.1:0/445056622", 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/445056622", 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 7, 2023-09-30T13:54:59.595 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 24, 2023-09-30T13:54:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:54:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:54:59.596 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:54:59.596 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:54:59.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.601 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:54:59.601 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:59.617 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:54:59.617 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:59.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:54:59.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:54:59.689 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-09-30T13:54:59.974 INFO:teuthology.orchestra.run.smithi062.stdout:# file: . 2023-09-30T13:54:59.974 INFO:teuthology.orchestra.run.smithi062.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-09-30T13:54:59.974 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:54:59.974 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:54:59.974 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:54:59.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 Processor -- start 2023-09-30T13:55:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 -- start start 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18680cee70 0x7f186815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680b1e20 con 0x7f18680cea30 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680b1530 con 0x7f18680cee70 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.140+0000 7f186d30f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680b17d0 con 0x7f18681598c0 2023-09-30T13:55:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18677fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18680cee70 0x7f186815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:37782/0 (socket says 172.21.15.62:37782) 2023-09-30T13:55:00.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f1866ffd640 1 -- 172.21.15.62:0/3665110791 learned_addr learned my addr 172.21.15.62:0/3665110791 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18677fe640 1 -- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 msgr2=0x7f18680ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18677fe640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18677fe640 1 -- 172.21.15.62:0/3665110791 >> v1:172.21.15.135:6789/0 conn(0x7f18680cea30 legacy=0x7f186815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18677fe640 1 -- 172.21.15.62:0/3665110791 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680b1ab0 con 0x7f18680cee70 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f18667fc640 1 -- 172.21.15.62:0/3665110791 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236780777 0 0) 0x7f18680b1e20 con 0x7f18680cea30 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.141+0000 7f1866ffd640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.142+0000 7f18677fe640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f186815dc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1860009d90 tx=0x7f186002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d622a3b7a3bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.142+0000 7f18667fc640 1 -- 172.21.15.62:0/3665110791 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186002cc50 con 0x7f18680cee70 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.142+0000 7f18667fc640 1 -- 172.21.15.62:0/3665110791 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186002cdb0 con 0x7f18680cee70 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.142+0000 7f18667fc640 1 -- 172.21.15.62:0/3665110791 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860034660 con 0x7f18680cee70 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 -- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 msgr2=0x7f186815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f186815dc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1860009d90 tx=0x7f186002bea0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 -- 172.21.15.62:0/3665110791 shutdown_connections 2023-09-30T13:55:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f186815dc30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 --2- 172.21.15.62:0/3665110791 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18681598c0 0x7f18680ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 -- 172.21.15.62:0/3665110791 >> 172.21.15.62:0/3665110791 conn(0x7f186806a170 msgr2=0x7f186806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 -- 172.21.15.62:0/3665110791 shutdown_connections 2023-09-30T13:55:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.143+0000 7f186d30f640 1 -- 172.21.15.62:0/3665110791 wait complete. 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.144+0000 7f186d30f640 1 Processor -- start 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.144+0000 7f186d30f640 1 -- start start 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18680cea30 0x7f18680c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f18680c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c4720 con 0x7f18681598c0 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c4a00 con 0x7f18680cee70 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f186d30f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c22f0 con 0x7f18680cea30 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40882/0 (socket says 172.21.15.62:40882) 2023-09-30T13:55:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 -- 172.21.15.62:0/1246434201 learned_addr learned my addr 172.21.15.62:0/1246434201 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f185ffff640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f18680c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f1866ffd640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18680cea30 0x7f18680c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 -- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18680cea30 msgr2=0x7f18680c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18680cea30 0x7f18680c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 -- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 msgr2=0x7f18680c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f18680c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 -- 172.21.15.62:0/1246434201 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009460 con 0x7f18681598c0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.145+0000 7f18677fe640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1860009eb0 tx=0x7f1860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.146+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860009450 con 0x7f18681598c0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.146+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186003f420 con 0x7f18681598c0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.146+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1860009a70 con 0x7f18681598c0 2023-09-30T13:55:00.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.146+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186003f790 con 0x7f18681598c0 2023-09-30T13:55:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.146+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18680c28b0 con 0x7f18681598c0 2023-09-30T13:55:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.147+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680b1030 con 0x7f18681598c0 2023-09-30T13:55:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.148+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f186003f8f0 con 0x7f18681598c0 2023-09-30T13:55:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.148+0000 7f185f7fe640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 0x7f184806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.148+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18600ac060 con 0x7f18681598c0 2023-09-30T13:55:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.148+0000 7f1866ffd640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 0x7f184806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.149+0000 7f1866ffd640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 0x7f184806cff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1858009c20 tx=0x7f1858009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.152+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1860077100 con 0x7f18681598c0 2023-09-30T13:55:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.328+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18680c2150 con 0x7f18681598c0 2023-09-30T13:55:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.329+0000 7f185f7fe640 1 -- 172.21.15.62:0/1246434201 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f18680c2150 con 0x7f18681598c0 2023-09-30T13:55:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:00.329 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 msgr2=0x7f184806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 0x7f184806cff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1858009c20 tx=0x7f1858009210 comp rx=0 tx=0).stop 2023-09-30T13:55:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 msgr2=0x7f1868070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1860009eb0 tx=0x7f1860004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 shutdown_connections 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f184806ab30 0x7f184806cff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18681598c0 0x7f1868070e30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18680cee70 0x7f18680c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 --2- 172.21.15.62:0/1246434201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18680cea30 0x7f18680c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 >> 172.21.15.62:0/1246434201 conn(0x7f186806a170 msgr2=0x7f18680acca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 shutdown_connections 2023-09-30T13:55:00.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.331+0000 7f186d30f640 1 -- 172.21.15.62:0/1246434201 wait complete. 2023-09-30T13:55:00.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:00.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:00.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.452+0000 7f64dabe9640 1 Processor -- start 2023-09-30T13:55:00.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.452+0000 7f64dabe9640 1 -- start start 2023-09-30T13:55:00.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64dabe9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64d415cb00 0x7f64d4071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64dabe9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cee0 0x7f64d40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64dabe9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d40c9a00 con 0x7f64d40ae300 2023-09-30T13:55:00.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64dabe9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d406d740 con 0x7f64d415cb00 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64dabe9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d406da20 con 0x7f64d415cee0 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64d415cb00 0x7f64d4071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64d415cb00 0x7f64d4071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40892/0 (socket says 172.21.15.62:40892) 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 -- 172.21.15.62:0/1870420876 learned_addr learned my addr 172.21.15.62:0/1870420876 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 -- 172.21.15.62:0/1870420876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cee0 msgr2=0x7f64d40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d3fff640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cee0 0x7f64d40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cee0 0x7f64d40c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.453+0000 7f64d8985640 1 -- 172.21.15.62:0/1870420876 >> v1:172.21.15.135:6789/0 conn(0x7f64d40ae300 legacy=0x7f64d406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:00.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.454+0000 7f64d8985640 1 -- 172.21.15.62:0/1870420876 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d406dd00 con 0x7f64d415cb00 2023-09-30T13:55:00.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.454+0000 7f64d8985640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cb00 0x7f64d4071860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0f71e26dc19846 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.454+0000 7f64d37fe640 1 -- 172.21.15.62:0/1870420876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc02ca70 con 0x7f64d415cb00 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.454+0000 7f64d37fe640 1 -- 172.21.15.62:0/1870420876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc02cbd0 con 0x7f64d415cb00 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.454+0000 7f64d37fe640 1 -- 172.21.15.62:0/1870420876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0343f0 con 0x7f64d415cb00 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 -- 172.21.15.62:0/1870420876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cb00 msgr2=0x7f64d4071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cb00 0x7f64d4071860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc02bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 -- 172.21.15.62:0/1870420876 shutdown_connections 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cee0 0x7f64d40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 --2- 172.21.15.62:0/1870420876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cb00 0x7f64d4071860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 -- 172.21.15.62:0/1870420876 >> 172.21.15.62:0/1870420876 conn(0x7f64d4070970 msgr2=0x7f64d4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 -- 172.21.15.62:0/1870420876 shutdown_connections 2023-09-30T13:55:00.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.455+0000 7f64dabe9640 1 -- 172.21.15.62:0/1870420876 wait complete. 2023-09-30T13:55:00.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.456+0000 7f64dabe9640 1 Processor -- start 2023-09-30T13:55:00.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.456+0000 7f64dabe9640 1 -- start start 2023-09-30T13:55:00.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d40ae300 0x7f64d40c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cb00 0x7f64d40c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d414ee70 con 0x7f64d415cee0 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40c5420 con 0x7f64d40ae300 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64dabe9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40c5700 con 0x7f64d415cb00 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40896/0 (socket says 172.21.15.62:40896) 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 -- 172.21.15.62:0/154236101 learned_addr learned my addr 172.21.15.62:0/154236101 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d8985640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d40ae300 0x7f64d40c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d3fff640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cb00 0x7f64d40c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 -- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cb00 msgr2=0x7f64d40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cb00 0x7f64d40c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 -- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d40ae300 msgr2=0x7f64d40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d40ae300 0x7f64d40c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.457+0000 7f64d9186640 1 -- 172.21.15.62:0/154236101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009b30 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64d9186640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c410 tx=0x7f64bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc005230 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc005390 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d40c5f40 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0117d0 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.458+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d40c6500 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.459+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d40666d0 con 0x7f64d415cee0 2023-09-30T13:55:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.459+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f64bc011930 con 0x7f64d415cee0 2023-09-30T13:55:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.460+0000 7f64d17fa640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 0x7f64b406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.460+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64bc088790 con 0x7f64d415cee0 2023-09-30T13:55:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.460+0000 7f64d8985640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 0x7f64b406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.460+0000 7f64d8985640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 0x7f64b406cff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64cc035000 tx=0x7f64cc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.464+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f64bc053830 con 0x7f64d415cee0 2023-09-30T13:55:00.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.640+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64d40c6720 con 0x7f64d415cee0 2023-09-30T13:55:00.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.641+0000 7f64d17fa640 1 -- 172.21.15.62:0/154236101 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64bc056e50 con 0x7f64d415cee0 2023-09-30T13:55:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 msgr2=0x7f64b406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 0x7f64b406cff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64cc035000 tx=0x7f64cc030000 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 msgr2=0x7f64d415b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c410 tx=0x7f64bc00c8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 shutdown_connections 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f64b406ab30 0x7f64b406cff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64d415cee0 0x7f64d415b2c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d415cb00 0x7f64d40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 --2- 172.21.15.62:0/154236101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d40ae300 0x7f64d40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 >> 172.21.15.62:0/154236101 conn(0x7f64d4070970 msgr2=0x7f64d40af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 shutdown_connections 2023-09-30T13:55:00.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.643+0000 7f64dabe9640 1 -- 172.21.15.62:0/154236101 wait complete. 2023-09-30T13:55:00.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:00.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.762+0000 7fc323f47640 1 Processor -- start 2023-09-30T13:55:00.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 -- start start 2023-09-30T13:55:00.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 0x7fc31c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc31c06bf80 0x7fc31c0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0d0050 con 0x7fc31c0cd960 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0cdd40 con 0x7fc31c06bf80 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.763+0000 7fc323f47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c06b500 con 0x7fc31c06b070 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3224e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc31c06bf80 0x7fc31c0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc321ce3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc31c0cd960 0x7fc31c06b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47110/0 (socket says 172.21.15.62:47110) 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc321ce3640 1 -- 172.21.15.62:0/1898730966 learned_addr learned my addr 172.21.15.62:0/1898730966 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3224e4640 1 -- 172.21.15.62:0/1898730966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 msgr2=0x7fc31c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3214e2640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 0x7fc31c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3224e4640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 0x7fc31c0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3224e4640 1 -- 172.21.15.62:0/1898730966 >> v1:172.21.15.62:6789/0 conn(0x7fc31c0cd960 legacy=0x7fc31c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc320ce1640 1 -- 172.21.15.62:0/1898730966 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305153709 0 0) 0x7fc31c0d0050 con 0x7fc31c0cd960 2023-09-30T13:55:00.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3224e4640 1 -- 172.21.15.62:0/1898730966 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0cf720 con 0x7fc31c06bf80 2023-09-30T13:55:00.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.764+0000 7fc3214e2640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 0x7fc31c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc3224e4640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c06bf80 0x7fc31c0b0a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5f603d77d3112 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc320ce1640 1 -- 172.21.15.62:0/1898730966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31802cc50 con 0x7fc31c06bf80 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc320ce1640 1 -- 172.21.15.62:0/1898730966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31802cdb0 con 0x7fc31c06bf80 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc320ce1640 1 -- 172.21.15.62:0/1898730966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318034660 con 0x7fc31c06bf80 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 -- 172.21.15.62:0/1898730966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c06bf80 msgr2=0x7fc31c0b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c06bf80 0x7fc31c0b0a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802bea0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 -- 172.21.15.62:0/1898730966 shutdown_connections 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c06bf80 0x7fc31c0b0a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 --2- 172.21.15.62:0/1898730966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c06b070 0x7fc31c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 -- 172.21.15.62:0/1898730966 >> 172.21.15.62:0/1898730966 conn(0x7fc31c0d08e0 msgr2=0x7fc31c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 -- 172.21.15.62:0/1898730966 shutdown_connections 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.765+0000 7fc323f47640 1 -- 172.21.15.62:0/1898730966 wait complete. 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 Processor -- start 2023-09-30T13:55:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 -- start start 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 0x7fc31c149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c0b5870 0x7fc31c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0ad580 con 0x7fc31c0cd960 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b5e80 con 0x7fc31c06bf80 2023-09-30T13:55:00.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc323f47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b6160 con 0x7fc31c0b5870 2023-09-30T13:55:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc3214e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc3214e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40922/0 (socket says 172.21.15.62:40922) 2023-09-30T13:55:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.767+0000 7fc3214e2640 1 -- 172.21.15.62:0/1065025787 learned_addr learned my addr 172.21.15.62:0/1065025787 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3224e4640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c0b5870 0x7fc31c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc321ce3640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 0x7fc31c149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 -- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c0b5870 msgr2=0x7fc31c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c0b5870 0x7fc31c0b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 -- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 msgr2=0x7fc31c149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 0x7fc31c149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 -- 172.21.15.62:0/1065025787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009a70 con 0x7fc31c0cd960 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc321ce3640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 0x7fc31c149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3214e2640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c7f0 tx=0x7fc30c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c007a30 con 0x7fc31c0cd960 2023-09-30T13:55:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c007b90 con 0x7fc31c0cd960 2023-09-30T13:55:00.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0b6440 con 0x7fc31c0cd960 2023-09-30T13:55:00.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00ce40 con 0x7fc31c0cd960 2023-09-30T13:55:00.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.768+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c150480 con 0x7fc31c0cd960 2023-09-30T13:55:00.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.769+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0ad780 con 0x7fc31c0cd960 2023-09-30T13:55:00.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.770+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc30c0113f0 con 0x7fc31c0cd960 2023-09-30T13:55:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.770+0000 7fc3127fc640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 0x7fc30006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.770+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc30c089660 con 0x7fc31c0cd960 2023-09-30T13:55:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.770+0000 7fc321ce3640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 0x7fc30006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:00.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.771+0000 7fc321ce3640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 0x7fc30006cff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc314000f60 tx=0x7fc314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:00.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.774+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc31c0ad780 con 0x7fc31c0cd960 2023-09-30T13:55:00.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.951+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc31c0ad780 con 0x7fc31c0cd960 2023-09-30T13:55:00.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.951+0000 7fc3127fc640 1 -- 172.21.15.62:0/1065025787 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc31c0ad780 con 0x7fc31c0cd960 2023-09-30T13:55:00.951 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 msgr2=0x7fc30006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 0x7fc30006cff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc314000f60 tx=0x7fc314009040 comp rx=0 tx=0).stop 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 msgr2=0x7fc31c0b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c7f0 tx=0x7fc30c00cbf0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 shutdown_connections 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc30006ab30 0x7fc30006cff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc31c0b5870 0x7fc31c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc31c0cd960 0x7fc31c0b5330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 --2- 172.21.15.62:0/1065025787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc31c06bf80 0x7fc31c149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 >> 172.21.15.62:0/1065025787 conn(0x7fc31c0d08e0 msgr2=0x7fc31c15b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 shutdown_connections 2023-09-30T13:55:00.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:00.953+0000 7fc323f47640 1 -- 172.21.15.62:0/1065025787 wait complete. 2023-09-30T13:55:00.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:01.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.072+0000 7fd1aa80e640 1 Processor -- start 2023-09-30T13:55:01.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.072+0000 7fd1aa80e640 1 -- start start 2023-09-30T13:55:01.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1aa80e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1a4071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1aa80e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a406a640 con 0x7fd1a406ed30 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1aa80e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a415b1c0 con 0x7fd1a406bae0 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1aa80e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a415f6d0 con 0x7fd1a415ade0 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1a37fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd1a406ed30 0x7fd1a415e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47122/0 (socket says 172.21.15.62:47122) 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1a37fe640 1 -- 172.21.15.62:0/3977533636 learned_addr learned my addr 172.21.15.62:0/3977533636 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1a3fff640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1a4071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.073+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772520207 0 0) 0x7fd1a406a640 con 0x7fd1a406ed30 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd190003520 con 0x7fd1a406ed30 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307776546 0 0) 0x7fd190003520 con 0x7fd1a406ed30 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 msgr2=0x7fd1a4071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1a4071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 >> v1:172.21.15.135:6789/0 conn(0x7fd1a406bae0 legacy=0x7fd1a415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40ca540 con 0x7fd1a406ed30 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd194001670 con 0x7fd1a406ed30 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 >> v1:172.21.15.62:6789/0 conn(0x7fd1a406ed30 legacy=0x7fd1a415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1900039a0 0x7fd190003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a415f6d0 con 0x7fd190004d00 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000b980 con 0x7fd1900039a0 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000bb40 con 0x7fd1a415ade0 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a3fff640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1900039a0 0x7fd190003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a37fe640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 -- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 msgr2=0x7fd1900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a415ade0 0x7fd1900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 -- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1900039a0 msgr2=0x7fd190003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1900039a0 0x7fd190003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.074+0000 7fd1a8dab640 1 -- 172.21.15.62:0/3977533636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190003520 con 0x7fd190004d00 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.075+0000 7fd1a8dab640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd190005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001f60 tx=0x7fd1900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b3a3315270efba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.075+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c02d6f0 con 0x7fd190004d00 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.075+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c02d870 con 0x7fd190004d00 2023-09-30T13:55:01.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.075+0000 7fd1a2ffd640 1 -- 172.21.15.62:0/3977533636 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c02dc20 con 0x7fd190004d00 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 -- 172.21.15.62:0/3977533636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 msgr2=0x7fd190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/3977533636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd190005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001f60 tx=0x7fd1900057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1a8dab640 1 -- 172.21.15.62:0/3977533636 reap_dead start 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 -- 172.21.15.62:0/3977533636 shutdown_connections 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 -- 172.21.15.62:0/3977533636 >> 172.21.15.62:0/3977533636 conn(0x7fd1a40cc180 msgr2=0x7fd1a40cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 -- 172.21.15.62:0/3977533636 shutdown_connections 2023-09-30T13:55:01.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.076+0000 7fd1aa80e640 1 -- 172.21.15.62:0/3977533636 wait complete. 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.077+0000 7fd1aa80e640 1 Processor -- start 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.077+0000 7fd1aa80e640 1 -- start start 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a40c8b80 0x7fd1a40c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1a41f0380 0x7fd1a41f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40c9540 con 0x7fd190004d00 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40c5930 con 0x7fd1a41f0380 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1aa80e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a41f10f0 con 0x7fd1a40c8b80 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40940/0 (socket says 172.21.15.62:40940) 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 -- 172.21.15.62:0/947952697 learned_addr learned my addr 172.21.15.62:0/947952697 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:01.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a8dab640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1a41f0380 0x7fd1a41f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a37fe640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a40c8b80 0x7fd1a40c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 -- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a40c8b80 msgr2=0x7fd1a40c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a40c8b80 0x7fd1a40c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 -- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1a41f0380 msgr2=0x7fd1a41f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1a41f0380 0x7fd1a41f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 -- 172.21.15.62:0/947952697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a41f3850 con 0x7fd190004d00 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.078+0000 7fd1a3fff640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0119a0 tx=0x7fd18c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.079+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00faf0 con 0x7fd190004d00 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.079+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00fc50 con 0x7fd190004d00 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.079+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c014440 con 0x7fd190004d00 2023-09-30T13:55:01.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.079+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a41f3b30 con 0x7fd190004d00 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.079+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a41f40f0 con 0x7fd190004d00 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.080+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40cbae0 con 0x7fd190004d00 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.080+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd18c0145a0 con 0x7fd190004d00 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.081+0000 7fd1a0ff9640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 0x7fd18406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.081+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd18c089bd0 con 0x7fd190004d00 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.081+0000 7fd1a37fe640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 0x7fd18406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.081+0000 7fd1a37fe640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 0x7fd18406d020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40af0f0 tx=0x7fd194000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.085+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd18c054be0 con 0x7fd190004d00 2023-09-30T13:55:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.258+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1a404e0d0 con 0x7fd190004d00 2023-09-30T13:55:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.258+0000 7fd1a0ff9640 1 -- 172.21.15.62:0/947952697 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd18c022020 con 0x7fd190004d00 2023-09-30T13:55:01.258 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 msgr2=0x7fd18406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 0x7fd18406d020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40af0f0 tx=0x7fd194000f80 comp rx=0 tx=0).stop 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 msgr2=0x7fd1a40c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0119a0 tx=0x7fd18c011e60 comp rx=0 tx=0).stop 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 shutdown_connections 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd18406ab60 0x7fd18406d020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1a41f0380 0x7fd1a41f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1a40c8b80 0x7fd1a40c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 --2- 172.21.15.62:0/947952697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd190004d00 0x7fd1a40c53f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 >> 172.21.15.62:0/947952697 conn(0x7fd1a40cc180 msgr2=0x7fd1a40718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 shutdown_connections 2023-09-30T13:55:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.260+0000 7fd1aa80e640 1 -- 172.21.15.62:0/947952697 wait complete. 2023-09-30T13:55:01.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:01.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.378+0000 7f43e502d640 1 Processor -- start 2023-09-30T13:55:01.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 -- start start 2023-09-30T13:55:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f43e00b8760 0x7f43e00d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00d1410 con 0x7f43e00cd8c0 2023-09-30T13:55:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00d16f0 con 0x7f43e00b8760 2023-09-30T13:55:01.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.379+0000 7f43e502d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00d19d0 con 0x7f43e015cbc0 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43d7fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f43e00b8760 0x7f43e00d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43df59e640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f43e00cd8c0 0x7f43e00b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:40910/0 (socket says 172.21.15.62:40910) 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43df59e640 1 -- 172.21.15.62:0/383694092 learned_addr learned my addr 172.21.15.62:0/383694092 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:37854/0 (socket says 172.21.15.62:37854) 2023-09-30T13:55:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 -- 172.21.15.62:0/383694092 >> v2:172.21.15.135:3300/0 conn(0x7f43e00b8760 msgr2=0x7f43e00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 --2- 172.21.15.62:0/383694092 >> v2:172.21.15.135:3300/0 conn(0x7f43e00b8760 0x7f43e00d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 -- 172.21.15.62:0/383694092 >> v1:172.21.15.135:6789/0 conn(0x7f43e00cd8c0 legacy=0x7f43e00b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.380+0000 7f43ded9d640 1 -- 172.21.15.62:0/383694092 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00d1cb0 con 0x7f43e015cbc0 2023-09-30T13:55:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.381+0000 7f43ded9d640 1 --2- 172.21.15.62:0/383694092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f43d00097a0 tx=0x7f43d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cd28943711b9401 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.381+0000 7f43de59c640 1 -- 172.21.15.62:0/383694092 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0031830 con 0x7f43e015cbc0 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.381+0000 7f43de59c640 1 -- 172.21.15.62:0/383694092 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d0031990 con 0x7f43e015cbc0 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.381+0000 7f43de59c640 1 -- 172.21.15.62:0/383694092 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0031d20 con 0x7f43e015cbc0 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 -- 172.21.15.62:0/383694092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 msgr2=0x7f43e00d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 --2- 172.21.15.62:0/383694092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f43d00097a0 tx=0x7f43d002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 -- 172.21.15.62:0/383694092 shutdown_connections 2023-09-30T13:55:01.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 --2- 172.21.15.62:0/383694092 >> v2:172.21.15.135:3300/0 conn(0x7f43e00b8760 0x7f43e00d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 --2- 172.21.15.62:0/383694092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e00d24b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 -- 172.21.15.62:0/383694092 >> 172.21.15.62:0/383694092 conn(0x7f43e00718a0 msgr2=0x7f43e0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 -- 172.21.15.62:0/383694092 shutdown_connections 2023-09-30T13:55:01.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.382+0000 7f43e502d640 1 -- 172.21.15.62:0/383694092 wait complete. 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.383+0000 7f43e502d640 1 Processor -- start 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.383+0000 7f43e502d640 1 -- start start 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43e00b8760 0x7f43e0147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015e580 con 0x7f43e00cd8c0 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015d290 con 0x7f43e00b8760 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43e502d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015e0f0 con 0x7f43e015cbc0 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40952/0 (socket says 172.21.15.62:40952) 2023-09-30T13:55:01.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 -- 172.21.15.62:0/2597473444 learned_addr learned my addr 172.21.15.62:0/2597473444 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43ded9d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43e00b8760 0x7f43e0147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43df59e640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 -- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 msgr2=0x7f43e015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e015f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 -- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43e00b8760 msgr2=0x7f43e0147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43e00b8760 0x7f43e0147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.384+0000 7f43d7fff640 1 -- 172.21.15.62:0/2597473444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0009400 con 0x7f43e00cd8c0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43d7fff640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e9b0 tx=0x7f43c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009670 con 0x7f43e00cd8c0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c800c9a0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e015d4e0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c800cd50 con 0x7f43e00cd8c0 2023-09-30T13:55:01.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.385+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e015daa0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.386+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e015e260 con 0x7f43e00cd8c0 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.386+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f43c8013470 con 0x7f43e00cd8c0 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.387+0000 7f43d77fe640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 0x7f43c006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.387+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43c80896b0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.387+0000 7f43ded9d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 0x7f43c006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.387+0000 7f43ded9d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 0x7f43c006cff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43d0036000 tx=0x7f43d003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.391+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f43c80546d0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.567+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f43e004e0d0 con 0x7f43e00cd8c0 2023-09-30T13:55:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.567+0000 7f43d77fe640 1 -- 172.21.15.62:0/2597473444 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f43c805e070 con 0x7f43e00cd8c0 2023-09-30T13:55:01.567 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 msgr2=0x7f43c006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 0x7f43c006cff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43d0036000 tx=0x7f43d003c040 comp rx=0 tx=0).stop 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 msgr2=0x7f43e015f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e9b0 tx=0x7f43c800ee70 comp rx=0 tx=0).stop 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 shutdown_connections 2023-09-30T13:55:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f43c006ab30 0x7f43c006cff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43e015cbc0 0x7f43e015f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e00cd8c0 0x7f43e015f1d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 --2- 172.21.15.62:0/2597473444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43e00b8760 0x7f43e0147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 >> 172.21.15.62:0/2597473444 conn(0x7f43e00718a0 msgr2=0x7f43e00b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 shutdown_connections 2023-09-30T13:55:01.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.569+0000 7f43e502d640 1 -- 172.21.15.62:0/2597473444 wait complete. 2023-09-30T13:55:01.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:01.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.687+0000 7f05bd67c640 1 Processor -- start 2023-09-30T13:55:01.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.687+0000 7f05bd67c640 1 -- start start 2023-09-30T13:55:01.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05b8160160 0x7f05b80d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f05b80d3600 0x7f05b80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b80b5cd0 0x7f05b80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80cda60 con 0x7f05b8160160 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80d18a0 con 0x7f05b80d3600 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05bd67c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8160540 con 0x7f05b80b5cd0 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05b8160160 0x7f05b80d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05b8160160 0x7f05b80d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40958/0 (socket says 172.21.15.62:40958) 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 -- 172.21.15.62:0/4147086923 learned_addr learned my addr 172.21.15.62:0/4147086923 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b67fc640 1 --2- 172.21.15.62:0/4147086923 >> v2:172.21.15.135:3300/0 conn(0x7f05b80d3600 0x7f05b80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b77fe640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b80b5cd0 0x7f05b80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 -- 172.21.15.62:0/4147086923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b80b5cd0 msgr2=0x7f05b80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b80b5cd0 0x7f05b80cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 -- 172.21.15.62:0/4147086923 >> v2:172.21.15.135:3300/0 conn(0x7f05b80d3600 msgr2=0x7f05b80b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.688+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/4147086923 >> v2:172.21.15.135:3300/0 conn(0x7f05b80d3600 0x7f05b80b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.689+0000 7f05b6ffd640 1 -- 172.21.15.62:0/4147086923 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80cd450 con 0x7f05b8160160 2023-09-30T13:55:01.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.689+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b8160160 0x7f05b80d30c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05b808cc30 tx=0x7f05b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82de9ce03ea24a88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.689+0000 7f05b5ffb640 1 -- 172.21.15.62:0/4147086923 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0030860 con 0x7f05b8160160 2023-09-30T13:55:01.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.689+0000 7f05b5ffb640 1 -- 172.21.15.62:0/4147086923 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00309c0 con 0x7f05b8160160 2023-09-30T13:55:01.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.689+0000 7f05b5ffb640 1 -- 172.21.15.62:0/4147086923 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0030d50 con 0x7f05b8160160 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 -- 172.21.15.62:0/4147086923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b8160160 msgr2=0x7f05b80d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b8160160 0x7f05b80d30c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05b808cc30 tx=0x7f05b002b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 -- 172.21.15.62:0/4147086923 shutdown_connections 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b80b5cd0 0x7f05b80cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 --2- 172.21.15.62:0/4147086923 >> v2:172.21.15.135:3300/0 conn(0x7f05b80d3600 0x7f05b80b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 --2- 172.21.15.62:0/4147086923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b8160160 0x7f05b80d30c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 -- 172.21.15.62:0/4147086923 >> 172.21.15.62:0/4147086923 conn(0x7f05b8089fe0 msgr2=0x7f05b80d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 -- 172.21.15.62:0/4147086923 shutdown_connections 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.690+0000 7f05bd67c640 1 -- 172.21.15.62:0/4147086923 wait complete. 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.691+0000 7f05bd67c640 1 Processor -- start 2023-09-30T13:55:01.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.691+0000 7f05bd67c640 1 -- start start 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 0x7f05b8151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b8160160 0x7f05b8158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8153610 con 0x7f05b80b5cd0 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8152170 con 0x7f05b80d3600 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05bd67c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8158e10 con 0x7f05b8160160 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40974/0 (socket says 172.21.15.62:40974) 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05b6ffd640 1 -- 172.21.15.62:0/623079765 learned_addr learned my addr 172.21.15.62:0/623079765 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05b67fc640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 0x7f05b8151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.692+0000 7f05b77fe640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b8160160 0x7f05b8158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 -- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b8160160 msgr2=0x7f05b8158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b8160160 0x7f05b8158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 -- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 msgr2=0x7f05b8151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 0x7f05b8151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 -- 172.21.15.62:0/623079765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00094d0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b67fc640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 0x7f05b8151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05b6ffd640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05b002b9e0 tx=0x7f05b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0039c90 con 0x7f05b80b5cd0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0039e10 con 0x7f05b80b5cd0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b8152fc0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0043640 con 0x7f05b80b5cd0 2023-09-30T13:55:01.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.693+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b8152cc0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.694+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b8073e70 con 0x7f05b80b5cd0 2023-09-30T13:55:01.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.694+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f05b00437a0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.695+0000 7f05af7fe640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 0x7f059806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:01.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.695+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05b003e070 con 0x7f05b80b5cd0 2023-09-30T13:55:01.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.695+0000 7f05b67fc640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 0x7f059806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:01.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.695+0000 7f05b67fc640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 0x7f059806d020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05b8152a60 tx=0x7f05a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:01.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.699+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f05b00773f0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.886+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05b80cfef0 con 0x7f05b80b5cd0 2023-09-30T13:55:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.887+0000 7f05af7fe640 1 -- 172.21.15.62:0/623079765 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05b007aa10 con 0x7f05b80b5cd0 2023-09-30T13:55:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 msgr2=0x7f059806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 0x7f059806d020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05b8152a60 tx=0x7f05a0009190 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 msgr2=0x7f05b81561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05b002b9e0 tx=0x7f05b0004730 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 shutdown_connections 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f059806ab60 0x7f059806d020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f05b8160160 0x7f05b8158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05b80d3600 0x7f05b8151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 --2- 172.21.15.62:0/623079765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b80b5cd0 0x7f05b81561f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 >> 172.21.15.62:0/623079765 conn(0x7f05b8089fe0 msgr2=0x7f05b80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 shutdown_connections 2023-09-30T13:55:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:01.889+0000 7f05bd67c640 1 -- 172.21.15.62:0/623079765 wait complete. 2023-09-30T13:55:01.899 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:01.899 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:01.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:02.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.062+0000 7feee442b640 1 Processor -- start 2023-09-30T13:55:02.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.062+0000 7feee442b640 1 -- start start 2023-09-30T13:55:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee442b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feedc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee442b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feedc0cee70 0x7feedc15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee442b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc0b1e20 con 0x7feedc0cea30 2023-09-30T13:55:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee442b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc0b1530 con 0x7feedc0cee70 2023-09-30T13:55:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee442b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b17d0 con 0x7feedc1598c0 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee19c6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feedc0cea30 0x7feedc15d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47124/0 (socket says 172.21.15.62:47124) 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee19c6640 1 -- 172.21.15.62:0/2664330668 learned_addr learned my addr 172.21.15.62:0/2664330668 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324596184 0 0) 0x7feedc0b1e20 con 0x7feedc0cea30 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee29c8640 1 --2- 172.21.15.62:0/2664330668 >> v2:172.21.15.135:3300/0 conn(0x7feedc0cee70 0x7feedc15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec8003520 con 0x7feedc0cea30 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee21c7640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feedc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3080594694 0 0) 0x7feec8003520 con 0x7feedc0cea30 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 msgr2=0x7feedc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feedc0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 >> v2:172.21.15.135:3300/0 conn(0x7feedc0cee70 msgr2=0x7feedc15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 --2- 172.21.15.62:0/2664330668 >> v2:172.21.15.135:3300/0 conn(0x7feedc0cee70 0x7feedc15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0b1ab0 con 0x7feedc0cea30 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7feecc001670 con 0x7feedc0cea30 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 >> v1:172.21.15.62:6789/0 conn(0x7feedc0cea30 legacy=0x7feedc15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feec8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.063+0000 7feee11c5640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feec80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee11c5640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b1530 con 0x7feec8003970 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b17d0 con 0x7feec8004d00 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec800db90 con 0x7feedc1598c0 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feec8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee19c6640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feec80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee29c8640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 -- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 msgr2=0x7feec80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc1598c0 0x7feec80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 -- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feec8004d00 msgr2=0x7feec8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.064+0000 7feee21c7640 1 -- 172.21.15.62:0/2664330668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8003520 con 0x7feec8003970 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee21c7640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feec8003d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feed8009ab0 tx=0x7feec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4308fbb2f966a61a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8005990 con 0x7feec8003970 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8005af0 con 0x7feec8003970 2023-09-30T13:55:02.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee11c5640 1 -- 172.21.15.62:0/2664330668 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8005ea0 con 0x7feec8003970 2023-09-30T13:55:02.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee442b640 1 -- 172.21.15.62:0/2664330668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 msgr2=0x7feec8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee442b640 1 --2- 172.21.15.62:0/2664330668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feec8003d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feed8009ab0 tx=0x7feec80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee29c8640 1 -- 172.21.15.62:0/2664330668 reap_dead start 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.065+0000 7feee442b640 1 -- 172.21.15.62:0/2664330668 shutdown_connections 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.066+0000 7feee442b640 1 -- 172.21.15.62:0/2664330668 >> 172.21.15.62:0/2664330668 conn(0x7feedc06a170 msgr2=0x7feedc06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.066+0000 7feee442b640 1 -- 172.21.15.62:0/2664330668 shutdown_connections 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.066+0000 7feee442b640 1 -- 172.21.15.62:0/2664330668 wait complete. 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 Processor -- start 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 -- start start 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc153390 0x7feedc15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 0x7feedc15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc1498e0 con 0x7feec8003970 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0af390 con 0x7feedc0b0430 2023-09-30T13:55:02.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.067+0000 7feee442b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0af670 con 0x7feedc153390 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40986/0 (socket says 172.21.15.62:40986) 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 -- 172.21.15.62:0/3305000641 learned_addr learned my addr 172.21.15.62:0/3305000641 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee29c8640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 0x7feedc15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee19c6640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc153390 0x7feedc15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 -- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc153390 msgr2=0x7feedc15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc153390 0x7feedc15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 -- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 msgr2=0x7feedc15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 0x7feedc15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 -- 172.21.15.62:0/3305000641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0af950 con 0x7feec8003970 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee29c8640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 0x7feedc15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee21c7640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed8009bd0 tx=0x7feed8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8004020 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8004180 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc0afc30 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8003610 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.068+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc0aeff0 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.069+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc15c730 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.070+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7feed8003770 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.070+0000 7feed2ffd640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 0x7feec006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.070+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feed80ab6c0 con 0x7feec8003970 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.070+0000 7feee19c6640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 0x7feec006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.071+0000 7feee19c6640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 0x7feec006cff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feedc159000 tx=0x7feecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.075+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7feed80766b0 con 0x7feec8003970 2023-09-30T13:55:02.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.250+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feedc04e0d0 con 0x7feec8003970 2023-09-30T13:55:02.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.251+0000 7feed2ffd640 1 -- 172.21.15.62:0/3305000641 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7feed804c090 con 0x7feec8003970 2023-09-30T13:55:02.251 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:02.251 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 msgr2=0x7feec006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 0x7feec006cff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feedc159000 tx=0x7feecc009040 comp rx=0 tx=0).stop 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 msgr2=0x7feedc1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed8009bd0 tx=0x7feed8004730 comp rx=0 tx=0).stop 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 shutdown_connections 2023-09-30T13:55:02.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feec006ab30 0x7feec006cff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feedc0b0430 0x7feedc15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feedc153390 0x7feedc15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 --2- 172.21.15.62:0/3305000641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec8003970 0x7feedc1493a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 >> 172.21.15.62:0/3305000641 conn(0x7feedc06a170 msgr2=0x7feedc06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 shutdown_connections 2023-09-30T13:55:02.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.253+0000 7feee442b640 1 -- 172.21.15.62:0/3305000641 wait complete. 2023-09-30T13:55:02.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:02.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:02.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.373+0000 7f7a4663f640 1 Processor -- start 2023-09-30T13:55:02.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.373+0000 7f7a4663f640 1 -- start start 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a4663f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a4015cb00 0x7f7a40071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a4663f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a4015cee0 0x7f7a400c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a4663f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a400c9a00 con 0x7f7a400ae300 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a4663f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4006d740 con 0x7f7a4015cb00 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a4663f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4006da20 con 0x7f7a4015cee0 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a4015cb00 0x7f7a40071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a4015cb00 0x7f7a40071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40992/0 (socket says 172.21.15.62:40992) 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1385027149 learned_addr learned my addr 172.21.15.62:0/1385027149 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3f7fe640 1 --2- 172.21.15.62:0/1385027149 >> v2:172.21.15.135:3300/0 conn(0x7f7a4015cee0 0x7f7a400c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1385027149 >> v2:172.21.15.135:3300/0 conn(0x7f7a4015cee0 msgr2=0x7f7a400c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 --2- 172.21.15.62:0/1385027149 >> v2:172.21.15.135:3300/0 conn(0x7f7a4015cee0 0x7f7a400c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1385027149 >> v1:172.21.15.135:6789/0 conn(0x7f7a400ae300 legacy=0x7f7a4006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.374+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1385027149 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4006dd00 con 0x7f7a4015cb00 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.375+0000 7f7a3ffff640 1 --2- 172.21.15.62:0/1385027149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4015cb00 0x7f7a40071860 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a40073fa0 tx=0x7f7a3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5867d3bcaf5e4cea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.375+0000 7f7a3effd640 1 -- 172.21.15.62:0/1385027149 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34030860 con 0x7f7a4015cb00 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.375+0000 7f7a3effd640 1 -- 172.21.15.62:0/1385027149 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340309c0 con 0x7f7a4015cb00 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.375+0000 7f7a3effd640 1 -- 172.21.15.62:0/1385027149 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34030d50 con 0x7f7a4015cb00 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 -- 172.21.15.62:0/1385027149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4015cb00 msgr2=0x7f7a40071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1385027149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4015cb00 0x7f7a40071860 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a40073fa0 tx=0x7f7a3402b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 -- 172.21.15.62:0/1385027149 shutdown_connections 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1385027149 >> v2:172.21.15.135:3300/0 conn(0x7f7a4015cee0 0x7f7a400c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1385027149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4015cb00 0x7f7a40071860 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 -- 172.21.15.62:0/1385027149 >> 172.21.15.62:0/1385027149 conn(0x7f7a40070970 msgr2=0x7f7a40070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 -- 172.21.15.62:0/1385027149 shutdown_connections 2023-09-30T13:55:02.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.376+0000 7f7a4663f640 1 -- 172.21.15.62:0/1385027149 wait complete. 2023-09-30T13:55:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.377+0000 7f7a4663f640 1 Processor -- start 2023-09-30T13:55:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.377+0000 7f7a4663f640 1 -- start start 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 0x7f7a400b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a4015cee0 0x7f7a400b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b3980 con 0x7f7a400ae300 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b3c60 con 0x7f7a4015cb00 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a4663f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b3f40 con 0x7f7a4015cee0 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41002/0 (socket says 172.21.15.62:41002) 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1316321738 learned_addr learned my addr 172.21.15.62:0/1316321738 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3f7fe640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 0x7f7a400b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a44bdc640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a4015cee0 0x7f7a400b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a4015cee0 msgr2=0x7f7a400b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a4015cee0 0x7f7a400b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 msgr2=0x7f7a400b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 0x7f7a400b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 -- 172.21.15.62:0/1316321738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340094d0 con 0x7f7a400ae300 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3f7fe640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 0x7f7a400b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.378+0000 7f7a3ffff640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402b9e0 tx=0x7f7a34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.379+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34039c90 con 0x7f7a400ae300 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.379+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34039df0 con 0x7f7a400ae300 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.379+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a400b4220 con 0x7f7a400ae300 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.379+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34043640 con 0x7f7a400ae300 2023-09-30T13:55:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.379+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4014e7d0 con 0x7f7a400ae300 2023-09-30T13:55:02.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.380+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a400666d0 con 0x7f7a400ae300 2023-09-30T13:55:02.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.380+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7a340437a0 con 0x7f7a400ae300 2023-09-30T13:55:02.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.381+0000 7f7a3cff9640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 0x7f7a2c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.381+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a3403e070 con 0x7f7a400ae300 2023-09-30T13:55:02.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.381+0000 7f7a3f7fe640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 0x7f7a2c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.381+0000 7f7a3f7fe640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 0x7f7a2c06cff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c8f40 tx=0x7f7a30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.385+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7a340775a0 con 0x7f7a400ae300 2023-09-30T13:55:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.565+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a400b4740 con 0x7f7a400ae300 2023-09-30T13:55:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.565+0000 7f7a3cff9640 1 -- 172.21.15.62:0/1316321738 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a3407abc0 con 0x7f7a400ae300 2023-09-30T13:55:02.565 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 msgr2=0x7f7a2c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 0x7f7a2c06cff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c8f40 tx=0x7f7a30008040 comp rx=0 tx=0).stop 2023-09-30T13:55:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 msgr2=0x7f7a4014e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402b9e0 tx=0x7f7a34004730 comp rx=0 tx=0).stop 2023-09-30T13:55:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 shutdown_connections 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a2c06ab30 0x7f7a2c06cff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a4015cee0 0x7f7a400b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a4015cb00 0x7f7a400b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 --2- 172.21.15.62:0/1316321738 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a400ae300 0x7f7a4014e290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 >> 172.21.15.62:0/1316321738 conn(0x7f7a40070970 msgr2=0x7f7a4006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 shutdown_connections 2023-09-30T13:55:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.569+0000 7f7a4663f640 1 -- 172.21.15.62:0/1316321738 wait complete. 2023-09-30T13:55:02.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.689+0000 7f9a630e0640 1 Processor -- start 2023-09-30T13:55:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.689+0000 7f9a630e0640 1 -- start start 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a630e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a5c15e1e0 0x7f9a5c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a630e0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a5c0b15e0 0x7f9a5c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a630e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0b1350 con 0x7f9a5c15e750 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a630e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ce2d0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a630e0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0d0360 con 0x7f9a5c0b15e0 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a60e7c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a5c15e1e0 0x7f9a5c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a6167d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9a5c15e750 0x7f9a5c15ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47128/0 (socket says 172.21.15.62:47128) 2023-09-30T13:55:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a6167d640 1 -- 172.21.15.62:0/3625525502 learned_addr learned my addr 172.21.15.62:0/3625525502 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a5bfff640 1 --2- 172.21.15.62:0/3625525502 >> v2:172.21.15.135:3300/0 conn(0x7f9a5c0b15e0 0x7f9a5c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a60e7c640 1 -- 172.21.15.62:0/3625525502 >> v2:172.21.15.135:3300/0 conn(0x7f9a5c0b15e0 msgr2=0x7f9a5c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a60e7c640 1 --2- 172.21.15.62:0/3625525502 >> v2:172.21.15.135:3300/0 conn(0x7f9a5c0b15e0 0x7f9a5c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a60e7c640 1 -- 172.21.15.62:0/3625525502 >> v1:172.21.15.62:6789/0 conn(0x7f9a5c15e750 legacy=0x7f9a5c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a60e7c640 1 -- 172.21.15.62:0/3625525502 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0d17c0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.690+0000 7f9a5b7fe640 1 -- 172.21.15.62:0/3625525502 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852341511 0 0) 0x7f9a5c0b1350 con 0x7f9a5c15e750 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.691+0000 7f9a60e7c640 1 --2- 172.21.15.62:0/3625525502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c0cd120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b22b0 tx=0x7f9a5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2ba2218294c43a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.691+0000 7f9a5b7fe640 1 -- 172.21.15.62:0/3625525502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50031830 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.691+0000 7f9a5b7fe640 1 -- 172.21.15.62:0/3625525502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50031990 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.691+0000 7f9a5b7fe640 1 -- 172.21.15.62:0/3625525502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50031d20 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 -- 172.21.15.62:0/3625525502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 msgr2=0x7f9a5c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3625525502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c0cd120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b22b0 tx=0x7f9a5002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 -- 172.21.15.62:0/3625525502 shutdown_connections 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3625525502 >> v2:172.21.15.135:3300/0 conn(0x7f9a5c0b15e0 0x7f9a5c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3625525502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c0cd120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 -- 172.21.15.62:0/3625525502 >> 172.21.15.62:0/3625525502 conn(0x7f9a5c0d08e0 msgr2=0x7f9a5c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 -- 172.21.15.62:0/3625525502 shutdown_connections 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.692+0000 7f9a630e0640 1 -- 172.21.15.62:0/3625525502 wait complete. 2023-09-30T13:55:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.693+0000 7f9a630e0640 1 Processor -- start 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.693+0000 7f9a630e0640 1 -- start start 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a5c0b15e0 0x7f9a5c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a5c15e750 0x7f9a5c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c9020 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c9300 con 0x7f9a5c0b15e0 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a630e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c95e0 con 0x7f9a5c15e750 2023-09-30T13:55:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41014/0 (socket says 172.21.15.62:41014) 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 -- 172.21.15.62:0/3288629939 learned_addr learned my addr 172.21.15.62:0/3288629939 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a60e7c640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a5c0b15e0 0x7f9a5c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a6167d640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a5c15e750 0x7f9a5c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 -- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a5c15e750 msgr2=0x7f9a5c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a5c15e750 0x7f9a5c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 -- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a5c0b15e0 msgr2=0x7f9a5c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a5c0b15e0 0x7f9a5c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.694+0000 7f9a5bfff640 1 -- 172.21.15.62:0/3288629939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009400 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a5bfff640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800e870 tx=0x7f9a4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a480094f0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800c940 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c0c98c0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800ccf0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.695+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c0c8cd0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.696+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c0cebc0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.696+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9a48013470 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.696+0000 7f9a597fa640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 0x7f9a4006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.697+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a480895b0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.697+0000 7f9a60e7c640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 0x7f9a4006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.697+0000 7f9a60e7c640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 0x7f9a4006cff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a50036000 tx=0x7f9a5003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.701+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9a480545c0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.874+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a5c04e0d0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.875+0000 7f9a597fa640 1 -- 172.21.15.62:0/3288629939 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a48057be0 con 0x7f9a5c15e1e0 2023-09-30T13:55:02.875 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 msgr2=0x7f9a4006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 0x7f9a4006cff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a50036000 tx=0x7f9a5003c040 comp rx=0 tx=0).stop 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 msgr2=0x7f9a5c159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800e870 tx=0x7f9a4800ed30 comp rx=0 tx=0).stop 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 shutdown_connections 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a4006ab30 0x7f9a4006cff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a5c15e750 0x7f9a5c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5c15e1e0 0x7f9a5c159950 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 --2- 172.21.15.62:0/3288629939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a5c0b15e0 0x7f9a5c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 >> 172.21.15.62:0/3288629939 conn(0x7f9a5c0d08e0 msgr2=0x7f9a5c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 shutdown_connections 2023-09-30T13:55:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.877+0000 7f9a630e0640 1 -- 172.21.15.62:0/3288629939 wait complete. 2023-09-30T13:55:02.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.996+0000 7f794f8b4640 1 Processor -- start 2023-09-30T13:55:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.996+0000 7f794f8b4640 1 -- start start 2023-09-30T13:55:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794f8b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79480d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794f8b4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79480cd8c0 0x7f79480cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794f8b4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79480d1410 con 0x7f794815cbc0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794f8b4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79480ce290 con 0x7f79480cd8c0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794f8b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79480d16f0 con 0x7f79480b8760 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794d650640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f794815cbc0 0x7f79480d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47136/0 (socket says 172.21.15.62:47136) 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.997+0000 7f794d650640 1 -- 172.21.15.62:0/259977485 learned_addr learned my addr 172.21.15.62:0/259977485 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 --2- 172.21.15.62:0/259977485 >> v2:172.21.15.135:3300/0 conn(0x7f79480cd8c0 0x7f79480cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794ce4f640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79480d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797682344 0 0) 0x7f79480d1410 con 0x7f794815cbc0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930003520 con 0x7f794815cbc0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 745305662 0 0) 0x7f7930003520 con 0x7f794815cbc0 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 msgr2=0x7f79480d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79480d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 >> v2:172.21.15.135:3300/0 conn(0x7f79480cd8c0 msgr2=0x7f79480cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 --2- 172.21.15.62:0/259977485 >> v2:172.21.15.135:3300/0 conn(0x7f79480cd8c0 0x7f79480cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480d19d0 con 0x7f794815cbc0 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f7940001670 con 0x7f794815cbc0 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 >> v1:172.21.15.62:6789/0 conn(0x7f794815cbc0 legacy=0x7f79480d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7930003970 0x7f7930003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f7930005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79480ce290 con 0x7f7930004d00 2023-09-30T13:55:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79480d16f0 con 0x7f7930003970 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793000b980 con 0x7f79480b8760 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f7930005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794d650640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7930003970 0x7f7930003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794ce4f640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 -- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 msgr2=0x7f79300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480b8760 0x7f79300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 -- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7930003970 msgr2=0x7f7930003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7930003970 0x7f7930003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.998+0000 7f794de51640 1 -- 172.21.15.62:0/259977485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930003520 con 0x7f7930004d00 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.999+0000 7f794de51640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f7930005180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7938009fc0 tx=0x7f79300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed0dd21e98c5aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.999+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793802cc60 con 0x7f7930004d00 2023-09-30T13:55:03.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.999+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800f040 con 0x7f7930004d00 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:02.999+0000 7f7947fff640 1 -- 172.21.15.62:0/259977485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938034440 con 0x7f7930004d00 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 -- 172.21.15.62:0/259977485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 msgr2=0x7f7930005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 --2- 172.21.15.62:0/259977485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f7930005180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7938009fc0 tx=0x7f79300057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794de51640 1 -- 172.21.15.62:0/259977485 reap_dead start 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 -- 172.21.15.62:0/259977485 shutdown_connections 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 -- 172.21.15.62:0/259977485 >> 172.21.15.62:0/259977485 conn(0x7f79480718a0 msgr2=0x7f7948071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 -- 172.21.15.62:0/259977485 shutdown_connections 2023-09-30T13:55:03.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.000+0000 7f794f8b4640 1 -- 172.21.15.62:0/259977485 wait complete. 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.001+0000 7f794f8b4640 1 Processor -- start 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.001+0000 7f794f8b4640 1 -- start start 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480c5710 0x7f79480cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794815b750 0x7f794815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79480ca040 con 0x7f7930004d00 2023-09-30T13:55:03.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794815c110 con 0x7f794815b750 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794f8b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794815d270 con 0x7f79480c5710 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41034/0 (socket says 172.21.15.62:41034) 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 -- 172.21.15.62:0/3352810592 learned_addr learned my addr 172.21.15.62:0/3352810592 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794ce4f640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480c5710 0x7f79480cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794de51640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794815b750 0x7f794815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 -- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480c5710 msgr2=0x7f79480cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480c5710 0x7f79480cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 -- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794815b750 msgr2=0x7f794815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794815b750 0x7f794815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.002+0000 7f794d650640 1 -- 172.21.15.62:0/3352810592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480c8e10 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f794d650640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79400072f0 tx=0x7f79400076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000f960 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794000fac0 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79480c90f0 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000fe70 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.003+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79480cc340 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.004+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794804e0d0 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.004+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f794001e3b0 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.004+0000 7f7945ffb640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 0x7f793406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.005+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79400890a0 con 0x7f7930004d00 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.005+0000 7f794ce4f640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 0x7f793406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.005+0000 7f794ce4f640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 0x7f793406d020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79480c7ab0 tx=0x7f793c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.009+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7940054170 con 0x7f7930004d00 2023-09-30T13:55:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.182+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7948158bc0 con 0x7f7930004d00 2023-09-30T13:55:03.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.182+0000 7f7945ffb640 1 -- 172.21.15.62:0/3352810592 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7940057790 con 0x7f7930004d00 2023-09-30T13:55:03.182 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 msgr2=0x7f793406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 0x7f793406d020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79480c7ab0 tx=0x7f793c009190 comp rx=0 tx=0).stop 2023-09-30T13:55:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 msgr2=0x7f79480c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79400072f0 tx=0x7f79400076f0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 shutdown_connections 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f793406ab60 0x7f793406d020 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794815b750 0x7f794815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79480c5710 0x7f79480cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 --2- 172.21.15.62:0/3352810592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7930004d00 0x7f79480c87e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 >> 172.21.15.62:0/3352810592 conn(0x7f79480718a0 msgr2=0x7f79480c5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 shutdown_connections 2023-09-30T13:55:03.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.184+0000 7f794f8b4640 1 -- 172.21.15.62:0/3352810592 wait complete. 2023-09-30T13:55:03.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:03.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.303+0000 7fa5c0fe9640 1 Processor -- start 2023-09-30T13:55:03.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.303+0000 7fa5c0fe9640 1 -- start start 2023-09-30T13:55:03.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5c0fe9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5bc0b8760 0x7fa5bc0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5c0fe9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 0x7fa5bc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5c0fe9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0d1410 con 0x7fa5bc15cbc0 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5c0fe9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0ce290 con 0x7fa5bc0b8760 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5c0fe9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0d16f0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5b9d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5bc0b8760 0x7fa5bc0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5ba59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa5bc15cbc0 0x7fa5bc0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47140/0 (socket says 172.21.15.62:47140) 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.304+0000 7fa5ba59c640 1 -- 172.21.15.62:0/2379920947 learned_addr learned my addr 172.21.15.62:0/2379920947 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5bad9d640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 0x7fa5bc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/2379920947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 msgr2=0x7fa5bc0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b9d9b640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 0x7fa5bc0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/2379920947 >> v1:172.21.15.62:6789/0 conn(0x7fa5bc15cbc0 legacy=0x7fa5bc0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/2379920947 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0d19d0 con 0x7fa5bc0b8760 2023-09-30T13:55:03.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b959a640 1 -- 172.21.15.62:0/2379920947 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646874202 0 0) 0x7fa5bc0d1410 con 0x7fa5bc15cbc0 2023-09-30T13:55:03.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5bad9d640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 0x7fa5bc0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.305+0000 7fa5b9d9b640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0b8760 0x7fa5bc0d24b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35e207383d34110 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5b959a640 1 -- 172.21.15.62:0/2379920947 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b002cc50 con 0x7fa5bc0b8760 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5b959a640 1 -- 172.21.15.62:0/2379920947 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b002cdb0 con 0x7fa5bc0b8760 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5b959a640 1 -- 172.21.15.62:0/2379920947 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0034660 con 0x7fa5bc0b8760 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/2379920947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0b8760 msgr2=0x7fa5bc0d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0b8760 0x7fa5bc0d24b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b002bea0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/2379920947 shutdown_connections 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0cd8c0 0x7fa5bc0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/2379920947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0b8760 0x7fa5bc0d24b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/2379920947 >> 172.21.15.62:0/2379920947 conn(0x7fa5bc0718a0 msgr2=0x7fa5bc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/2379920947 shutdown_connections 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.306+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/2379920947 wait complete. 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 Processor -- start 2023-09-30T13:55:03.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 -- start start 2023-09-30T13:55:03.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0b8760 0x7fa5bc0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5bc15cbc0 0x7fa5bc0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc153f80 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1530d0 con 0x7fa5bc15cbc0 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5c0fe9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c5a30 con 0x7fa5bc0b8760 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.308+0000 7fa5b9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41042/0 (socket says 172.21.15.62:41042) 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/1481393569 learned_addr learned my addr 172.21.15.62:0/1481393569 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5ba59c640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0b8760 0x7fa5bc0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5bad9d640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5bc15cbc0 0x7fa5bc0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0b8760 msgr2=0x7fa5bc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0b8760 0x7fa5bc0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5bc15cbc0 msgr2=0x7fa5bc0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5bc15cbc0 0x7fa5bc0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 -- 172.21.15.62:0/1481393569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009a70 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5b9d9b640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0037040 tx=0x7fa5b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0040650 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b00407b0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc153300 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0040b60 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.309+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc1538c0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.310+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc04e0d0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.311+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa5b0040cc0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.311+0000 7fa5aaffd640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 0x7fa59c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.311+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5b00ac260 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.312+0000 7fa5ba59c640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 0x7fa59c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.312+0000 7fa5ba59c640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 0x7fa59c06cff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4007fd0 tx=0x7fa5b4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.315+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa5b00771e0 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.490+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa5bc0cd680 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.490+0000 7fa5aaffd640 1 -- 172.21.15.62:0/1481393569 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa5b007a800 con 0x7fa5bc0cd8c0 2023-09-30T13:55:03.490 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:03.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 msgr2=0x7fa59c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 0x7fa59c06cff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4007fd0 tx=0x7fa5b4007de0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 msgr2=0x7fa5bc152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0037040 tx=0x7fa5b0004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 shutdown_connections 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa59c06ab30 0x7fa59c06cff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5bc15cbc0 0x7fa5bc0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc0cd8c0 0x7fa5bc152b90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 --2- 172.21.15.62:0/1481393569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5bc0b8760 0x7fa5bc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 >> 172.21.15.62:0/1481393569 conn(0x7fa5bc0718a0 msgr2=0x7fa5bc071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 shutdown_connections 2023-09-30T13:55:03.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.492+0000 7fa5c0fe9640 1 -- 172.21.15.62:0/1481393569 wait complete. 2023-09-30T13:55:03.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:03.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.610+0000 7fce83716640 1 Processor -- start 2023-09-30T13:55:03.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce83716640 1 -- start start 2023-09-30T13:55:03.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce83716640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce7c0c2460 0x7fce7c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce83716640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0cd9b0 con 0x7fce7c065a20 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce83716640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c15ae80 con 0x7fce7c15aaa0 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce83716640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0ccda0 con 0x7fce7c0c2460 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce81cb3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fce7c065a20 0x7fce7c0cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47156/0 (socket says 172.21.15.62:47156) 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.611+0000 7fce81cb3640 1 -- 172.21.15.62:0/2845018342 learned_addr learned my addr 172.21.15.62:0/2845018342 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce80cb1640 1 --2- 172.21.15.62:0/2845018342 >> v2:172.21.15.135:3300/0 conn(0x7fce7c0c2460 0x7fce7c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311688674 0 0) 0x7fce7c0cd9b0 con 0x7fce7c065a20 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003520 con 0x7fce7c065a20 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce80cb1640 1 -- 172.21.15.62:0/2845018342 >> v1:172.21.15.135:6789/0 conn(0x7fce7c15aaa0 legacy=0x7fce7c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000874742 0 0) 0x7fce64003520 con 0x7fce7c065a20 2023-09-30T13:55:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce80cb1640 1 -- 172.21.15.62:0/2845018342 >> v1:172.21.15.62:6789/0 conn(0x7fce7c065a20 legacy=0x7fce7c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.612+0000 7fce80cb1640 1 -- 172.21.15.62:0/2845018342 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0cd080 con 0x7fce7c0c2460 2023-09-30T13:55:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce80cb1640 1 --2- 172.21.15.62:0/2845018342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0c2460 0x7fce7c0b1bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce700097a0 tx=0x7fce7002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f8f4c9a93d9dcd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7002f050 con 0x7fce7c0c2460 2023-09-30T13:55:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70031500 con 0x7fce7c0c2460 2023-09-30T13:55:03.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce7bfff640 1 -- 172.21.15.62:0/2845018342 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0019f0 con 0x7fce7c0c2460 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce83716640 1 -- 172.21.15.62:0/2845018342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0c2460 msgr2=0x7fce7c0b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.613+0000 7fce83716640 1 --2- 172.21.15.62:0/2845018342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0c2460 0x7fce7c0b1bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce700097a0 tx=0x7fce7002b820 comp rx=0 tx=0).stop 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.614+0000 7fce83716640 1 -- 172.21.15.62:0/2845018342 shutdown_connections 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.614+0000 7fce83716640 1 --2- 172.21.15.62:0/2845018342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c0c2460 0x7fce7c0b1bb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.614+0000 7fce83716640 1 -- 172.21.15.62:0/2845018342 >> 172.21.15.62:0/2845018342 conn(0x7fce7c0b0850 msgr2=0x7fce7c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.614+0000 7fce83716640 1 -- 172.21.15.62:0/2845018342 shutdown_connections 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.614+0000 7fce83716640 1 -- 172.21.15.62:0/2845018342 wait complete. 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 Processor -- start 2023-09-30T13:55:03.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 -- start start 2023-09-30T13:55:03.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 0x7fce7c0adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 0x7fce7c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06cfd0 con 0x7fce7c0c2460 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c09e1b0 con 0x7fce7c065a20 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.615+0000 7fce83716640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c09e490 con 0x7fce7c15aaa0 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41054/0 (socket says 172.21.15.62:41054) 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 -- 172.21.15.62:0/1387340345 learned_addr learned my addr 172.21.15.62:0/1387340345 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:03.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce814b2640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 0x7fce7c0adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce81cb3640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 0x7fce7c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 -- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 msgr2=0x7fce7c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 0x7fce7c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 -- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 msgr2=0x7fce7c0adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 0x7fce7c0adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 -- 172.21.15.62:0/1387340345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70009400 con 0x7fce7c0c2460 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce814b2640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 0x7fce7c0adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce81cb3640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 0x7fce7c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:03.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce80cb1640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c00 tx=0x7fce700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70033980 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70033b00 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c09e770 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.616+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7003e480 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.617+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c09ef70 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.618+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c09ec90 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.618+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fce7003a040 con 0x7fce7c0c2460 2023-09-30T13:55:03.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.618+0000 7fce79ffb640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 0x7fce6806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:03.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.618+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce700ab650 con 0x7fce7c0c2460 2023-09-30T13:55:03.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.619+0000 7fce814b2640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 0x7fce6806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:03.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.619+0000 7fce814b2640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 0x7fce6806cff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:03.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.623+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fce7c09ec90 con 0x7fce7c0c2460 2023-09-30T13:55:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.810+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce7c09ec90 con 0x7fce7c0c2460 2023-09-30T13:55:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.810+0000 7fce79ffb640 1 -- 172.21.15.62:0/1387340345 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fce7c09ec90 con 0x7fce7c0c2460 2023-09-30T13:55:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 msgr2=0x7fce6806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 0x7fce6806cff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74009040 comp rx=0 tx=0).stop 2023-09-30T13:55:03.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 msgr2=0x7fce7c0c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c00 tx=0x7fce700046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 shutdown_connections 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ab30 0x7fce6806cff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c15aaa0 0x7fce7c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c0c2460 0x7fce7c0c4a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 --2- 172.21.15.62:0/1387340345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c065a20 0x7fce7c0adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 >> 172.21.15.62:0/1387340345 conn(0x7fce7c0b0850 msgr2=0x7fce7c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.812+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 shutdown_connections 2023-09-30T13:55:03.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:03.813+0000 7fce83716640 1 -- 172.21.15.62:0/1387340345 wait complete. 2023-09-30T13:55:03.822 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:55:03.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:03.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-09-30T13:55:03.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[94491]: fuse finished with error 0 and tester_r 0 2023-09-30T13:55:03.853 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:03.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:55:03.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:03.891 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-09-30T13:55:03.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:04.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.105+0000 7fd908276640 1 Processor -- start 2023-09-30T13:55:04.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.105+0000 7fd908276640 1 -- start start 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd908276640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9000cdc20 0x7fd9000b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd908276640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd9000cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd908276640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000b2e50 con 0x7fd9000cef70 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd908276640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cf400 con 0x7fd9000cdc20 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd908276640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000ac2d0 con 0x7fd9000b2940 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.106+0000 7fd906012640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9000cdc20 0x7fd9000b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9000cdc20 0x7fd9000b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41070/0 (socket says 172.21.15.62:41070) 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 -- 172.21.15.62:0/870071970 learned_addr learned my addr 172.21.15.62:0/870071970 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd905811640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd9000cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 -- 172.21.15.62:0/870071970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 msgr2=0x7fd9000cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:04.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd9000cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 -- 172.21.15.62:0/870071970 >> v1:172.21.15.135:6789/0 conn(0x7fd9000cef70 legacy=0x7fd9000ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.107+0000 7fd906012640 1 -- 172.21.15.62:0/870071970 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000cc340 con 0x7fd9000cdc20 2023-09-30T13:55:04.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd906012640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cdc20 0x7fd9000b2400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009850 tx=0x7fd8f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de0612e7499506d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd905010640 1 -- 172.21.15.62:0/870071970 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004230 con 0x7fd9000cdc20 2023-09-30T13:55:04.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd905010640 1 -- 172.21.15.62:0/870071970 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0004390 con 0x7fd9000cdc20 2023-09-30T13:55:04.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd905010640 1 -- 172.21.15.62:0/870071970 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0031830 con 0x7fd9000cdc20 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 -- 172.21.15.62:0/870071970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cdc20 msgr2=0x7fd9000b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cdc20 0x7fd9000b2400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009850 tx=0x7fd8f002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 -- 172.21.15.62:0/870071970 shutdown_connections 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd9000cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 --2- 172.21.15.62:0/870071970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cdc20 0x7fd9000b2400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 -- 172.21.15.62:0/870071970 >> 172.21.15.62:0/870071970 conn(0x7fd90006a170 msgr2=0x7fd90006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 -- 172.21.15.62:0/870071970 shutdown_connections 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.108+0000 7fd908276640 1 -- 172.21.15.62:0/870071970 wait complete. 2023-09-30T13:55:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.109+0000 7fd908276640 1 Processor -- start 2023-09-30T13:55:04.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 -- start start 2023-09-30T13:55:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd900149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9000cdc20 0x7fd90014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90014c310 con 0x7fd9000cef70 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900149910 con 0x7fd9000cdc20 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd908276640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900149bf0 con 0x7fd9000b2940 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd906813640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd906813640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41072/0 (socket says 172.21.15.62:41072) 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd906813640 1 -- 172.21.15.62:0/4204561078 learned_addr learned my addr 172.21.15.62:0/4204561078 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd906012640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd900149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.110+0000 7fd905811640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9000cdc20 0x7fd90014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 -- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 msgr2=0x7fd900149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd900149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 -- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9000cdc20 msgr2=0x7fd90014bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9000cdc20 0x7fd90014bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 -- 172.21.15.62:0/4204561078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009460 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906012640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd900149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd906813640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7a0 tx=0x7fd8f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003b70 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8003cf0 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd900149ed0 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003ea0 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.111+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90014a490 con 0x7fd9000cef70 2023-09-30T13:55:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.112+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90014a6b0 con 0x7fd9000cef70 2023-09-30T13:55:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.112+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd8f800aa90 con 0x7fd9000cef70 2023-09-30T13:55:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.113+0000 7fd8f6ffd640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 0x7fd8e406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.113+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8f8089330 con 0x7fd9000cef70 2023-09-30T13:55:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.113+0000 7fd906012640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 0x7fd8e406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.114+0000 7fd906012640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 0x7fd8e406cff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0035000 tx=0x7fd8f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.117+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd8f8054200 con 0x7fd9000cef70 2023-09-30T13:55:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.293+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd90004e0d0 con 0x7fd9000cef70 2023-09-30T13:55:04.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.295+0000 7fd8f6ffd640 1 -- 172.21.15.62:0/4204561078 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fd8f8057820 con 0x7fd9000cef70 2023-09-30T13:55:04.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:04.295 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 msgr2=0x7fd8e406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 0x7fd8e406cff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0035000 tx=0x7fd8f0008030 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 msgr2=0x7fd9000c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c7a0 tx=0x7fd8f800cc60 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 shutdown_connections 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8e406ab30 0x7fd8e406cff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9000cef70 0x7fd9000c7b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9000cdc20 0x7fd90014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 --2- 172.21.15.62:0/4204561078 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9000b2940 0x7fd900149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 >> 172.21.15.62:0/4204561078 conn(0x7fd90006a170 msgr2=0x7fd900070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 shutdown_connections 2023-09-30T13:55:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.297+0000 7fd908276640 1 -- 172.21.15.62:0/4204561078 wait complete. 2023-09-30T13:55:04.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:04.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.414+0000 7f817a39e640 1 Processor -- start 2023-09-30T13:55:04.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 -- start start 2023-09-30T13:55:04.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f817415c8c0 0x7f81740d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81740cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81740d0190 con 0x7f81740cfd30 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81740b1be0 con 0x7f817415c8c0 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817a39e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81740cd210 con 0x7f81740b1fa0 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.415+0000 7f817939c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f817415c8c0 0x7f81740d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f817415c8c0 0x7f81740d31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41076/0 (socket says 172.21.15.62:41076) 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 -- 172.21.15.62:0/1834280218 learned_addr learned my addr 172.21.15.62:0/1834280218 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f8178b9b640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81740cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 -- 172.21.15.62:0/1834280218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 msgr2=0x7f81740cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81740cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 -- 172.21.15.62:0/1834280218 >> v1:172.21.15.135:6789/0 conn(0x7f81740cfd30 legacy=0x7f8174160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.416+0000 7f817939c640 1 -- 172.21.15.62:0/1834280218 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817415cca0 con 0x7f817415c8c0 2023-09-30T13:55:04.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817939c640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817415c8c0 0x7f81740d31c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8164009e50 tx=0x7f816402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9164c8f919fbe3a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f8173fff640 1 -- 172.21.15.62:0/1834280218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816402ca70 con 0x7f817415c8c0 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f8173fff640 1 -- 172.21.15.62:0/1834280218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816402cbd0 con 0x7f817415c8c0 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f8173fff640 1 -- 172.21.15.62:0/1834280218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640343f0 con 0x7f817415c8c0 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 -- 172.21.15.62:0/1834280218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817415c8c0 msgr2=0x7f81740d31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817415c8c0 0x7f81740d31c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8164009e50 tx=0x7f816402bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 -- 172.21.15.62:0/1834280218 shutdown_connections 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81740cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 --2- 172.21.15.62:0/1834280218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f817415c8c0 0x7f81740d31c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 -- 172.21.15.62:0/1834280218 >> 172.21.15.62:0/1834280218 conn(0x7f8174071660 msgr2=0x7f8174071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 -- 172.21.15.62:0/1834280218 shutdown_connections 2023-09-30T13:55:04.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.417+0000 7f817a39e640 1 -- 172.21.15.62:0/1834280218 wait complete. 2023-09-30T13:55:04.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 Processor -- start 2023-09-30T13:55:04.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 -- start start 2023-09-30T13:55:04.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81741f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 0x7f81741f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740d0c00 con 0x7f81740cfd30 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817414e930 con 0x7f817415c8c0 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.419+0000 7f817a39e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81740cbe80 con 0x7f81740b1fa0 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41090/0 (socket says 172.21.15.62:41090) 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 -- 172.21.15.62:0/386471261 learned_addr learned my addr 172.21.15.62:0/386471261 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8179b9d640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 0x7f81741f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f817939c640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81741f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 -- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 msgr2=0x7f81741f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81741f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 -- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 msgr2=0x7f81741f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 0x7f81741f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 -- 172.21.15.62:0/386471261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164009b30 con 0x7f81740cfd30 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8179b9d640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 0x7f81741f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8178b9b640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f816800d830 tx=0x7f816800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800b6c0 con 0x7f81740cfd30 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800b840 con 0x7f81740cfd30 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800bbf0 con 0x7f81740cfd30 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.420+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740cc160 con 0x7f81740cfd30 2023-09-30T13:55:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.421+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740d0820 con 0x7f81740cfd30 2023-09-30T13:55:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.421+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8174073e70 con 0x7f81740cfd30 2023-09-30T13:55:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.422+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f816801e460 con 0x7f81740cfd30 2023-09-30T13:55:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.422+0000 7f8171ffb640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 0x7f816006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.422+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8168089c60 con 0x7f81740cfd30 2023-09-30T13:55:04.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.422+0000 7f817939c640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 0x7f816006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.423+0000 7f817939c640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 0x7f816006cff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8164035000 tx=0x7f8164030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.426+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8168054c50 con 0x7f81740cfd30 2023-09-30T13:55:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.602+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8174072ec0 con 0x7f81740cfd30 2023-09-30T13:55:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.603+0000 7f8171ffb640 1 -- 172.21.15.62:0/386471261 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f8168058270 con 0x7f81740cfd30 2023-09-30T13:55:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:04.604 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 msgr2=0x7f816006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 0x7f816006cff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8164035000 tx=0x7f8164030000 comp rx=0 tx=0).stop 2023-09-30T13:55:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 msgr2=0x7f81741f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f816800d830 tx=0x7f816800dcf0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 shutdown_connections 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f816006ab30 0x7f816006cff0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f817415c8c0 0x7f81741f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81740cfd30 0x7f81741f57c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 --2- 172.21.15.62:0/386471261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81740b1fa0 0x7f81741f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.605+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 >> 172.21.15.62:0/386471261 conn(0x7f8174071660 msgr2=0x7f81740b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.606+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 shutdown_connections 2023-09-30T13:55:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.606+0000 7f817a39e640 1 -- 172.21.15.62:0/386471261 wait complete. 2023-09-30T13:55:04.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T13:55:04.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.725+0000 7ffbb78a2640 1 Processor -- start 2023-09-30T13:55:04.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.725+0000 7ffbb78a2640 1 -- start start 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb78a2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffbb006bf80 0x7ffbb00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb78a2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb00d0050 con 0x7ffbb006b070 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb78a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb006b500 con 0x7ffbb00cd960 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb78a2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb00cdd40 con 0x7ffbb006bf80 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb5e3f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffbb006bf80 0x7ffbb00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb4e3d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffbb006b070 0x7ffbb00b04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47168/0 (socket says 172.21.15.62:47168) 2023-09-30T13:55:04.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb4e3d640 1 -- 172.21.15.62:0/2542384439 learned_addr learned my addr 172.21.15.62:0/2542384439 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:04.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb5e3f640 1 -- 172.21.15.62:0/2542384439 >> v1:172.21.15.135:6789/0 conn(0x7ffbb00cd960 legacy=0x7ffbb006b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:04.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb5e3f640 1 -- 172.21.15.62:0/2542384439 >> v1:172.21.15.62:6789/0 conn(0x7ffbb006b070 legacy=0x7ffbb00b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffba7fff640 1 -- 172.21.15.62:0/2542384439 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210120617 0 0) 0x7ffbb00d0050 con 0x7ffbb006b070 2023-09-30T13:55:04.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.726+0000 7ffbb5e3f640 1 -- 172.21.15.62:0/2542384439 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00cf720 con 0x7ffbb006bf80 2023-09-30T13:55:04.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.727+0000 7ffbb5e3f640 1 --2- 172.21.15.62:0/2542384439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb00b0bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009d90 tx=0x7ffba802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68dd99ebb60c1f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.727+0000 7ffba7fff640 1 -- 172.21.15.62:0/2542384439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba802cc60 con 0x7ffbb006bf80 2023-09-30T13:55:04.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.727+0000 7ffba7fff640 1 -- 172.21.15.62:0/2542384439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba802cdc0 con 0x7ffbb006bf80 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.727+0000 7ffba7fff640 1 -- 172.21.15.62:0/2542384439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8034660 con 0x7ffbb006bf80 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 -- 172.21.15.62:0/2542384439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 msgr2=0x7ffbb00b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/2542384439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb00b0bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009d90 tx=0x7ffba802beb0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 -- 172.21.15.62:0/2542384439 shutdown_connections 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/2542384439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb00b0bd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 -- 172.21.15.62:0/2542384439 >> 172.21.15.62:0/2542384439 conn(0x7ffbb00d08e0 msgr2=0x7ffbb00d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 -- 172.21.15.62:0/2542384439 shutdown_connections 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.728+0000 7ffbb78a2640 1 -- 172.21.15.62:0/2542384439 wait complete. 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.729+0000 7ffbb78a2640 1 Processor -- start 2023-09-30T13:55:04.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.729+0000 7ffbb78a2640 1 -- start start 2023-09-30T13:55:04.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbb00cd960 0x7ffbb0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbb006f760 0x7ffbb006fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0156d50 con 0x7ffbb006bf80 2023-09-30T13:55:04.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0070110 con 0x7ffbb00cd960 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb78a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0155770 con 0x7ffbb006f760 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41104/0 (socket says 172.21.15.62:41104) 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 -- 172.21.15.62:0/3022402730 learned_addr learned my addr 172.21.15.62:0/3022402730 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb4e3d640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbb00cd960 0x7ffbb0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb5e3f640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbb006f760 0x7ffbb006fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 -- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbb006f760 msgr2=0x7ffbb006fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbb006f760 0x7ffbb006fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 -- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbb00cd960 msgr2=0x7ffbb0154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbb00cd960 0x7ffbb0154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 -- 172.21.15.62:0/3022402730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8009a70 con 0x7ffbb006bf80 2023-09-30T13:55:04.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffbb563e640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c430 tx=0x7ffbac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011790 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.730+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0118f0 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.731+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb0155a50 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.731+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011ce0 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.731+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb0156010 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.732+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb004e0d0 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.732+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ffbac01c460 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.732+0000 7ffba5ffb640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 0x7ffb9406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.733+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffbac089300 con 0x7ffbb006bf80 2023-09-30T13:55:04.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.733+0000 7ffbb4e3d640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 0x7ffb9406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:04.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.733+0000 7ffbb4e3d640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 0x7ffb9406cff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0158ca0 tx=0x7ffba0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:04.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.737+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ffbac054310 con 0x7ffbb006bf80 2023-09-30T13:55:04.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:04.949+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffbb0066ca0 con 0x7ffbb006bf80 2023-09-30T13:55:05.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.485+0000 7ffba5ffb640 1 -- 172.21.15.62:0/3022402730 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffbac057930 con 0x7ffbb006bf80 2023-09-30T13:55:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 msgr2=0x7ffb9406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 0x7ffb9406cff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0158ca0 tx=0x7ffba0007de0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 msgr2=0x7ffbb0156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00c430 tx=0x7ffbac00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 shutdown_connections 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb9406ab30 0x7ffb9406cff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbb006f760 0x7ffbb006fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbb00cd960 0x7ffbb0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 --2- 172.21.15.62:0/3022402730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbb006bf80 0x7ffbb0156810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 >> 172.21.15.62:0/3022402730 conn(0x7ffbb00d08e0 msgr2=0x7ffbb00b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 shutdown_connections 2023-09-30T13:55:05.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.488+0000 7ffbb78a2640 1 -- 172.21.15.62:0/3022402730 wait complete. 2023-09-30T13:55:05.501 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-09-30T13:55:05.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T13:55:05.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.617+0000 7f7e605a9640 1 Processor -- start 2023-09-30T13:55:05.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.617+0000 7f7e605a9640 1 -- start start 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e605a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 0x7f7e580b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e605a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e580b4230 0x7f7e58070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e605a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5815b190 con 0x7f7e580b2160 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e605a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5815afa0 con 0x7f7e580b4230 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e605a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5815b470 con 0x7f7e580b0c40 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5eb46640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e580b4230 0x7f7e58070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5e345640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7e580b2160 0x7f7e580b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47182/0 (socket says 172.21.15.62:47182) 2023-09-30T13:55:05.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5e345640 1 -- 172.21.15.62:0/2096415810 learned_addr learned my addr 172.21.15.62:0/2096415810 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5db44640 1 --2- 172.21.15.62:0/2096415810 >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 0x7f7e580b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5eb46640 1 -- 172.21.15.62:0/2096415810 >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 msgr2=0x7f7e580b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5eb46640 1 --2- 172.21.15.62:0/2096415810 >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 0x7f7e580b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5eb46640 1 -- 172.21.15.62:0/2096415810 >> v1:172.21.15.62:6789/0 conn(0x7f7e580b2160 legacy=0x7f7e580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5d343640 1 -- 172.21.15.62:0/2096415810 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999317115 0 0) 0x7f7e5815b190 con 0x7f7e580b2160 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5eb46640 1 -- 172.21.15.62:0/2096415810 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5815b750 con 0x7f7e580b4230 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.618+0000 7f7e5db44640 1 --2- 172.21.15.62:0/2096415810 >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 0x7f7e580b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.619+0000 7f7e5eb46640 1 --2- 172.21.15.62:0/2096415810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b4230 0x7f7e58070160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e580cbe60 tx=0x7f7e5002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c15886623063f97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.619+0000 7f7e5d343640 1 -- 172.21.15.62:0/2096415810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5002cc80 con 0x7f7e580b4230 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.619+0000 7f7e5d343640 1 -- 172.21.15.62:0/2096415810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5002cde0 con 0x7f7e580b4230 2023-09-30T13:55:05.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.619+0000 7f7e5d343640 1 -- 172.21.15.62:0/2096415810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50034660 con 0x7f7e580b4230 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 -- 172.21.15.62:0/2096415810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b4230 msgr2=0x7f7e58070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2096415810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b4230 0x7f7e58070160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e580cbe60 tx=0x7f7e5002bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 -- 172.21.15.62:0/2096415810 shutdown_connections 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2096415810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b4230 0x7f7e58070160 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2096415810 >> v2:172.21.15.135:3300/0 conn(0x7f7e580b0c40 0x7f7e580b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 -- 172.21.15.62:0/2096415810 >> 172.21.15.62:0/2096415810 conn(0x7f7e580cb720 msgr2=0x7f7e580ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 -- 172.21.15.62:0/2096415810 shutdown_connections 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.620+0000 7f7e605a9640 1 -- 172.21.15.62:0/2096415810 wait complete. 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.621+0000 7f7e605a9640 1 Processor -- start 2023-09-30T13:55:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.621+0000 7f7e605a9640 1 -- start start 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e580b0c40 0x7f7e58159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e580b4230 0x7f7e580ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580ad230 con 0x7f7e580b2160 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58141a70 con 0x7f7e580b0c40 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e605a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5813a6b0 con 0x7f7e580b4230 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41128/0 (socket says 172.21.15.62:41128) 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 -- 172.21.15.62:0/2128880118 learned_addr learned my addr 172.21.15.62:0/2128880118 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5e345640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e580b0c40 0x7f7e58159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5eb46640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e580b4230 0x7f7e580ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 -- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e580b4230 msgr2=0x7f7e580ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e580b4230 0x7f7e580ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 -- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e580b0c40 msgr2=0x7f7e58159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e580b0c40 0x7f7e58159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 -- 172.21.15.62:0/2128880118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50009a70 con 0x7f7e580b2160 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.622+0000 7f7e5db44640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c7c0 tx=0x7f7e4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.623+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007820 con 0x7f7e580b2160 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.623+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48007980 con 0x7f7e580b2160 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.623+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e58158ba0 con 0x7f7e580b2160 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.623+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007d10 con 0x7f7e580b2160 2023-09-30T13:55:05.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.623+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e58159160 con 0x7f7e580b2160 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.624+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5804e0d0 con 0x7f7e580b2160 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.624+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7e480113f0 con 0x7f7e580b2160 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.624+0000 7f7e4effd640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 0x7f7e3c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.624+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e48089620 con 0x7f7e580b2160 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.625+0000 7f7e5e345640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 0x7f7e3c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.625+0000 7f7e5e345640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 0x7f7e3c06cff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000f60 tx=0x7f7e54007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.629+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7e480544f0 con 0x7f7e580b2160 2023-09-30T13:55:05.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:05.841+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e580ad460 con 0x7f7e580b2160 2023-09-30T13:55:06.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.495+0000 7f7e4effd640 1 -- 172.21.15.62:0/2128880118 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e48057b10 con 0x7f7e580b2160 2023-09-30T13:55:06.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 msgr2=0x7f7e3c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 0x7f7e3c06cff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000f60 tx=0x7f7e54007b50 comp rx=0 tx=0).stop 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 msgr2=0x7f7e580accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c7c0 tx=0x7f7e4800cc80 comp rx=0 tx=0).stop 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 shutdown_connections 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7e3c06ab30 0x7f7e3c06cff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e580b4230 0x7f7e580ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e580b2160 0x7f7e580accf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 --2- 172.21.15.62:0/2128880118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e580b0c40 0x7f7e58159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 >> 172.21.15.62:0/2128880118 conn(0x7f7e580cb720 msgr2=0x7f7e58070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:06.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 shutdown_connections 2023-09-30T13:55:06.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.497+0000 7f7e605a9640 1 -- 172.21.15.62:0/2128880118 wait complete. 2023-09-30T13:55:06.509 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T13:55:06.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:06.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 Processor -- start 2023-09-30T13:55:06.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 -- start start 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cea30 0x7fdbd40cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbd40ab250 0x7fdbd40ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40cf3d0 con 0x7fdbd40cdc20 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40b2e50 con 0x7fdbd40ab250 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd9f78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40ac2d0 con 0x7fdbd40cea30 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbd40ab250 0x7fdbd40ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd37fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdbd40cdc20 0x7fdbd40b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47198/0 (socket says 172.21.15.62:47198) 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.619+0000 7fdbd37fe640 1 -- 172.21.15.62:0/3697684032 learned_addr learned my addr 172.21.15.62:0/3697684032 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:06.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd2ffd640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cea30 0x7fdbd40cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd3fff640 1 -- 172.21.15.62:0/3697684032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cea30 msgr2=0x7fdbd40cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd3fff640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cea30 0x7fdbd40cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd3fff640 1 -- 172.21.15.62:0/3697684032 >> v1:172.21.15.62:6789/0 conn(0x7fdbd40cdc20 legacy=0x7fdbd40b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd27fc640 1 -- 172.21.15.62:0/3697684032 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509433548 0 0) 0x7fdbd40cf3d0 con 0x7fdbd40cdc20 2023-09-30T13:55:06.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.620+0000 7fdbd3fff640 1 -- 172.21.15.62:0/3697684032 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40cc340 con 0x7fdbd40ab250 2023-09-30T13:55:06.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd3fff640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40ab250 0x7fdbd40ab6e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009d90 tx=0x7fdbcc02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f0e42d4468adb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd27fc640 1 -- 172.21.15.62:0/3697684032 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02cbc0 con 0x7fdbd40ab250 2023-09-30T13:55:06.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd27fc640 1 -- 172.21.15.62:0/3697684032 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02cd20 con 0x7fdbd40ab250 2023-09-30T13:55:06.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd27fc640 1 -- 172.21.15.62:0/3697684032 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc034660 con 0x7fdbd40ab250 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 -- 172.21.15.62:0/3697684032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40ab250 msgr2=0x7fdbd40ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40ab250 0x7fdbd40ab6e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009d90 tx=0x7fdbcc02be10 comp rx=0 tx=0).stop 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 -- 172.21.15.62:0/3697684032 shutdown_connections 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40ab250 0x7fdbd40ab6e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/3697684032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cea30 0x7fdbd40cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 -- 172.21.15.62:0/3697684032 >> 172.21.15.62:0/3697684032 conn(0x7fdbd406a170 msgr2=0x7fdbd406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 -- 172.21.15.62:0/3697684032 shutdown_connections 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.621+0000 7fdbd9f78640 1 -- 172.21.15.62:0/3697684032 wait complete. 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.622+0000 7fdbd9f78640 1 Processor -- start 2023-09-30T13:55:06.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 -- start start 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd40ab250 0x7fdbd4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cdc20 0x7fdbd40998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40983d0 con 0x7fdbd40cea30 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4098620 con 0x7fdbd40ab250 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.623+0000 7fdbd9f78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4098900 con 0x7fdbd40cdc20 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41146/0 (socket says 172.21.15.62:41146) 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 -- 172.21.15.62:0/2904188749 learned_addr learned my addr 172.21.15.62:0/2904188749 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd37fe640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd40ab250 0x7fdbd4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 -- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cdc20 msgr2=0x7fdbd40998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd2ffd640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cdc20 0x7fdbd40998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cdc20 0x7fdbd40998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 -- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd40ab250 msgr2=0x7fdbd4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd40ab250 0x7fdbd4159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 -- 172.21.15.62:0/2904188749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009a70 con 0x7fdbd40cea30 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd3fff640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009d90 tx=0x7fdbcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc003b90 con 0x7fdbd40cea30 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02ce90 con 0x7fdbd40cea30 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc004030 con 0x7fdbd40cea30 2023-09-30T13:55:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd4098be0 con 0x7fdbd40cea30 2023-09-30T13:55:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.624+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd40991a0 con 0x7fdbd40cea30 2023-09-30T13:55:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.625+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd404e0d0 con 0x7fdbd40cea30 2023-09-30T13:55:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.626+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdbcc03b050 con 0x7fdbd40cea30 2023-09-30T13:55:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.626+0000 7fdbbbfff640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 0x7fdbc006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.626+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbcc0ab8a0 con 0x7fdbd40cea30 2023-09-30T13:55:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.626+0000 7fdbd37fe640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 0x7fdbc006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.627+0000 7fdbd37fe640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 0x7fdbc006cff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80010e0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.630+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fdbcc076890 con 0x7fdbd40cea30 2023-09-30T13:55:06.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.841+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbd4099690 con 0x7fdbd40cea30 2023-09-30T13:55:06.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.842+0000 7fdbbbfff640 1 -- 172.21.15.62:0/2904188749 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fdbcc079eb0 con 0x7fdbd40cea30 2023-09-30T13:55:06.842 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:06.842 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:06.842 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:06.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 msgr2=0x7fdbc006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 0x7fdbc006cff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80010e0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 msgr2=0x7fdbd4099df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009d90 tx=0x7fdbcc004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 shutdown_connections 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdbc006ab30 0x7fdbc006cff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbd40cea30 0x7fdbd4099df0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbd40cdc20 0x7fdbd40998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 --2- 172.21.15.62:0/2904188749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbd40ab250 0x7fdbd4159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 >> 172.21.15.62:0/2904188749 conn(0x7fdbd406a170 msgr2=0x7fdbd415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 shutdown_connections 2023-09-30T13:55:06.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.844+0000 7fdbd9f78640 1 -- 172.21.15.62:0/2904188749 wait complete. 2023-09-30T13:55:06.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.960+0000 7f9c8e34e640 1 Processor -- start 2023-09-30T13:55:06.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.960+0000 7f9c8e34e640 1 -- start start 2023-09-30T13:55:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8e34e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 0x7f9c88069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8e34e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 0x7f9c8806a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8e34e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8815aed0 con 0x7f9c8806dd60 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8e34e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c880b50a0 con 0x7f9c880b48e0 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8e34e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880b1670 con 0x7f9c880c26f0 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c87fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9c8806dd60 0x7f9c8806e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47200/0 (socket says 172.21.15.62:47200) 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c87fff640 1 -- 172.21.15.62:0/2675241984 learned_addr learned my addr 172.21.15.62:0/2675241984 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c877fe640 1 --2- 172.21.15.62:0/2675241984 >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 0x7f9c88069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/2675241984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 0x7f9c8806a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555534148 0 0) 0x7f9c8815aed0 con 0x7f9c8806dd60 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.961+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c70003520 con 0x7f9c8806dd60 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978686267 0 0) 0x7f9c70003520 con 0x7f9c8806dd60 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/2675241984 >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 msgr2=0x7f9c88069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/2675241984 >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 0x7f9c88069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/2675241984 >> v1:172.21.15.62:6789/0 conn(0x7f9c8806dd60 legacy=0x7f9c8806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/2675241984 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88066070 con 0x7f9c880c26f0 2023-09-30T13:55:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c877fe640 1 --2- 172.21.15.62:0/2675241984 >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 0x7f9c88069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.962+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/2675241984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 0x7f9c8806a290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009d90 tx=0x7f9c8002bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ce3b72ee0cd269 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c001670 con 0x7f9c880c26f0 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8002c780 con 0x7f9c880c26f0 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c86ffd640 1 -- 172.21.15.62:0/2675241984 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8002caf0 con 0x7f9c880c26f0 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 -- 172.21.15.62:0/2675241984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 msgr2=0x7f9c8806a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/2675241984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 0x7f9c8806a290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009d90 tx=0x7f9c8002bc50 comp rx=0 tx=0).stop 2023-09-30T13:55:06.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 -- 172.21.15.62:0/2675241984 shutdown_connections 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/2675241984 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880c26f0 0x7f9c8806a290 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/2675241984 >> v2:172.21.15.135:3300/0 conn(0x7f9c880b48e0 0x7f9c88069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 -- 172.21.15.62:0/2675241984 >> 172.21.15.62:0/2675241984 conn(0x7f9c880b0b50 msgr2=0x7f9c880b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 -- 172.21.15.62:0/2675241984 shutdown_connections 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.963+0000 7f9c8e34e640 1 -- 172.21.15.62:0/2675241984 wait complete. 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.964+0000 7f9c8e34e640 1 Processor -- start 2023-09-30T13:55:06.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 -- start start 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c8806dd60 0x7f9c8809ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880b48e0 0x7f9c880c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881f1cd0 con 0x7f9c880c26f0 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880c5b20 con 0x7f9c8806dd60 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8e34e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8809fd20 con 0x7f9c880b48e0 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8c8eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8c8eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41162/0 (socket says 172.21.15.62:41162) 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.965+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/6837513 learned_addr learned my addr 172.21.15.62:0/6837513 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:06.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c87fff640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c8806dd60 0x7f9c8809ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c877fe640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880b48e0 0x7f9c880c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880b48e0 msgr2=0x7f9c880c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880b48e0 0x7f9c880c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c8806dd60 msgr2=0x7f9c8809ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c8806dd60 0x7f9c8809ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 -- 172.21.15.62:0/6837513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009400 con 0x7f9c880c26f0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8c8eb640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e80 tx=0x7f9c80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80035c40 con 0x7f9c880c26f0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80035dc0 con 0x7f9c880c26f0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8003e650 con 0x7f9c880c26f0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c80009a70 con 0x7f9c880c26f0 2023-09-30T13:55:06.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.966+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8809f760 con 0x7f9c880c26f0 2023-09-30T13:55:06.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.967+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8804e0d0 con 0x7f9c880c26f0 2023-09-30T13:55:06.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.968+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9c8003b050 con 0x7f9c880c26f0 2023-09-30T13:55:06.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.968+0000 7f9c84ff9640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 0x7f9c7406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:06.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.968+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c800ab2f0 con 0x7f9c880c26f0 2023-09-30T13:55:06.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.968+0000 7f9c87fff640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 0x7f9c7406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:06.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.969+0000 7f9c87fff640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 0x7f9c7406cff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c006ad0 tx=0x7f9c7c001d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:06.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:06.972+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9c80076300 con 0x7f9c880c26f0 2023-09-30T13:55:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.151+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c880cb900 con 0x7f9c880c26f0 2023-09-30T13:55:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.153+0000 7f9c84ff9640 1 -- 172.21.15.62:0/6837513 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f9c80079920 con 0x7f9c880c26f0 2023-09-30T13:55:07.152 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:07.153 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 msgr2=0x7f9c7406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 0x7f9c7406cff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c006ad0 tx=0x7f9c7c001d20 comp rx=0 tx=0).stop 2023-09-30T13:55:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 msgr2=0x7f9c88157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e80 tx=0x7f9c80004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 shutdown_connections 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c7406ab30 0x7f9c7406cff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c880c26f0 0x7f9c88157620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c880b48e0 0x7f9c880c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 --2- 172.21.15.62:0/6837513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c8806dd60 0x7f9c8809ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.154+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 >> 172.21.15.62:0/6837513 conn(0x7f9c880b0b50 msgr2=0x7f9c880b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.155+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 shutdown_connections 2023-09-30T13:55:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.155+0000 7f9c8e34e640 1 -- 172.21.15.62:0/6837513 wait complete. 2023-09-30T13:55:07.165 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T13:55:07.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:55:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.271+0000 7f5f3a353640 1 Processor -- start 2023-09-30T13:55:07.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.271+0000 7f5f3a353640 1 -- start start 2023-09-30T13:55:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f3a353640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f340cdf30 0x7f5f34167af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f3a353640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3415d0d0 con 0x7f5f340d2500 2023-09-30T13:55:07.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f3a353640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f341608f0 con 0x7f5f3415ccf0 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f3a353640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f340b8a80 con 0x7f5f340cdf30 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f388f0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f340cdf30 0x7f5f34167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f388f0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f340cdf30 0x7f5f34167af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41170/0 (socket says 172.21.15.62:41170) 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f388f0640 1 -- 172.21.15.62:0/1421260173 learned_addr learned my addr 172.21.15.62:0/1421260173 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.272+0000 7f5f337fe640 1 --1- 172.21.15.62:0/1421260173 >> v1:172.21.15.62:6789/0 conn(0x7f5f340d2500 0x7f5f340cd820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47216/0 (socket says 172.21.15.62:47216) 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.273+0000 7f5f388f0640 1 -- 172.21.15.62:0/1421260173 >> v1:172.21.15.135:6789/0 conn(0x7f5f3415ccf0 legacy=0x7f5f340b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.273+0000 7f5f388f0640 1 -- 172.21.15.62:0/1421260173 >> v1:172.21.15.62:6789/0 conn(0x7f5f340d2500 legacy=0x7f5f340cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.273+0000 7f5f32ffd640 1 -- 172.21.15.62:0/1421260173 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996238825 0 0) 0x7f5f3415d0d0 con 0x7f5f340d2500 2023-09-30T13:55:07.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.273+0000 7f5f388f0640 1 -- 172.21.15.62:0/1421260173 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34160bd0 con 0x7f5f340cdf30 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.273+0000 7f5f388f0640 1 --2- 172.21.15.62:0/1421260173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f34167af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009e50 tx=0x7f5f2c02bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7f441b5ca42155 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f32ffd640 1 -- 172.21.15.62:0/1421260173 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c02cb30 con 0x7f5f340cdf30 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f32ffd640 1 -- 172.21.15.62:0/1421260173 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c02cc90 con 0x7f5f340cdf30 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f32ffd640 1 -- 172.21.15.62:0/1421260173 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0343f0 con 0x7f5f340cdf30 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 -- 172.21.15.62:0/1421260173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 msgr2=0x7f5f34167af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 --2- 172.21.15.62:0/1421260173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f34167af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009e50 tx=0x7f5f2c02bf90 comp rx=0 tx=0).stop 2023-09-30T13:55:07.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 -- 172.21.15.62:0/1421260173 shutdown_connections 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 --2- 172.21.15.62:0/1421260173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f34167af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 -- 172.21.15.62:0/1421260173 >> 172.21.15.62:0/1421260173 conn(0x7f5f34071480 msgr2=0x7f5f34071890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 -- 172.21.15.62:0/1421260173 shutdown_connections 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.274+0000 7f5f3a353640 1 -- 172.21.15.62:0/1421260173 wait complete. 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.275+0000 7f5f3a353640 1 Processor -- start 2023-09-30T13:55:07.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 -- start start 2023-09-30T13:55:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f340d2500 0x7f5f3415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3415ccf0 0x7f5f340cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340c9ff0 con 0x7f5f340cdf30 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340c9ca0 con 0x7f5f3415ccf0 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f3a353640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3415e290 con 0x7f5f340d2500 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f33fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f33fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41182/0 (socket says 172.21.15.62:41182) 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.276+0000 7f5f33fff640 1 -- 172.21.15.62:0/2977658828 learned_addr learned my addr 172.21.15.62:0/2977658828 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f337fe640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f340d2500 0x7f5f3415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f388f0640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3415ccf0 0x7f5f340cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 -- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f340d2500 msgr2=0x7f5f3415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f340d2500 0x7f5f3415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 -- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3415ccf0 msgr2=0x7f5f340cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3415ccf0 0x7f5f340cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 -- 172.21.15.62:0/2977658828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009b30 con 0x7f5f340cdf30 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f33fff640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c450 tx=0x7f5f2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240052d0 con 0x7f5f340cdf30 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24005430 con 0x7f5f340cdf30 2023-09-30T13:55:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24012870 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3415e570 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.277+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f340cc9e0 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.278+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f340c9b00 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.279+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5f240129d0 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.279+0000 7f5f30ff9640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 0x7f5f2006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.279+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f24088e10 con 0x7f5f340cdf30 2023-09-30T13:55:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.279+0000 7f5f337fe640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 0x7f5f2006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.280+0000 7f5f337fe640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 0x7f5f2006d020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f340b7cb0 tx=0x7f5f28007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.283+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5f340c9b00 con 0x7f5f340cdf30 2023-09-30T13:55:07.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.455+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f34161190 con 0x7f5f2006ab60 2023-09-30T13:55:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.465+0000 7f5f30ff9640 1 -- 172.21.15.62:0/2977658828 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7f5f28004c70 con 0x7f5f2006ab60 2023-09-30T13:55:07.468 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:07.470 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:55:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 msgr2=0x7f5f2006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 0x7f5f2006d020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f340b7cb0 tx=0x7f5f28007f00 comp rx=0 tx=0).stop 2023-09-30T13:55:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 msgr2=0x7f5f3415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c450 tx=0x7f5f2400c910 comp rx=0 tx=0).stop 2023-09-30T13:55:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 shutdown_connections 2023-09-30T13:55:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5f2006ab60 0x7f5f2006d020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3415ccf0 0x7f5f340cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f340d2500 0x7f5f3415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 --2- 172.21.15.62:0/2977658828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f340cdf30 0x7f5f3415dcb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 >> 172.21.15.62:0/2977658828 conn(0x7f5f34071480 msgr2=0x7f5f340d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 shutdown_connections 2023-09-30T13:55:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.469+0000 7f5f3a353640 1 -- 172.21.15.62:0/2977658828 wait complete. 2023-09-30T13:55:07.479 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-09-30T13:55:05.675911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1987972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.282533"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454383+0000","last_change":"2023-09-30T13:54:49.420957+0000","last_active":"2023-09-30T13:54:54.454383+0000","last_peered":"2023-09-30T13:54:54.454383+0000","last_clean":"2023-09-30T13:54:54.454383+0000","last_became_active":"2023-09-30T13:54:49.420645+0000","last_became_peered":"2023-09-30T13:54:49.420645+0000","last_unstale":"2023-09-30T13:54:54.454383+0000","last_undegraded":"2023-09-30T13:54:54.454383+0000","last_fullsized":"2023-09-30T13:54:54.454383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440525+0000","last_change":"2023-09-30T13:54:50.403409+0000","last_active":"2023-09-30T13:54:54.440525+0000","last_peered":"2023-09-30T13:54:54.440525+0000","last_clean":"2023-09-30T13:54:54.440525+0000","last_became_active":"2023-09-30T13:54:50.403080+0000","last_became_peered":"2023-09-30T13:54:50.403080+0000","last_unstale":"2023-09-30T13:54:54.440525+0000","last_undegraded":"2023-09-30T13:54:54.440525+0000","last_fullsized":"2023-09-30T13:54:54.440525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394904+0000","last_change":"2023-09-30T13:54:54.461252+0000","last_active":"2023-09-30T13:54:55.394904+0000","last_peered":"2023-09-30T13:54:55.394904+0000","last_clean":"2023-09-30T13:54:55.394904+0000","last_became_active":"2023-09-30T13:54:54.460732+0000","last_became_peered":"2023-09-30T13:54:54.460732+0000","last_unstale":"2023-09-30T13:54:55.394904+0000","last_undegraded":"2023-09-30T13:54:55.394904+0000","last_fullsized":"2023-09-30T13:54:55.394904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440632+0000","last_change":"2023-09-30T13:54:49.417394+0000","last_active":"2023-09-30T13:54:54.440632+0000","last_peered":"2023-09-30T13:54:54.440632+0000","last_clean":"2023-09-30T13:54:54.440632+0000","last_became_active":"2023-09-30T13:54:49.417129+0000","last_became_peered":"2023-09-30T13:54:49.417129+0000","last_unstale":"2023-09-30T13:54:54.440632+0000","last_undegraded":"2023-09-30T13:54:54.440632+0000","last_fullsized":"2023-09-30T13:54:54.440632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454087+0000","last_change":"2023-09-30T13:54:50.412921+0000","last_active":"2023-09-30T13:54:54.454087+0000","last_peered":"2023-09-30T13:54:54.454087+0000","last_clean":"2023-09-30T13:54:54.454087+0000","last_became_active":"2023-09-30T13:54:50.412639+0000","last_became_peered":"2023-09-30T13:54:50.412639+0000","last_unstale":"2023-09-30T13:54:54.454087+0000","last_undegraded":"2023-09-30T13:54:54.454087+0000","last_fullsized":"2023-09-30T13:54:54.454087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395450+0000","last_change":"2023-09-30T13:54:54.451254+0000","last_active":"2023-09-30T13:54:55.395450+0000","last_peered":"2023-09-30T13:54:55.395450+0000","last_clean":"2023-09-30T13:54:55.395450+0000","last_became_active":"2023-09-30T13:54:54.450838+0000","last_became_peered":"2023-09-30T13:54:54.450838+0000","last_unstale":"2023-09-30T13:54:55.395450+0000","last_undegraded":"2023-09-30T13:54:55.395450+0000","last_fullsized":"2023-09-30T13:54:55.395450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:29.042314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458680+0000","last_change":"2023-09-30T13:54:49.419160+0000","last_active":"2023-09-30T13:54:54.458680+0000","last_peered":"2023-09-30T13:54:54.458680+0000","last_clean":"2023-09-30T13:54:54.458680+0000","last_became_active":"2023-09-30T13:54:49.418836+0000","last_became_peered":"2023-09-30T13:54:49.418836+0000","last_unstale":"2023-09-30T13:54:54.458680+0000","last_undegraded":"2023-09-30T13:54:54.458680+0000","last_fullsized":"2023-09-30T13:54:54.458680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450093+0000","last_change":"2023-09-30T13:54:50.412155+0000","last_active":"2023-09-30T13:54:54.450093+0000","last_peered":"2023-09-30T13:54:54.450093+0000","last_clean":"2023-09-30T13:54:54.450093+0000","last_became_active":"2023-09-30T13:54:50.411864+0000","last_became_peered":"2023-09-30T13:54:50.411864+0000","last_unstale":"2023-09-30T13:54:54.450093+0000","last_undegraded":"2023-09-30T13:54:54.450093+0000","last_fullsized":"2023-09-30T13:54:54.450093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395306+0000","last_change":"2023-09-30T13:54:54.462010+0000","last_active":"2023-09-30T13:54:55.395306+0000","last_peered":"2023-09-30T13:54:55.395306+0000","last_clean":"2023-09-30T13:54:55.395306+0000","last_became_active":"2023-09-30T13:54:54.461058+0000","last_became_peered":"2023-09-30T13:54:54.461058+0000","last_unstale":"2023-09-30T13:54:55.395306+0000","last_undegraded":"2023-09-30T13:54:55.395306+0000","last_fullsized":"2023-09-30T13:54:55.395306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:25.190712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458145+0000","last_change":"2023-09-30T13:54:49.427182+0000","last_active":"2023-09-30T13:54:54.458145+0000","last_peered":"2023-09-30T13:54:54.458145+0000","last_clean":"2023-09-30T13:54:54.458145+0000","last_became_active":"2023-09-30T13:54:49.426903+0000","last_became_peered":"2023-09-30T13:54:49.426903+0000","last_unstale":"2023-09-30T13:54:54.458145+0000","last_undegraded":"2023-09-30T13:54:54.458145+0000","last_fullsized":"2023-09-30T13:54:54.458145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:03.302440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450403+0000","last_change":"2023-09-30T13:54:50.417073+0000","last_active":"2023-09-30T13:54:54.450403+0000","last_peered":"2023-09-30T13:54:54.450403+0000","last_clean":"2023-09-30T13:54:54.450403+0000","last_became_active":"2023-09-30T13:54:50.416801+0000","last_became_peered":"2023-09-30T13:54:50.416801+0000","last_unstale":"2023-09-30T13:54:54.450403+0000","last_undegraded":"2023-09-30T13:54:54.450403+0000","last_fullsized":"2023-09-30T13:54:54.450403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395323+0000","last_change":"2023-09-30T13:54:54.458847+0000","last_active":"2023-09-30T13:54:55.395323+0000","last_peered":"2023-09-30T13:54:55.395323+0000","last_clean":"2023-09-30T13:54:55.395323+0000","last_became_active":"2023-09-30T13:54:54.457421+0000","last_became_peered":"2023-09-30T13:54:54.457421+0000","last_unstale":"2023-09-30T13:54:55.395323+0000","last_undegraded":"2023-09-30T13:54:55.395323+0000","last_fullsized":"2023-09-30T13:54:55.395323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:58.531700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445534+0000","last_change":"2023-09-30T13:54:50.421056+0000","last_active":"2023-09-30T13:54:54.445534+0000","last_peered":"2023-09-30T13:54:54.445534+0000","last_clean":"2023-09-30T13:54:54.445534+0000","last_became_active":"2023-09-30T13:54:50.420770+0000","last_became_peered":"2023-09-30T13:54:50.420770+0000","last_unstale":"2023-09-30T13:54:54.445534+0000","last_undegraded":"2023-09-30T13:54:54.445534+0000","last_fullsized":"2023-09-30T13:54:54.445534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458473+0000","last_change":"2023-09-30T13:54:49.422297+0000","last_active":"2023-09-30T13:54:54.458473+0000","last_peered":"2023-09-30T13:54:54.458473+0000","last_clean":"2023-09-30T13:54:54.458473+0000","last_became_active":"2023-09-30T13:54:49.422032+0000","last_became_peered":"2023-09-30T13:54:49.422032+0000","last_unstale":"2023-09-30T13:54:54.458473+0000","last_undegraded":"2023-09-30T13:54:54.458473+0000","last_fullsized":"2023-09-30T13:54:54.458473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395905+0000","last_change":"2023-09-30T13:54:54.456854+0000","last_active":"2023-09-30T13:54:55.395905+0000","last_peered":"2023-09-30T13:54:55.395905+0000","last_clean":"2023-09-30T13:54:55.395905+0000","last_became_active":"2023-09-30T13:54:54.456476+0000","last_became_peered":"2023-09-30T13:54:54.456476+0000","last_unstale":"2023-09-30T13:54:55.395905+0000","last_undegraded":"2023-09-30T13:54:55.395905+0000","last_fullsized":"2023-09-30T13:54:55.395905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:28.802733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440683+0000","last_change":"2023-09-30T13:54:50.410713+0000","last_active":"2023-09-30T13:54:54.440683+0000","last_peered":"2023-09-30T13:54:54.440683+0000","last_clean":"2023-09-30T13:54:54.440683+0000","last_became_active":"2023-09-30T13:54:50.410454+0000","last_became_peered":"2023-09-30T13:54:50.410454+0000","last_unstale":"2023-09-30T13:54:54.440683+0000","last_undegraded":"2023-09-30T13:54:54.440683+0000","last_fullsized":"2023-09-30T13:54:54.440683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442060+0000","last_change":"2023-09-30T13:54:49.415626+0000","last_active":"2023-09-30T13:54:54.442060+0000","last_peered":"2023-09-30T13:54:54.442060+0000","last_clean":"2023-09-30T13:54:54.442060+0000","last_became_active":"2023-09-30T13:54:49.415378+0000","last_became_peered":"2023-09-30T13:54:49.415378+0000","last_unstale":"2023-09-30T13:54:54.442060+0000","last_undegraded":"2023-09-30T13:54:54.442060+0000","last_fullsized":"2023-09-30T13:54:54.442060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395657+0000","last_change":"2023-09-30T13:54:54.454291+0000","last_active":"2023-09-30T13:54:55.395657+0000","last_peered":"2023-09-30T13:54:55.395657+0000","last_clean":"2023-09-30T13:54:55.395657+0000","last_became_active":"2023-09-30T13:54:54.453505+0000","last_became_peered":"2023-09-30T13:54:54.453505+0000","last_unstale":"2023-09-30T13:54:55.395657+0000","last_undegraded":"2023-09-30T13:54:55.395657+0000","last_fullsized":"2023-09-30T13:54:55.395657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:56.027992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443495+0000","last_change":"2023-09-30T13:54:50.410244+0000","last_active":"2023-09-30T13:54:54.443495+0000","last_peered":"2023-09-30T13:54:54.443495+0000","last_clean":"2023-09-30T13:54:54.443495+0000","last_became_active":"2023-09-30T13:54:50.409602+0000","last_became_peered":"2023-09-30T13:54:50.409602+0000","last_unstale":"2023-09-30T13:54:54.443495+0000","last_undegraded":"2023-09-30T13:54:54.443495+0000","last_fullsized":"2023-09-30T13:54:54.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439311+0000","last_change":"2023-09-30T13:54:49.418424+0000","last_active":"2023-09-30T13:54:54.439311+0000","last_peered":"2023-09-30T13:54:54.439311+0000","last_clean":"2023-09-30T13:54:54.439311+0000","last_became_active":"2023-09-30T13:54:49.417956+0000","last_became_peered":"2023-09-30T13:54:49.417956+0000","last_unstale":"2023-09-30T13:54:54.439311+0000","last_undegraded":"2023-09-30T13:54:54.439311+0000","last_fullsized":"2023-09-30T13:54:54.439311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556417+0000","last_change":"2023-09-30T13:54:54.462623+0000","last_active":"2023-09-30T13:54:55.556417+0000","last_peered":"2023-09-30T13:54:55.556417+0000","last_clean":"2023-09-30T13:54:55.556417+0000","last_became_active":"2023-09-30T13:54:54.462207+0000","last_became_peered":"2023-09-30T13:54:54.462207+0000","last_unstale":"2023-09-30T13:54:55.556417+0000","last_undegraded":"2023-09-30T13:54:55.556417+0000","last_fullsized":"2023-09-30T13:54:55.556417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443009+0000","last_change":"2023-09-30T13:54:50.413527+0000","last_active":"2023-09-30T13:54:54.443009+0000","last_peered":"2023-09-30T13:54:54.443009+0000","last_clean":"2023-09-30T13:54:54.443009+0000","last_became_active":"2023-09-30T13:54:50.413227+0000","last_became_peered":"2023-09-30T13:54:50.413227+0000","last_unstale":"2023-09-30T13:54:54.443009+0000","last_undegraded":"2023-09-30T13:54:54.443009+0000","last_fullsized":"2023-09-30T13:54:54.443009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:53.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457857+0000","last_change":"2023-09-30T13:54:49.425834+0000","last_active":"2023-09-30T13:54:54.457857+0000","last_peered":"2023-09-30T13:54:54.457857+0000","last_clean":"2023-09-30T13:54:54.457857+0000","last_became_active":"2023-09-30T13:54:49.424534+0000","last_became_peered":"2023-09-30T13:54:49.424534+0000","last_unstale":"2023-09-30T13:54:54.457857+0000","last_undegraded":"2023-09-30T13:54:54.457857+0000","last_fullsized":"2023-09-30T13:54:54.457857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:38.360726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395974+0000","last_change":"2023-09-30T13:54:54.461499+0000","last_active":"2023-09-30T13:54:55.395974+0000","last_peered":"2023-09-30T13:54:55.395974+0000","last_clean":"2023-09-30T13:54:55.395974+0000","last_became_active":"2023-09-30T13:54:54.461112+0000","last_became_peered":"2023-09-30T13:54:54.461112+0000","last_unstale":"2023-09-30T13:54:55.395974+0000","last_undegraded":"2023-09-30T13:54:55.395974+0000","last_fullsized":"2023-09-30T13:54:55.395974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454330+0000","last_change":"2023-09-30T13:54:50.410914+0000","last_active":"2023-09-30T13:54:54.454330+0000","last_peered":"2023-09-30T13:54:54.454330+0000","last_clean":"2023-09-30T13:54:54.454330+0000","last_became_active":"2023-09-30T13:54:50.410418+0000","last_became_peered":"2023-09-30T13:54:50.410418+0000","last_unstale":"2023-09-30T13:54:54.454330+0000","last_undegraded":"2023-09-30T13:54:54.454330+0000","last_fullsized":"2023-09-30T13:54:54.454330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447170+0000","last_change":"2023-09-30T13:54:49.422040+0000","last_active":"2023-09-30T13:54:54.447170+0000","last_peered":"2023-09-30T13:54:54.447170+0000","last_clean":"2023-09-30T13:54:54.447170+0000","last_became_active":"2023-09-30T13:54:49.421750+0000","last_became_peered":"2023-09-30T13:54:49.421750+0000","last_unstale":"2023-09-30T13:54:54.447170+0000","last_undegraded":"2023-09-30T13:54:54.447170+0000","last_fullsized":"2023-09-30T13:54:54.447170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395403+0000","last_change":"2023-09-30T13:54:54.461309+0000","last_active":"2023-09-30T13:54:55.395403+0000","last_peered":"2023-09-30T13:54:55.395403+0000","last_clean":"2023-09-30T13:54:55.395403+0000","last_became_active":"2023-09-30T13:54:54.460864+0000","last_became_peered":"2023-09-30T13:54:54.460864+0000","last_unstale":"2023-09-30T13:54:55.395403+0000","last_undegraded":"2023-09-30T13:54:55.395403+0000","last_fullsized":"2023-09-30T13:54:55.395403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:02.815628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441932+0000","last_change":"2023-09-30T13:54:50.412240+0000","last_active":"2023-09-30T13:54:54.441932+0000","last_peered":"2023-09-30T13:54:54.441932+0000","last_clean":"2023-09-30T13:54:54.441932+0000","last_became_active":"2023-09-30T13:54:50.411943+0000","last_became_peered":"2023-09-30T13:54:50.411943+0000","last_unstale":"2023-09-30T13:54:54.441932+0000","last_undegraded":"2023-09-30T13:54:54.441932+0000","last_fullsized":"2023-09-30T13:54:54.441932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439918+0000","last_change":"2023-09-30T13:54:49.416854+0000","last_active":"2023-09-30T13:54:54.439918+0000","last_peered":"2023-09-30T13:54:54.439918+0000","last_clean":"2023-09-30T13:54:54.439918+0000","last_became_active":"2023-09-30T13:54:49.416581+0000","last_became_peered":"2023-09-30T13:54:49.416581+0000","last_unstale":"2023-09-30T13:54:54.439918+0000","last_undegraded":"2023-09-30T13:54:54.439918+0000","last_fullsized":"2023-09-30T13:54:54.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394833+0000","last_change":"2023-09-30T13:54:54.462965+0000","last_active":"2023-09-30T13:54:55.394833+0000","last_peered":"2023-09-30T13:54:55.394833+0000","last_clean":"2023-09-30T13:54:55.394833+0000","last_became_active":"2023-09-30T13:54:54.462601+0000","last_became_peered":"2023-09-30T13:54:54.462601+0000","last_unstale":"2023-09-30T13:54:55.394833+0000","last_undegraded":"2023-09-30T13:54:55.394833+0000","last_fullsized":"2023-09-30T13:54:55.394833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:43:37.820526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439588+0000","last_change":"2023-09-30T13:54:50.408191+0000","last_active":"2023-09-30T13:54:54.439588+0000","last_peered":"2023-09-30T13:54:54.439588+0000","last_clean":"2023-09-30T13:54:54.439588+0000","last_became_active":"2023-09-30T13:54:50.407941+0000","last_became_peered":"2023-09-30T13:54:50.407941+0000","last_unstale":"2023-09-30T13:54:54.439588+0000","last_undegraded":"2023-09-30T13:54:54.439588+0000","last_fullsized":"2023-09-30T13:54:54.439588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458784+0000","last_change":"2023-09-30T13:54:49.425042+0000","last_active":"2023-09-30T13:54:54.458784+0000","last_peered":"2023-09-30T13:54:54.458784+0000","last_clean":"2023-09-30T13:54:54.458784+0000","last_became_active":"2023-09-30T13:54:49.424790+0000","last_became_peered":"2023-09-30T13:54:49.424790+0000","last_unstale":"2023-09-30T13:54:54.458784+0000","last_undegraded":"2023-09-30T13:54:54.458784+0000","last_fullsized":"2023-09-30T13:54:54.458784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555303+0000","last_change":"2023-09-30T13:54:54.466551+0000","last_active":"2023-09-30T13:54:55.555303+0000","last_peered":"2023-09-30T13:54:55.555303+0000","last_clean":"2023-09-30T13:54:55.555303+0000","last_became_active":"2023-09-30T13:54:54.464011+0000","last_became_peered":"2023-09-30T13:54:54.464011+0000","last_unstale":"2023-09-30T13:54:55.555303+0000","last_undegraded":"2023-09-30T13:54:55.555303+0000","last_fullsized":"2023-09-30T13:54:55.555303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450488+0000","last_change":"2023-09-30T13:54:50.415029+0000","last_active":"2023-09-30T13:54:54.450488+0000","last_peered":"2023-09-30T13:54:54.450488+0000","last_clean":"2023-09-30T13:54:54.450488+0000","last_became_active":"2023-09-30T13:54:50.414756+0000","last_became_peered":"2023-09-30T13:54:50.414756+0000","last_unstale":"2023-09-30T13:54:54.450488+0000","last_undegraded":"2023-09-30T13:54:54.450488+0000","last_fullsized":"2023-09-30T13:54:54.450488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439678+0000","last_change":"2023-09-30T13:54:49.421098+0000","last_active":"2023-09-30T13:54:54.439678+0000","last_peered":"2023-09-30T13:54:54.439678+0000","last_clean":"2023-09-30T13:54:54.439678+0000","last_became_active":"2023-09-30T13:54:49.420826+0000","last_became_peered":"2023-09-30T13:54:49.420826+0000","last_unstale":"2023-09-30T13:54:54.439678+0000","last_undegraded":"2023-09-30T13:54:54.439678+0000","last_fullsized":"2023-09-30T13:54:54.439678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555580+0000","last_change":"2023-09-30T13:54:54.460534+0000","last_active":"2023-09-30T13:54:55.555580+0000","last_peered":"2023-09-30T13:54:55.555580+0000","last_clean":"2023-09-30T13:54:55.555580+0000","last_became_active":"2023-09-30T13:54:54.459808+0000","last_became_peered":"2023-09-30T13:54:54.459808+0000","last_unstale":"2023-09-30T13:54:55.555580+0000","last_undegraded":"2023-09-30T13:54:55.555580+0000","last_fullsized":"2023-09-30T13:54:55.555580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443004+0000","last_change":"2023-09-30T13:54:50.409280+0000","last_active":"2023-09-30T13:54:54.443004+0000","last_peered":"2023-09-30T13:54:54.443004+0000","last_clean":"2023-09-30T13:54:54.443004+0000","last_became_active":"2023-09-30T13:54:50.408982+0000","last_became_peered":"2023-09-30T13:54:50.408982+0000","last_unstale":"2023-09-30T13:54:54.443004+0000","last_undegraded":"2023-09-30T13:54:54.443004+0000","last_fullsized":"2023-09-30T13:54:54.443004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:04.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449516+0000","last_change":"2023-09-30T13:54:49.426134+0000","last_active":"2023-09-30T13:54:54.449516+0000","last_peered":"2023-09-30T13:54:54.449516+0000","last_clean":"2023-09-30T13:54:54.449516+0000","last_became_active":"2023-09-30T13:54:49.425836+0000","last_became_peered":"2023-09-30T13:54:49.425836+0000","last_unstale":"2023-09-30T13:54:54.449516+0000","last_undegraded":"2023-09-30T13:54:54.449516+0000","last_fullsized":"2023-09-30T13:54:54.449516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:09.783758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556338+0000","last_change":"2023-09-30T13:54:54.455762+0000","last_active":"2023-09-30T13:54:55.556338+0000","last_peered":"2023-09-30T13:54:55.556338+0000","last_clean":"2023-09-30T13:54:55.556338+0000","last_became_active":"2023-09-30T13:54:54.455325+0000","last_became_peered":"2023-09-30T13:54:54.455325+0000","last_unstale":"2023-09-30T13:54:55.556338+0000","last_undegraded":"2023-09-30T13:54:55.556338+0000","last_fullsized":"2023-09-30T13:54:55.556338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439147+0000","last_change":"2023-09-30T13:54:50.408742+0000","last_active":"2023-09-30T13:54:54.439147+0000","last_peered":"2023-09-30T13:54:54.439147+0000","last_clean":"2023-09-30T13:54:54.439147+0000","last_became_active":"2023-09-30T13:54:50.408453+0000","last_became_peered":"2023-09-30T13:54:50.408453+0000","last_unstale":"2023-09-30T13:54:54.439147+0000","last_undegraded":"2023-09-30T13:54:54.439147+0000","last_fullsized":"2023-09-30T13:54:54.439147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448390+0000","last_change":"2023-09-30T13:54:49.421234+0000","last_active":"2023-09-30T13:54:54.448390+0000","last_peered":"2023-09-30T13:54:54.448390+0000","last_clean":"2023-09-30T13:54:54.448390+0000","last_became_active":"2023-09-30T13:54:49.420950+0000","last_became_peered":"2023-09-30T13:54:49.420950+0000","last_unstale":"2023-09-30T13:54:54.448390+0000","last_undegraded":"2023-09-30T13:54:54.448390+0000","last_fullsized":"2023-09-30T13:54:54.448390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556539+0000","last_change":"2023-09-30T13:54:54.462900+0000","last_active":"2023-09-30T13:54:55.556539+0000","last_peered":"2023-09-30T13:54:55.556539+0000","last_clean":"2023-09-30T13:54:55.556539+0000","last_became_active":"2023-09-30T13:54:54.459241+0000","last_became_peered":"2023-09-30T13:54:54.459241+0000","last_unstale":"2023-09-30T13:54:55.556539+0000","last_undegraded":"2023-09-30T13:54:55.556539+0000","last_fullsized":"2023-09-30T13:54:55.556539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453782+0000","last_change":"2023-09-30T13:54:50.405590+0000","last_active":"2023-09-30T13:54:54.453782+0000","last_peered":"2023-09-30T13:54:54.453782+0000","last_clean":"2023-09-30T13:54:54.453782+0000","last_became_active":"2023-09-30T13:54:50.405266+0000","last_became_peered":"2023-09-30T13:54:50.405266+0000","last_unstale":"2023-09-30T13:54:54.453782+0000","last_undegraded":"2023-09-30T13:54:54.453782+0000","last_fullsized":"2023-09-30T13:54:54.453782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457949+0000","last_change":"2023-09-30T13:54:49.424227+0000","last_active":"2023-09-30T13:54:54.457949+0000","last_peered":"2023-09-30T13:54:54.457949+0000","last_clean":"2023-09-30T13:54:54.457949+0000","last_became_active":"2023-09-30T13:54:49.423939+0000","last_became_peered":"2023-09-30T13:54:49.423939+0000","last_unstale":"2023-09-30T13:54:54.457949+0000","last_undegraded":"2023-09-30T13:54:54.457949+0000","last_fullsized":"2023-09-30T13:54:54.457949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:20.159794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555733+0000","last_change":"2023-09-30T13:54:54.463551+0000","last_active":"2023-09-30T13:54:55.555733+0000","last_peered":"2023-09-30T13:54:55.555733+0000","last_clean":"2023-09-30T13:54:55.555733+0000","last_became_active":"2023-09-30T13:54:54.463125+0000","last_became_peered":"2023-09-30T13:54:54.463125+0000","last_unstale":"2023-09-30T13:54:55.555733+0000","last_undegraded":"2023-09-30T13:54:55.555733+0000","last_fullsized":"2023-09-30T13:54:55.555733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440199+0000","last_change":"2023-09-30T13:54:50.410239+0000","last_active":"2023-09-30T13:54:54.440199+0000","last_peered":"2023-09-30T13:54:54.440199+0000","last_clean":"2023-09-30T13:54:54.440199+0000","last_became_active":"2023-09-30T13:54:50.409936+0000","last_became_peered":"2023-09-30T13:54:50.409936+0000","last_unstale":"2023-09-30T13:54:54.440199+0000","last_undegraded":"2023-09-30T13:54:54.440199+0000","last_fullsized":"2023-09-30T13:54:54.440199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448279+0000","last_change":"2023-09-30T13:54:49.419889+0000","last_active":"2023-09-30T13:54:54.448279+0000","last_peered":"2023-09-30T13:54:54.448279+0000","last_clean":"2023-09-30T13:54:54.448279+0000","last_became_active":"2023-09-30T13:54:49.419588+0000","last_became_peered":"2023-09-30T13:54:49.419588+0000","last_unstale":"2023-09-30T13:54:54.448279+0000","last_undegraded":"2023-09-30T13:54:54.448279+0000","last_fullsized":"2023-09-30T13:54:54.448279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:38.191440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458057+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:54:54.458057+0000","last_peered":"2023-09-30T13:54:54.458057+0000","last_clean":"2023-09-30T13:54:54.458057+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:54:54.458057+0000","last_undegraded":"2023-09-30T13:54:54.458057+0000","last_fullsized":"2023-09-30T13:54:54.458057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420181+0000","last_change":"2023-09-30T13:54:54.461747+0000","last_active":"2023-09-30T13:54:55.420181+0000","last_peered":"2023-09-30T13:54:55.420181+0000","last_clean":"2023-09-30T13:54:55.420181+0000","last_became_active":"2023-09-30T13:54:54.461313+0000","last_became_peered":"2023-09-30T13:54:54.461313+0000","last_unstale":"2023-09-30T13:54:55.420181+0000","last_undegraded":"2023-09-30T13:54:55.420181+0000","last_fullsized":"2023-09-30T13:54:55.420181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458578+0000","last_change":"2023-09-30T13:54:50.416311+0000","last_active":"2023-09-30T13:54:54.458578+0000","last_peered":"2023-09-30T13:54:54.458578+0000","last_clean":"2023-09-30T13:54:54.458578+0000","last_became_active":"2023-09-30T13:54:50.415316+0000","last_became_peered":"2023-09-30T13:54:50.415316+0000","last_unstale":"2023-09-30T13:54:54.458578+0000","last_undegraded":"2023-09-30T13:54:54.458578+0000","last_fullsized":"2023-09-30T13:54:54.458578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449816+0000","last_change":"2023-09-30T13:54:49.423309+0000","last_active":"2023-09-30T13:54:54.449816+0000","last_peered":"2023-09-30T13:54:54.449816+0000","last_clean":"2023-09-30T13:54:54.449816+0000","last_became_active":"2023-09-30T13:54:49.423038+0000","last_became_peered":"2023-09-30T13:54:49.423038+0000","last_unstale":"2023-09-30T13:54:54.449816+0000","last_undegraded":"2023-09-30T13:54:54.449816+0000","last_fullsized":"2023-09-30T13:54:54.449816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.419816+0000","last_change":"2023-09-30T13:54:54.461245+0000","last_active":"2023-09-30T13:54:55.419816+0000","last_peered":"2023-09-30T13:54:55.419816+0000","last_clean":"2023-09-30T13:54:55.419816+0000","last_became_active":"2023-09-30T13:54:54.460850+0000","last_became_peered":"2023-09-30T13:54:54.460850+0000","last_unstale":"2023-09-30T13:54:55.419816+0000","last_undegraded":"2023-09-30T13:54:55.419816+0000","last_fullsized":"2023-09-30T13:54:55.419816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450189+0000","last_change":"2023-09-30T13:54:50.415242+0000","last_active":"2023-09-30T13:54:54.450189+0000","last_peered":"2023-09-30T13:54:54.450189+0000","last_clean":"2023-09-30T13:54:54.450189+0000","last_became_active":"2023-09-30T13:54:50.414966+0000","last_became_peered":"2023-09-30T13:54:50.414966+0000","last_unstale":"2023-09-30T13:54:54.450189+0000","last_undegraded":"2023-09-30T13:54:54.450189+0000","last_fullsized":"2023-09-30T13:54:54.450189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439617+0000","last_change":"2023-09-30T13:54:49.419341+0000","last_active":"2023-09-30T13:54:54.439617+0000","last_peered":"2023-09-30T13:54:54.439617+0000","last_clean":"2023-09-30T13:54:54.439617+0000","last_became_active":"2023-09-30T13:54:49.419064+0000","last_became_peered":"2023-09-30T13:54:49.419064+0000","last_unstale":"2023-09-30T13:54:54.439617+0000","last_undegraded":"2023-09-30T13:54:54.439617+0000","last_fullsized":"2023-09-30T13:54:54.439617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555529+0000","last_change":"2023-09-30T13:54:54.470669+0000","last_active":"2023-09-30T13:54:55.555529+0000","last_peered":"2023-09-30T13:54:55.555529+0000","last_clean":"2023-09-30T13:54:55.555529+0000","last_became_active":"2023-09-30T13:54:54.470079+0000","last_became_peered":"2023-09-30T13:54:54.470079+0000","last_unstale":"2023-09-30T13:54:55.555529+0000","last_undegraded":"2023-09-30T13:54:55.555529+0000","last_fullsized":"2023-09-30T13:54:55.555529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458977+0000","last_change":"2023-09-30T13:54:50.415862+0000","last_active":"2023-09-30T13:54:54.458977+0000","last_peered":"2023-09-30T13:54:54.458977+0000","last_clean":"2023-09-30T13:54:54.458977+0000","last_became_active":"2023-09-30T13:54:50.415304+0000","last_became_peered":"2023-09-30T13:54:50.415304+0000","last_unstale":"2023-09-30T13:54:54.458977+0000","last_undegraded":"2023-09-30T13:54:54.458977+0000","last_fullsized":"2023-09-30T13:54:54.458977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:43.639609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447671+0000","last_change":"2023-09-30T13:54:49.415340+0000","last_active":"2023-09-30T13:54:54.447671+0000","last_peered":"2023-09-30T13:54:54.447671+0000","last_clean":"2023-09-30T13:54:54.447671+0000","last_became_active":"2023-09-30T13:54:49.415072+0000","last_became_peered":"2023-09-30T13:54:49.415072+0000","last_unstale":"2023-09-30T13:54:54.447671+0000","last_undegraded":"2023-09-30T13:54:54.447671+0000","last_fullsized":"2023-09-30T13:54:54.447671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:14:27.574930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555106+0000","last_change":"2023-09-30T13:54:54.458742+0000","last_active":"2023-09-30T13:54:55.555106+0000","last_peered":"2023-09-30T13:54:55.555106+0000","last_clean":"2023-09-30T13:54:55.555106+0000","last_became_active":"2023-09-30T13:54:54.458302+0000","last_became_peered":"2023-09-30T13:54:54.458302+0000","last_unstale":"2023-09-30T13:54:55.555106+0000","last_undegraded":"2023-09-30T13:54:55.555106+0000","last_fullsized":"2023-09-30T13:54:55.555106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.459145+0000","last_change":"2023-09-30T13:54:50.415857+0000","last_active":"2023-09-30T13:54:54.459145+0000","last_peered":"2023-09-30T13:54:54.459145+0000","last_clean":"2023-09-30T13:54:54.459145+0000","last_became_active":"2023-09-30T13:54:50.415551+0000","last_became_peered":"2023-09-30T13:54:50.415551+0000","last_unstale":"2023-09-30T13:54:54.459145+0000","last_undegraded":"2023-09-30T13:54:54.459145+0000","last_fullsized":"2023-09-30T13:54:54.459145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442277+0000","last_change":"2023-09-30T13:54:49.417788+0000","last_active":"2023-09-30T13:54:54.442277+0000","last_peered":"2023-09-30T13:54:54.442277+0000","last_clean":"2023-09-30T13:54:54.442277+0000","last_became_active":"2023-09-30T13:54:49.417494+0000","last_became_peered":"2023-09-30T13:54:49.417494+0000","last_unstale":"2023-09-30T13:54:54.442277+0000","last_undegraded":"2023-09-30T13:54:54.442277+0000","last_fullsized":"2023-09-30T13:54:54.442277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395085+0000","last_change":"2023-09-30T13:54:54.462891+0000","last_active":"2023-09-30T13:54:55.395085+0000","last_peered":"2023-09-30T13:54:55.395085+0000","last_clean":"2023-09-30T13:54:55.395085+0000","last_became_active":"2023-09-30T13:54:54.461379+0000","last_became_peered":"2023-09-30T13:54:54.461379+0000","last_unstale":"2023-09-30T13:54:55.395085+0000","last_undegraded":"2023-09-30T13:54:55.395085+0000","last_fullsized":"2023-09-30T13:54:55.395085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:43.391644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458032+0000","last_change":"2023-09-30T13:54:50.417980+0000","last_active":"2023-09-30T13:54:54.458032+0000","last_peered":"2023-09-30T13:54:54.458032+0000","last_clean":"2023-09-30T13:54:54.458032+0000","last_became_active":"2023-09-30T13:54:50.417570+0000","last_became_peered":"2023-09-30T13:54:50.417570+0000","last_unstale":"2023-09-30T13:54:54.458032+0000","last_undegraded":"2023-09-30T13:54:54.458032+0000","last_fullsized":"2023-09-30T13:54:54.458032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446933+0000","last_change":"2023-09-30T13:54:49.419847+0000","last_active":"2023-09-30T13:54:54.446933+0000","last_peered":"2023-09-30T13:54:54.446933+0000","last_clean":"2023-09-30T13:54:54.446933+0000","last_became_active":"2023-09-30T13:54:49.419547+0000","last_became_peered":"2023-09-30T13:54:49.419547+0000","last_unstale":"2023-09-30T13:54:54.446933+0000","last_undegraded":"2023-09-30T13:54:54.446933+0000","last_fullsized":"2023-09-30T13:54:54.446933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:59:22.340711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555588+0000","last_change":"2023-09-30T13:54:54.458941+0000","last_active":"2023-09-30T13:54:55.555588+0000","last_peered":"2023-09-30T13:54:55.555588+0000","last_clean":"2023-09-30T13:54:55.555588+0000","last_became_active":"2023-09-30T13:54:54.458230+0000","last_became_peered":"2023-09-30T13:54:54.458230+0000","last_unstale":"2023-09-30T13:54:55.555588+0000","last_undegraded":"2023-09-30T13:54:55.555588+0000","last_fullsized":"2023-09-30T13:54:55.555588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447803+0000","last_change":"2023-09-30T13:54:50.411632+0000","last_active":"2023-09-30T13:54:54.447803+0000","last_peered":"2023-09-30T13:54:54.447803+0000","last_clean":"2023-09-30T13:54:54.447803+0000","last_became_active":"2023-09-30T13:54:50.411281+0000","last_became_peered":"2023-09-30T13:54:50.411281+0000","last_unstale":"2023-09-30T13:54:54.447803+0000","last_undegraded":"2023-09-30T13:54:54.447803+0000","last_fullsized":"2023-09-30T13:54:54.447803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448857+0000","last_change":"2023-09-30T13:54:49.417961+0000","last_active":"2023-09-30T13:54:54.448857+0000","last_peered":"2023-09-30T13:54:54.448857+0000","last_clean":"2023-09-30T13:54:54.448857+0000","last_became_active":"2023-09-30T13:54:49.417131+0000","last_became_peered":"2023-09-30T13:54:49.417131+0000","last_unstale":"2023-09-30T13:54:54.448857+0000","last_undegraded":"2023-09-30T13:54:54.448857+0000","last_fullsized":"2023-09-30T13:54:54.448857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:02.854268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.396016+0000","last_change":"2023-09-30T13:54:54.461774+0000","last_active":"2023-09-30T13:54:55.396016+0000","last_peered":"2023-09-30T13:54:55.396016+0000","last_clean":"2023-09-30T13:54:55.396016+0000","last_became_active":"2023-09-30T13:54:54.461333+0000","last_became_peered":"2023-09-30T13:54:54.461333+0000","last_unstale":"2023-09-30T13:54:55.396016+0000","last_undegraded":"2023-09-30T13:54:55.396016+0000","last_fullsized":"2023-09-30T13:54:55.396016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:07.190629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458382+0000","last_change":"2023-09-30T13:54:50.418751+0000","last_active":"2023-09-30T13:54:54.458382+0000","last_peered":"2023-09-30T13:54:54.458382+0000","last_clean":"2023-09-30T13:54:54.458382+0000","last_became_active":"2023-09-30T13:54:50.418290+0000","last_became_peered":"2023-09-30T13:54:50.418290+0000","last_unstale":"2023-09-30T13:54:54.458382+0000","last_undegraded":"2023-09-30T13:54:54.458382+0000","last_fullsized":"2023-09-30T13:54:54.458382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449427+0000","last_change":"2023-09-30T13:54:49.425647+0000","last_active":"2023-09-30T13:54:54.449427+0000","last_peered":"2023-09-30T13:54:54.449427+0000","last_clean":"2023-09-30T13:54:54.449427+0000","last_became_active":"2023-09-30T13:54:49.425388+0000","last_became_peered":"2023-09-30T13:54:49.425388+0000","last_unstale":"2023-09-30T13:54:54.449427+0000","last_undegraded":"2023-09-30T13:54:54.449427+0000","last_fullsized":"2023-09-30T13:54:54.449427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395641+0000","last_change":"2023-09-30T13:54:54.461862+0000","last_active":"2023-09-30T13:54:55.395641+0000","last_peered":"2023-09-30T13:54:55.395641+0000","last_clean":"2023-09-30T13:54:55.395641+0000","last_became_active":"2023-09-30T13:54:54.461454+0000","last_became_peered":"2023-09-30T13:54:54.461454+0000","last_unstale":"2023-09-30T13:54:55.395641+0000","last_undegraded":"2023-09-30T13:54:55.395641+0000","last_fullsized":"2023-09-30T13:54:55.395641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:41:47.042221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453950+0000","last_change":"2023-09-30T13:54:50.410049+0000","last_active":"2023-09-30T13:54:54.453950+0000","last_peered":"2023-09-30T13:54:54.453950+0000","last_clean":"2023-09-30T13:54:54.453950+0000","last_became_active":"2023-09-30T13:54:50.409797+0000","last_became_peered":"2023-09-30T13:54:50.409797+0000","last_unstale":"2023-09-30T13:54:54.453950+0000","last_undegraded":"2023-09-30T13:54:54.453950+0000","last_fullsized":"2023-09-30T13:54:54.453950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:31.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.455043+0000","last_change":"2023-09-30T13:54:49.419144+0000","last_active":"2023-09-30T13:54:54.455043+0000","last_peered":"2023-09-30T13:54:54.455043+0000","last_clean":"2023-09-30T13:54:54.455043+0000","last_became_active":"2023-09-30T13:54:49.418861+0000","last_became_peered":"2023-09-30T13:54:49.418861+0000","last_unstale":"2023-09-30T13:54:54.455043+0000","last_undegraded":"2023-09-30T13:54:54.455043+0000","last_fullsized":"2023-09-30T13:54:54.455043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555756+0000","last_change":"2023-09-30T13:54:54.461392+0000","last_active":"2023-09-30T13:54:55.555756+0000","last_peered":"2023-09-30T13:54:55.555756+0000","last_clean":"2023-09-30T13:54:55.555756+0000","last_became_active":"2023-09-30T13:54:54.460929+0000","last_became_peered":"2023-09-30T13:54:54.460929+0000","last_unstale":"2023-09-30T13:54:55.555756+0000","last_undegraded":"2023-09-30T13:54:55.555756+0000","last_fullsized":"2023-09-30T13:54:55.555756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458494+0000","last_change":"2023-09-30T13:54:50.416496+0000","last_active":"2023-09-30T13:54:54.458494+0000","last_peered":"2023-09-30T13:54:54.458494+0000","last_clean":"2023-09-30T13:54:54.458494+0000","last_became_active":"2023-09-30T13:54:50.416041+0000","last_became_peered":"2023-09-30T13:54:50.416041+0000","last_unstale":"2023-09-30T13:54:54.458494+0000","last_undegraded":"2023-09-30T13:54:54.458494+0000","last_fullsized":"2023-09-30T13:54:54.458494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:59.305889+0000","last_change":"2023-09-30T13:54:49.424285+0000","last_active":"2023-09-30T13:54:59.305889+0000","last_peered":"2023-09-30T13:54:59.305889+0000","last_clean":"2023-09-30T13:54:59.305889+0000","last_became_active":"2023-09-30T13:54:49.424016+0000","last_became_peered":"2023-09-30T13:54:49.424016+0000","last_unstale":"2023-09-30T13:54:59.305889+0000","last_undegraded":"2023-09-30T13:54:59.305889+0000","last_fullsized":"2023-09-30T13:54:59.305889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555828+0000","last_change":"2023-09-30T13:54:54.460160+0000","last_active":"2023-09-30T13:54:55.555828+0000","last_peered":"2023-09-30T13:54:55.555828+0000","last_clean":"2023-09-30T13:54:55.555828+0000","last_became_active":"2023-09-30T13:54:54.459029+0000","last_became_peered":"2023-09-30T13:54:54.459029+0000","last_unstale":"2023-09-30T13:54:55.555828+0000","last_undegraded":"2023-09-30T13:54:55.555828+0000","last_fullsized":"2023-09-30T13:54:55.555828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443040+0000","last_change":"2023-09-30T13:54:50.415939+0000","last_active":"2023-09-30T13:54:54.443040+0000","last_peered":"2023-09-30T13:54:54.443040+0000","last_clean":"2023-09-30T13:54:54.443040+0000","last_became_active":"2023-09-30T13:54:50.415711+0000","last_became_peered":"2023-09-30T13:54:50.415711+0000","last_unstale":"2023-09-30T13:54:54.443040+0000","last_undegraded":"2023-09-30T13:54:54.443040+0000","last_fullsized":"2023-09-30T13:54:54.443040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439502+0000","last_change":"2023-09-30T13:54:49.421474+0000","last_active":"2023-09-30T13:54:54.439502+0000","last_peered":"2023-09-30T13:54:54.439502+0000","last_clean":"2023-09-30T13:54:54.439502+0000","last_became_active":"2023-09-30T13:54:49.421229+0000","last_became_peered":"2023-09-30T13:54:49.421229+0000","last_unstale":"2023-09-30T13:54:54.439502+0000","last_undegraded":"2023-09-30T13:54:54.439502+0000","last_fullsized":"2023-09-30T13:54:54.439502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395499+0000","last_change":"2023-09-30T13:54:54.462295+0000","last_active":"2023-09-30T13:54:55.395499+0000","last_peered":"2023-09-30T13:54:55.395499+0000","last_clean":"2023-09-30T13:54:55.395499+0000","last_became_active":"2023-09-30T13:54:54.461617+0000","last_became_peered":"2023-09-30T13:54:54.461617+0000","last_unstale":"2023-09-30T13:54:55.395499+0000","last_undegraded":"2023-09-30T13:54:55.395499+0000","last_fullsized":"2023-09-30T13:54:55.395499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:35.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454208+0000","last_change":"2023-09-30T13:54:50.409156+0000","last_active":"2023-09-30T13:54:54.454208+0000","last_peered":"2023-09-30T13:54:54.454208+0000","last_clean":"2023-09-30T13:54:54.454208+0000","last_became_active":"2023-09-30T13:54:50.408875+0000","last_became_peered":"2023-09-30T13:54:50.408875+0000","last_unstale":"2023-09-30T13:54:54.454208+0000","last_undegraded":"2023-09-30T13:54:54.454208+0000","last_fullsized":"2023-09-30T13:54:54.454208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450123+0000","last_change":"2023-09-30T13:54:49.421494+0000","last_active":"2023-09-30T13:54:54.450123+0000","last_peered":"2023-09-30T13:54:54.450123+0000","last_clean":"2023-09-30T13:54:54.450123+0000","last_became_active":"2023-09-30T13:54:49.420772+0000","last_became_peered":"2023-09-30T13:54:49.420772+0000","last_unstale":"2023-09-30T13:54:54.450123+0000","last_undegraded":"2023-09-30T13:54:54.450123+0000","last_fullsized":"2023-09-30T13:54:54.450123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:44.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395038+0000","last_change":"2023-09-30T13:54:54.450703+0000","last_active":"2023-09-30T13:54:55.395038+0000","last_peered":"2023-09-30T13:54:55.395038+0000","last_clean":"2023-09-30T13:54:55.395038+0000","last_became_active":"2023-09-30T13:54:54.450294+0000","last_became_peered":"2023-09-30T13:54:54.450294+0000","last_unstale":"2023-09-30T13:54:55.395038+0000","last_undegraded":"2023-09-30T13:54:55.395038+0000","last_fullsized":"2023-09-30T13:54:55.395038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:04:52.729643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450019+0000","last_change":"2023-09-30T13:54:50.422345+0000","last_active":"2023-09-30T13:54:54.450019+0000","last_peered":"2023-09-30T13:54:54.450019+0000","last_clean":"2023-09-30T13:54:54.450019+0000","last_became_active":"2023-09-30T13:54:50.422097+0000","last_became_peered":"2023-09-30T13:54:50.422097+0000","last_unstale":"2023-09-30T13:54:54.450019+0000","last_undegraded":"2023-09-30T13:54:54.450019+0000","last_fullsized":"2023-09-30T13:54:54.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447068+0000","last_change":"2023-09-30T13:54:49.421580+0000","last_active":"2023-09-30T13:54:54.447068+0000","last_peered":"2023-09-30T13:54:54.447068+0000","last_clean":"2023-09-30T13:54:54.447068+0000","last_became_active":"2023-09-30T13:54:49.421309+0000","last_became_peered":"2023-09-30T13:54:49.421309+0000","last_unstale":"2023-09-30T13:54:54.447068+0000","last_undegraded":"2023-09-30T13:54:54.447068+0000","last_fullsized":"2023-09-30T13:54:54.447068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:17.392031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394992+0000","last_change":"2023-09-30T13:54:54.461962+0000","last_active":"2023-09-30T13:54:55.394992+0000","last_peered":"2023-09-30T13:54:55.394992+0000","last_clean":"2023-09-30T13:54:55.394992+0000","last_became_active":"2023-09-30T13:54:54.461572+0000","last_became_peered":"2023-09-30T13:54:54.461572+0000","last_unstale":"2023-09-30T13:54:55.394992+0000","last_undegraded":"2023-09-30T13:54:55.394992+0000","last_fullsized":"2023-09-30T13:54:55.394992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556083+0000","last_change":"2023-09-30T13:54:54.465345+0000","last_active":"2023-09-30T13:54:55.556083+0000","last_peered":"2023-09-30T13:54:55.556083+0000","last_clean":"2023-09-30T13:54:55.556083+0000","last_became_active":"2023-09-30T13:54:54.464944+0000","last_became_peered":"2023-09-30T13:54:54.464944+0000","last_unstale":"2023-09-30T13:54:55.556083+0000","last_undegraded":"2023-09-30T13:54:55.556083+0000","last_fullsized":"2023-09-30T13:54:55.556083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:22:46.203262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439196+0000","last_change":"2023-09-30T13:54:50.415261+0000","last_active":"2023-09-30T13:54:54.439196+0000","last_peered":"2023-09-30T13:54:54.439196+0000","last_clean":"2023-09-30T13:54:54.439196+0000","last_became_active":"2023-09-30T13:54:50.414934+0000","last_became_peered":"2023-09-30T13:54:50.414934+0000","last_unstale":"2023-09-30T13:54:54.439196+0000","last_undegraded":"2023-09-30T13:54:54.439196+0000","last_fullsized":"2023-09-30T13:54:54.439196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447216+0000","last_change":"2023-09-30T13:54:49.423480+0000","last_active":"2023-09-30T13:54:54.447216+0000","last_peered":"2023-09-30T13:54:54.447216+0000","last_clean":"2023-09-30T13:54:54.447216+0000","last_became_active":"2023-09-30T13:54:49.423220+0000","last_became_peered":"2023-09-30T13:54:49.423220+0000","last_unstale":"2023-09-30T13:54:54.447216+0000","last_undegraded":"2023-09-30T13:54:54.447216+0000","last_fullsized":"2023-09-30T13:54:54.447216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420301+0000","last_change":"2023-09-30T13:54:54.464246+0000","last_active":"2023-09-30T13:54:55.420301+0000","last_peered":"2023-09-30T13:54:55.420301+0000","last_clean":"2023-09-30T13:54:55.420301+0000","last_became_active":"2023-09-30T13:54:54.463379+0000","last_became_peered":"2023-09-30T13:54:54.463379+0000","last_unstale":"2023-09-30T13:54:55.420301+0000","last_undegraded":"2023-09-30T13:54:55.420301+0000","last_fullsized":"2023-09-30T13:54:55.420301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443406+0000","last_change":"2023-09-30T13:54:50.409576+0000","last_active":"2023-09-30T13:54:54.443406+0000","last_peered":"2023-09-30T13:54:54.443406+0000","last_clean":"2023-09-30T13:54:54.443406+0000","last_became_active":"2023-09-30T13:54:50.409205+0000","last_became_peered":"2023-09-30T13:54:50.409205+0000","last_unstale":"2023-09-30T13:54:54.443406+0000","last_undegraded":"2023-09-30T13:54:54.443406+0000","last_fullsized":"2023-09-30T13:54:54.443406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441966+0000","last_change":"2023-09-30T13:54:49.414072+0000","last_active":"2023-09-30T13:54:54.441966+0000","last_peered":"2023-09-30T13:54:54.441966+0000","last_clean":"2023-09-30T13:54:54.441966+0000","last_became_active":"2023-09-30T13:54:49.413795+0000","last_became_peered":"2023-09-30T13:54:49.413795+0000","last_unstale":"2023-09-30T13:54:54.441966+0000","last_undegraded":"2023-09-30T13:54:54.441966+0000","last_fullsized":"2023-09-30T13:54:54.441966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445628+0000","last_change":"2023-09-30T13:54:49.418852+0000","last_active":"2023-09-30T13:54:54.445628+0000","last_peered":"2023-09-30T13:54:54.445628+0000","last_clean":"2023-09-30T13:54:54.445628+0000","last_became_active":"2023-09-30T13:54:49.417214+0000","last_became_peered":"2023-09-30T13:54:49.417214+0000","last_unstale":"2023-09-30T13:54:54.445628+0000","last_undegraded":"2023-09-30T13:54:54.445628+0000","last_fullsized":"2023-09-30T13:54:54.445628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454816+0000","last_change":"2023-09-30T13:54:50.408345+0000","last_active":"2023-09-30T13:54:54.454816+0000","last_peered":"2023-09-30T13:54:54.454816+0000","last_clean":"2023-09-30T13:54:54.454816+0000","last_became_active":"2023-09-30T13:54:50.408060+0000","last_became_peered":"2023-09-30T13:54:50.408060+0000","last_unstale":"2023-09-30T13:54:54.454816+0000","last_undegraded":"2023-09-30T13:54:54.454816+0000","last_fullsized":"2023-09-30T13:54:54.454816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394296+0000","last_change":"2023-09-30T13:54:54.460070+0000","last_active":"2023-09-30T13:54:55.394296+0000","last_peered":"2023-09-30T13:54:55.394296+0000","last_clean":"2023-09-30T13:54:55.394296+0000","last_became_active":"2023-09-30T13:54:54.459607+0000","last_became_peered":"2023-09-30T13:54:54.459607+0000","last_unstale":"2023-09-30T13:54:55.394296+0000","last_undegraded":"2023-09-30T13:54:55.394296+0000","last_fullsized":"2023-09-30T13:54:55.394296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:45.736051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440800+0000","last_change":"2023-09-30T13:54:49.418506+0000","last_active":"2023-09-30T13:54:54.440800+0000","last_peered":"2023-09-30T13:54:54.440800+0000","last_clean":"2023-09-30T13:54:54.440800+0000","last_became_active":"2023-09-30T13:54:49.418247+0000","last_became_peered":"2023-09-30T13:54:49.418247+0000","last_unstale":"2023-09-30T13:54:54.440800+0000","last_undegraded":"2023-09-30T13:54:54.440800+0000","last_fullsized":"2023-09-30T13:54:54.440800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442842+0000","last_change":"2023-09-30T13:54:50.414962+0000","last_active":"2023-09-30T13:54:54.442842+0000","last_peered":"2023-09-30T13:54:54.442842+0000","last_clean":"2023-09-30T13:54:54.442842+0000","last_became_active":"2023-09-30T13:54:50.414716+0000","last_became_peered":"2023-09-30T13:54:50.414716+0000","last_unstale":"2023-09-30T13:54:54.442842+0000","last_undegraded":"2023-09-30T13:54:54.442842+0000","last_fullsized":"2023-09-30T13:54:54.442842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:18.397281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395779+0000","last_change":"2023-09-30T13:54:54.453610+0000","last_active":"2023-09-30T13:54:55.395779+0000","last_peered":"2023-09-30T13:54:55.395779+0000","last_clean":"2023-09-30T13:54:55.395779+0000","last_became_active":"2023-09-30T13:54:54.453208+0000","last_became_peered":"2023-09-30T13:54:54.453208+0000","last_unstale":"2023-09-30T13:54:55.395779+0000","last_undegraded":"2023-09-30T13:54:55.395779+0000","last_fullsized":"2023-09-30T13:54:55.395779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:16:46.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447707+0000","last_change":"2023-09-30T13:54:50.413789+0000","last_active":"2023-09-30T13:54:54.447707+0000","last_peered":"2023-09-30T13:54:54.447707+0000","last_clean":"2023-09-30T13:54:54.447707+0000","last_became_active":"2023-09-30T13:54:50.413515+0000","last_became_peered":"2023-09-30T13:54:50.413515+0000","last_unstale":"2023-09-30T13:54:54.447707+0000","last_undegraded":"2023-09-30T13:54:54.447707+0000","last_fullsized":"2023-09-30T13:54:54.447707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446862+0000","last_change":"2023-09-30T13:54:50.407643+0000","last_active":"2023-09-30T13:54:54.446862+0000","last_peered":"2023-09-30T13:54:54.446862+0000","last_clean":"2023-09-30T13:54:54.446862+0000","last_became_active":"2023-09-30T13:54:50.407392+0000","last_became_peered":"2023-09-30T13:54:50.407392+0000","last_unstale":"2023-09-30T13:54:54.446862+0000","last_undegraded":"2023-09-30T13:54:54.446862+0000","last_fullsized":"2023-09-30T13:54:54.446862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449338+0000","last_change":"2023-09-30T13:54:50.417249+0000","last_active":"2023-09-30T13:54:54.449338+0000","last_peered":"2023-09-30T13:54:54.449338+0000","last_clean":"2023-09-30T13:54:54.449338+0000","last_became_active":"2023-09-30T13:54:50.416968+0000","last_became_peered":"2023-09-30T13:54:50.416968+0000","last_unstale":"2023-09-30T13:54:54.449338+0000","last_undegraded":"2023-09-30T13:54:54.449338+0000","last_fullsized":"2023-09-30T13:54:54.449338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454724+0000","last_change":"2023-09-30T13:54:50.414645+0000","last_active":"2023-09-30T13:54:54.454724+0000","last_peered":"2023-09-30T13:54:54.454724+0000","last_clean":"2023-09-30T13:54:54.454724+0000","last_became_active":"2023-09-30T13:54:50.414355+0000","last_became_peered":"2023-09-30T13:54:50.414355+0000","last_unstale":"2023-09-30T13:54:54.454724+0000","last_undegraded":"2023-09-30T13:54:54.454724+0000","last_fullsized":"2023-09-30T13:54:54.454724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442101+0000","last_change":"2023-09-30T13:54:50.400252+0000","last_active":"2023-09-30T13:54:54.442101+0000","last_peered":"2023-09-30T13:54:54.442101+0000","last_clean":"2023-09-30T13:54:54.442101+0000","last_became_active":"2023-09-30T13:54:50.399917+0000","last_became_peered":"2023-09-30T13:54:50.399917+0000","last_unstale":"2023-09-30T13:54:54.442101+0000","last_undegraded":"2023-09-30T13:54:54.442101+0000","last_fullsized":"2023-09-30T13:54:54.442101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439388+0000","last_change":"2023-09-30T13:54:50.414491+0000","last_active":"2023-09-30T13:54:54.439388+0000","last_peered":"2023-09-30T13:54:54.439388+0000","last_clean":"2023-09-30T13:54:54.439388+0000","last_became_active":"2023-09-30T13:54:50.414221+0000","last_became_peered":"2023-09-30T13:54:50.414221+0000","last_unstale":"2023-09-30T13:54:54.439388+0000","last_undegraded":"2023-09-30T13:54:54.439388+0000","last_fullsized":"2023-09-30T13:54:54.439388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446932+0000","last_change":"2023-09-30T13:54:50.413491+0000","last_active":"2023-09-30T13:54:54.446932+0000","last_peered":"2023-09-30T13:54:54.446932+0000","last_clean":"2023-09-30T13:54:54.446932+0000","last_became_active":"2023-09-30T13:54:50.413226+0000","last_became_peered":"2023-09-30T13:54:50.413226+0000","last_unstale":"2023-09-30T13:54:54.446932+0000","last_undegraded":"2023-09-30T13:54:54.446932+0000","last_fullsized":"2023-09-30T13:54:54.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441831+0000","last_change":"2023-09-30T13:54:50.399450+0000","last_active":"2023-09-30T13:54:54.441831+0000","last_peered":"2023-09-30T13:54:54.441831+0000","last_clean":"2023-09-30T13:54:54.441831+0000","last_became_active":"2023-09-30T13:54:50.399129+0000","last_became_peered":"2023-09-30T13:54:50.399129+0000","last_unstale":"2023-09-30T13:54:54.441831+0000","last_undegraded":"2023-09-30T13:54:54.441831+0000","last_fullsized":"2023-09-30T13:54:54.441831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447123+0000","last_change":"2023-09-30T13:54:50.416017+0000","last_active":"2023-09-30T13:54:54.447123+0000","last_peered":"2023-09-30T13:54:54.447123+0000","last_clean":"2023-09-30T13:54:54.447123+0000","last_became_active":"2023-09-30T13:54:50.415769+0000","last_became_peered":"2023-09-30T13:54:50.415769+0000","last_unstale":"2023-09-30T13:54:54.447123+0000","last_undegraded":"2023-09-30T13:54:54.447123+0000","last_fullsized":"2023-09-30T13:54:54.447123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441869+0000","last_change":"2023-09-30T13:54:50.401717+0000","last_active":"2023-09-30T13:54:54.441869+0000","last_peered":"2023-09-30T13:54:54.441869+0000","last_clean":"2023-09-30T13:54:54.441869+0000","last_became_active":"2023-09-30T13:54:50.401384+0000","last_became_peered":"2023-09-30T13:54:50.401384+0000","last_unstale":"2023-09-30T13:54:54.441869+0000","last_undegraded":"2023-09-30T13:54:54.441869+0000","last_fullsized":"2023-09-30T13:54:54.441869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449251+0000","last_change":"2023-09-30T13:54:50.423066+0000","last_active":"2023-09-30T13:54:54.449251+0000","last_peered":"2023-09-30T13:54:54.449251+0000","last_clean":"2023-09-30T13:54:54.449251+0000","last_became_active":"2023-09-30T13:54:50.422797+0000","last_became_peered":"2023-09-30T13:54:50.422797+0000","last_unstale":"2023-09-30T13:54:54.449251+0000","last_undegraded":"2023-09-30T13:54:54.449251+0000","last_fullsized":"2023-09-30T13:54:54.449251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454616+0000","last_change":"2023-09-30T13:54:50.412413+0000","last_active":"2023-09-30T13:54:54.454616+0000","last_peered":"2023-09-30T13:54:54.454616+0000","last_clean":"2023-09-30T13:54:54.454616+0000","last_became_active":"2023-09-30T13:54:50.412107+0000","last_became_peered":"2023-09-30T13:54:50.412107+0000","last_unstale":"2023-09-30T13:54:54.454616+0000","last_undegraded":"2023-09-30T13:54:54.454616+0000","last_fullsized":"2023-09-30T13:54:54.454616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446754+0000","last_change":"2023-09-30T13:54:50.417833+0000","last_active":"2023-09-30T13:54:54.446754+0000","last_peered":"2023-09-30T13:54:54.446754+0000","last_clean":"2023-09-30T13:54:54.446754+0000","last_became_active":"2023-09-30T13:54:50.417525+0000","last_became_peered":"2023-09-30T13:54:50.417525+0000","last_unstale":"2023-09-30T13:54:54.446754+0000","last_undegraded":"2023-09-30T13:54:54.446754+0000","last_fullsized":"2023-09-30T13:54:54.446754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458795+0000","last_change":"2023-09-30T13:54:50.412766+0000","last_active":"2023-09-30T13:54:54.458795+0000","last_peered":"2023-09-30T13:54:54.458795+0000","last_clean":"2023-09-30T13:54:54.458795+0000","last_became_active":"2023-09-30T13:54:50.412502+0000","last_became_peered":"2023-09-30T13:54:50.412502+0000","last_unstale":"2023-09-30T13:54:54.458795+0000","last_undegraded":"2023-09-30T13:54:54.458795+0000","last_fullsized":"2023-09-30T13:54:54.458795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447122+0000","last_change":"2023-09-30T13:54:50.408372+0000","last_active":"2023-09-30T13:54:54.447122+0000","last_peered":"2023-09-30T13:54:54.447122+0000","last_clean":"2023-09-30T13:54:54.447122+0000","last_became_active":"2023-09-30T13:54:50.408111+0000","last_became_peered":"2023-09-30T13:54:50.408111+0000","last_unstale":"2023-09-30T13:54:54.447122+0000","last_undegraded":"2023-09-30T13:54:54.447122+0000","last_fullsized":"2023-09-30T13:54:54.447122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450494+0000","last_change":"2023-09-30T13:54:50.418485+0000","last_active":"2023-09-30T13:54:54.450494+0000","last_peered":"2023-09-30T13:54:54.450494+0000","last_clean":"2023-09-30T13:54:54.450494+0000","last_became_active":"2023-09-30T13:54:50.417771+0000","last_became_peered":"2023-09-30T13:54:50.417771+0000","last_unstale":"2023-09-30T13:54:54.450494+0000","last_undegraded":"2023-09-30T13:54:54.450494+0000","last_fullsized":"2023-09-30T13:54:54.450494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446955+0000","last_change":"2023-09-30T13:54:50.410885+0000","last_active":"2023-09-30T13:54:54.446955+0000","last_peered":"2023-09-30T13:54:54.446955+0000","last_clean":"2023-09-30T13:54:54.446955+0000","last_became_active":"2023-09-30T13:54:50.410590+0000","last_became_peered":"2023-09-30T13:54:50.410590+0000","last_unstale":"2023-09-30T13:54:54.446955+0000","last_undegraded":"2023-09-30T13:54:54.446955+0000","last_fullsized":"2023-09-30T13:54:54.446955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439246+0000","last_change":"2023-09-30T13:54:50.415957+0000","last_active":"2023-09-30T13:54:54.439246+0000","last_peered":"2023-09-30T13:54:54.439246+0000","last_clean":"2023-09-30T13:54:54.439246+0000","last_became_active":"2023-09-30T13:54:50.415634+0000","last_became_peered":"2023-09-30T13:54:50.415634+0000","last_unstale":"2023-09-30T13:54:54.439246+0000","last_undegraded":"2023-09-30T13:54:54.439246+0000","last_fullsized":"2023-09-30T13:54:54.439246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453850+0000","last_change":"2023-09-30T13:54:50.411326+0000","last_active":"2023-09-30T13:54:54.453850+0000","last_peered":"2023-09-30T13:54:54.453850+0000","last_clean":"2023-09-30T13:54:54.453850+0000","last_became_active":"2023-09-30T13:54:50.410982+0000","last_became_peered":"2023-09-30T13:54:50.410982+0000","last_unstale":"2023-09-30T13:54:54.453850+0000","last_undegraded":"2023-09-30T13:54:54.453850+0000","last_fullsized":"2023-09-30T13:54:54.453850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:41.710382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444714+0000","last_change":"2023-09-30T13:54:50.410846+0000","last_active":"2023-09-30T13:54:54.444714+0000","last_peered":"2023-09-30T13:54:54.444714+0000","last_clean":"2023-09-30T13:54:54.444714+0000","last_became_active":"2023-09-30T13:54:50.410552+0000","last_became_peered":"2023-09-30T13:54:50.410552+0000","last_unstale":"2023-09-30T13:54:54.444714+0000","last_undegraded":"2023-09-30T13:54:54.444714+0000","last_fullsized":"2023-09-30T13:54:54.444714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442982+0000","last_change":"2023-09-30T13:54:50.414413+0000","last_active":"2023-09-30T13:54:54.442982+0000","last_peered":"2023-09-30T13:54:54.442982+0000","last_clean":"2023-09-30T13:54:54.442982+0000","last_became_active":"2023-09-30T13:54:50.413675+0000","last_became_peered":"2023-09-30T13:54:50.413675+0000","last_unstale":"2023-09-30T13:54:54.442982+0000","last_undegraded":"2023-09-30T13:54:54.442982+0000","last_fullsized":"2023-09-30T13:54:54.442982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447232+0000","last_change":"2023-09-30T13:54:50.413676+0000","last_active":"2023-09-30T13:54:54.447232+0000","last_peered":"2023-09-30T13:54:54.447232+0000","last_clean":"2023-09-30T13:54:54.447232+0000","last_became_active":"2023-09-30T13:54:50.412614+0000","last_became_peered":"2023-09-30T13:54:50.412614+0000","last_unstale":"2023-09-30T13:54:54.447232+0000","last_undegraded":"2023-09-30T13:54:54.447232+0000","last_fullsized":"2023-09-30T13:54:54.447232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446834+0000","last_change":"2023-09-30T13:54:50.412729+0000","last_active":"2023-09-30T13:54:54.446834+0000","last_peered":"2023-09-30T13:54:54.446834+0000","last_clean":"2023-09-30T13:54:54.446834+0000","last_became_active":"2023-09-30T13:54:50.412478+0000","last_became_peered":"2023-09-30T13:54:50.412478+0000","last_unstale":"2023-09-30T13:54:54.446834+0000","last_undegraded":"2023-09-30T13:54:54.446834+0000","last_fullsized":"2023-09-30T13:54:54.446834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458895+0000","last_change":"2023-09-30T13:54:50.416012+0000","last_active":"2023-09-30T13:54:54.458895+0000","last_peered":"2023-09-30T13:54:54.458895+0000","last_clean":"2023-09-30T13:54:54.458895+0000","last_became_active":"2023-09-30T13:54:50.414957+0000","last_became_peered":"2023-09-30T13:54:50.414957+0000","last_unstale":"2023-09-30T13:54:54.458895+0000","last_undegraded":"2023-09-30T13:54:54.458895+0000","last_fullsized":"2023-09-30T13:54:54.458895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:54.613251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444109+0000","last_change":"2023-09-30T13:54:50.405513+0000","last_active":"2023-09-30T13:54:54.444109+0000","last_peered":"2023-09-30T13:54:54.444109+0000","last_clean":"2023-09-30T13:54:54.444109+0000","last_became_active":"2023-09-30T13:54:50.404703+0000","last_became_peered":"2023-09-30T13:54:50.404703+0000","last_unstale":"2023-09-30T13:54:54.444109+0000","last_undegraded":"2023-09-30T13:54:54.444109+0000","last_fullsized":"2023-09-30T13:54:54.444109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458099+0000","last_change":"2023-09-30T13:54:50.418187+0000","last_active":"2023-09-30T13:54:54.458099+0000","last_peered":"2023-09-30T13:54:54.458099+0000","last_clean":"2023-09-30T13:54:54.458099+0000","last_became_active":"2023-09-30T13:54:50.417894+0000","last_became_peered":"2023-09-30T13:54:50.417894+0000","last_unstale":"2023-09-30T13:54:54.458099+0000","last_undegraded":"2023-09-30T13:54:54.458099+0000","last_fullsized":"2023-09-30T13:54:54.458099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449166+0000","last_change":"2023-09-30T13:54:50.410069+0000","last_active":"2023-09-30T13:54:54.449166+0000","last_peered":"2023-09-30T13:54:54.449166+0000","last_clean":"2023-09-30T13:54:54.449166+0000","last_became_active":"2023-09-30T13:54:50.409788+0000","last_became_peered":"2023-09-30T13:54:50.409788+0000","last_unstale":"2023-09-30T13:54:54.449166+0000","last_undegraded":"2023-09-30T13:54:54.449166+0000","last_fullsized":"2023-09-30T13:54:54.449166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458341+0000","last_change":"2023-09-30T13:54:50.411521+0000","last_active":"2023-09-30T13:54:54.458341+0000","last_peered":"2023-09-30T13:54:54.458341+0000","last_clean":"2023-09-30T13:54:54.458341+0000","last_became_active":"2023-09-30T13:54:50.411249+0000","last_became_peered":"2023-09-30T13:54:50.411249+0000","last_unstale":"2023-09-30T13:54:54.458341+0000","last_undegraded":"2023-09-30T13:54:54.458341+0000","last_fullsized":"2023-09-30T13:54:54.458341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448866+0000","last_change":"2023-09-30T13:54:50.416620+0000","last_active":"2023-09-30T13:54:54.448866+0000","last_peered":"2023-09-30T13:54:54.448866+0000","last_clean":"2023-09-30T13:54:54.448866+0000","last_became_active":"2023-09-30T13:54:50.416353+0000","last_became_peered":"2023-09-30T13:54:50.416353+0000","last_unstale":"2023-09-30T13:54:54.448866+0000","last_undegraded":"2023-09-30T13:54:54.448866+0000","last_fullsized":"2023-09-30T13:54:54.448866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454120+0000","last_change":"2023-09-30T13:54:50.408896+0000","last_active":"2023-09-30T13:54:54.454120+0000","last_peered":"2023-09-30T13:54:54.454120+0000","last_clean":"2023-09-30T13:54:54.454120+0000","last_became_active":"2023-09-30T13:54:50.407306+0000","last_became_peered":"2023-09-30T13:54:50.407306+0000","last_unstale":"2023-09-30T13:54:54.454120+0000","last_undegraded":"2023-09-30T13:54:54.454120+0000","last_fullsized":"2023-09-30T13:54:54.454120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439826+0000","last_change":"2023-09-30T13:54:50.409514+0000","last_active":"2023-09-30T13:54:54.439826+0000","last_peered":"2023-09-30T13:54:54.439826+0000","last_clean":"2023-09-30T13:54:54.439826+0000","last_became_active":"2023-09-30T13:54:50.409220+0000","last_became_peered":"2023-09-30T13:54:50.409220+0000","last_unstale":"2023-09-30T13:54:54.439826+0000","last_undegraded":"2023-09-30T13:54:54.439826+0000","last_fullsized":"2023-09-30T13:54:54.439826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458792+0000","last_change":"2023-09-30T13:54:50.415599+0000","last_active":"2023-09-30T13:54:54.458792+0000","last_peered":"2023-09-30T13:54:54.458792+0000","last_clean":"2023-09-30T13:54:54.458792+0000","last_became_active":"2023-09-30T13:54:50.414604+0000","last_became_peered":"2023-09-30T13:54:50.414604+0000","last_unstale":"2023-09-30T13:54:54.458792+0000","last_undegraded":"2023-09-30T13:54:54.458792+0000","last_fullsized":"2023-09-30T13:54:54.458792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:55:07.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:55:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.627+0000 7f218013a640 1 Processor -- start 2023-09-30T13:55:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.627+0000 7f218013a640 1 -- start start 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 0x7f21780c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21780ac2b0 0x7f21780cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21780ac720 0x7f21780ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780d06d0 con 0x7f21780ac2b0 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780cb8a0 con 0x7f217815aab0 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f218013a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780cbb80 con 0x7f21780ac720 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21780ac2b0 0x7f21780cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21780ac2b0 0x7f21780cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39128/0 (socket says 172.21.15.62:39128) 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 -- 172.21.15.62:0/4234550684 learned_addr learned my addr 172.21.15.62:0/4234550684 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217ded6640 1 --2- 172.21.15.62:0/4234550684 >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 0x7f21780c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 -- 172.21.15.62:0/4234550684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21780ac720 msgr2=0x7f21780ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 --2- 172.21.15.62:0/4234550684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21780ac720 0x7f21780ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 -- 172.21.15.62:0/4234550684 >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 msgr2=0x7f21780c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 --2- 172.21.15.62:0/4234550684 >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 0x7f21780c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217d6d5640 1 -- 172.21.15.62:0/4234550684 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780cbe60 con 0x7f21780ac2b0 2023-09-30T13:55:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.628+0000 7f217ded6640 1 --2- 172.21.15.62:0/4234550684 >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 0x7f21780c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f217d6d5640 1 --2- 172.21.15.62:0/4234550684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f21780cc660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21780cd210 tx=0x7f216802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de994222c52d9cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f217ced4640 1 -- 172.21.15.62:0/4234550684 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168031870 con 0x7f21780ac2b0 2023-09-30T13:55:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f217ced4640 1 -- 172.21.15.62:0/4234550684 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21680319d0 con 0x7f21780ac2b0 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f217ced4640 1 -- 172.21.15.62:0/4234550684 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168031d60 con 0x7f21780ac2b0 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f218013a640 1 -- 172.21.15.62:0/4234550684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 msgr2=0x7f21780cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.629+0000 7f218013a640 1 --2- 172.21.15.62:0/4234550684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f21780cc660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21780cd210 tx=0x7f216802b910 comp rx=0 tx=0).stop 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 -- 172.21.15.62:0/4234550684 shutdown_connections 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 --2- 172.21.15.62:0/4234550684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21780ac720 0x7f21780ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 --2- 172.21.15.62:0/4234550684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f21780cc660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 --2- 172.21.15.62:0/4234550684 >> v2:172.21.15.135:3300/0 conn(0x7f217815aab0 0x7f21780c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 -- 172.21.15.62:0/4234550684 >> 172.21.15.62:0/4234550684 conn(0x7f2178098a50 msgr2=0x7f21780cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 -- 172.21.15.62:0/4234550684 shutdown_connections 2023-09-30T13:55:07.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.630+0000 7f218013a640 1 -- 172.21.15.62:0/4234550684 wait complete. 2023-09-30T13:55:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 Processor -- start 2023-09-30T13:55:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 -- start start 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 0x7f21780c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f217815aab0 0x7f2178154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780c61f0 con 0x7f21780ac2b0 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21781548b0 con 0x7f21780ac720 2023-09-30T13:55:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.631+0000 7f218013a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178150200 con 0x7f217815aab0 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39132/0 (socket says 172.21.15.62:39132) 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 -- 172.21.15.62:0/2143596396 learned_addr learned my addr 172.21.15.62:0/2143596396 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217d6d5640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 0x7f21780c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217e6d7640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f217815aab0 0x7f2178154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 -- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f217815aab0 msgr2=0x7f2178154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f217815aab0 0x7f2178154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 -- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 msgr2=0x7f21780c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 0x7f21780c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 -- 172.21.15.62:0/2143596396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680094d0 con 0x7f21780ac2b0 2023-09-30T13:55:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217d6d5640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 0x7f21780c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f217ded6640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f217400c820 tx=0x7f217400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174005b90 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174005cf0 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2178153ce0 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174007a30 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.632+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2178154260 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.633+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217804e0d0 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.634+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2174007b90 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.634+0000 7f216e7fc640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 0x7f215c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.634+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2174089420 con 0x7f21780ac2b0 2023-09-30T13:55:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.634+0000 7f217d6d5640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 0x7f215c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.635+0000 7f217d6d5640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 0x7f215c06cff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2168036000 tx=0x7f216803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.638+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2174054410 con 0x7f21780ac2b0 2023-09-30T13:55:07.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.810+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21780cb550 con 0x7f215c06ab30 2023-09-30T13:55:07.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.819+0000 7f216e7fc640 1 -- 172.21.15.62:0/2143596396 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7f2168031e00 con 0x7f215c06ab30 2023-09-30T13:55:07.822 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:07.823 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 msgr2=0x7f215c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 0x7f215c06cff0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2168036000 tx=0x7f216803c040 comp rx=0 tx=0).stop 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 msgr2=0x7f217814fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f217400c820 tx=0x7f217400cc20 comp rx=0 tx=0).stop 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 shutdown_connections 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f215c06ab30 0x7f215c06cff0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f217815aab0 0x7f2178154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21780ac720 0x7f21780c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 --2- 172.21.15.62:0/2143596396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21780ac2b0 0x7f217814fcc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 >> 172.21.15.62:0/2143596396 conn(0x7f2178098a50 msgr2=0x7f2178069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 shutdown_connections 2023-09-30T13:55:07.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.822+0000 7f218013a640 1 -- 172.21.15.62:0/2143596396 wait complete. 2023-09-30T13:55:07.832 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-30T13:55:07.676589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1987972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003282"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454383+0000","last_change":"2023-09-30T13:54:49.420957+0000","last_active":"2023-09-30T13:54:54.454383+0000","last_peered":"2023-09-30T13:54:54.454383+0000","last_clean":"2023-09-30T13:54:54.454383+0000","last_became_active":"2023-09-30T13:54:49.420645+0000","last_became_peered":"2023-09-30T13:54:49.420645+0000","last_unstale":"2023-09-30T13:54:54.454383+0000","last_undegraded":"2023-09-30T13:54:54.454383+0000","last_fullsized":"2023-09-30T13:54:54.454383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440525+0000","last_change":"2023-09-30T13:54:50.403409+0000","last_active":"2023-09-30T13:54:54.440525+0000","last_peered":"2023-09-30T13:54:54.440525+0000","last_clean":"2023-09-30T13:54:54.440525+0000","last_became_active":"2023-09-30T13:54:50.403080+0000","last_became_peered":"2023-09-30T13:54:50.403080+0000","last_unstale":"2023-09-30T13:54:54.440525+0000","last_undegraded":"2023-09-30T13:54:54.440525+0000","last_fullsized":"2023-09-30T13:54:54.440525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394904+0000","last_change":"2023-09-30T13:54:54.461252+0000","last_active":"2023-09-30T13:54:55.394904+0000","last_peered":"2023-09-30T13:54:55.394904+0000","last_clean":"2023-09-30T13:54:55.394904+0000","last_became_active":"2023-09-30T13:54:54.460732+0000","last_became_peered":"2023-09-30T13:54:54.460732+0000","last_unstale":"2023-09-30T13:54:55.394904+0000","last_undegraded":"2023-09-30T13:54:55.394904+0000","last_fullsized":"2023-09-30T13:54:55.394904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440632+0000","last_change":"2023-09-30T13:54:49.417394+0000","last_active":"2023-09-30T13:54:54.440632+0000","last_peered":"2023-09-30T13:54:54.440632+0000","last_clean":"2023-09-30T13:54:54.440632+0000","last_became_active":"2023-09-30T13:54:49.417129+0000","last_became_peered":"2023-09-30T13:54:49.417129+0000","last_unstale":"2023-09-30T13:54:54.440632+0000","last_undegraded":"2023-09-30T13:54:54.440632+0000","last_fullsized":"2023-09-30T13:54:54.440632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454087+0000","last_change":"2023-09-30T13:54:50.412921+0000","last_active":"2023-09-30T13:54:54.454087+0000","last_peered":"2023-09-30T13:54:54.454087+0000","last_clean":"2023-09-30T13:54:54.454087+0000","last_became_active":"2023-09-30T13:54:50.412639+0000","last_became_peered":"2023-09-30T13:54:50.412639+0000","last_unstale":"2023-09-30T13:54:54.454087+0000","last_undegraded":"2023-09-30T13:54:54.454087+0000","last_fullsized":"2023-09-30T13:54:54.454087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395450+0000","last_change":"2023-09-30T13:54:54.451254+0000","last_active":"2023-09-30T13:54:55.395450+0000","last_peered":"2023-09-30T13:54:55.395450+0000","last_clean":"2023-09-30T13:54:55.395450+0000","last_became_active":"2023-09-30T13:54:54.450838+0000","last_became_peered":"2023-09-30T13:54:54.450838+0000","last_unstale":"2023-09-30T13:54:55.395450+0000","last_undegraded":"2023-09-30T13:54:55.395450+0000","last_fullsized":"2023-09-30T13:54:55.395450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:29.042314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458680+0000","last_change":"2023-09-30T13:54:49.419160+0000","last_active":"2023-09-30T13:54:54.458680+0000","last_peered":"2023-09-30T13:54:54.458680+0000","last_clean":"2023-09-30T13:54:54.458680+0000","last_became_active":"2023-09-30T13:54:49.418836+0000","last_became_peered":"2023-09-30T13:54:49.418836+0000","last_unstale":"2023-09-30T13:54:54.458680+0000","last_undegraded":"2023-09-30T13:54:54.458680+0000","last_fullsized":"2023-09-30T13:54:54.458680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450093+0000","last_change":"2023-09-30T13:54:50.412155+0000","last_active":"2023-09-30T13:54:54.450093+0000","last_peered":"2023-09-30T13:54:54.450093+0000","last_clean":"2023-09-30T13:54:54.450093+0000","last_became_active":"2023-09-30T13:54:50.411864+0000","last_became_peered":"2023-09-30T13:54:50.411864+0000","last_unstale":"2023-09-30T13:54:54.450093+0000","last_undegraded":"2023-09-30T13:54:54.450093+0000","last_fullsized":"2023-09-30T13:54:54.450093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395306+0000","last_change":"2023-09-30T13:54:54.462010+0000","last_active":"2023-09-30T13:54:55.395306+0000","last_peered":"2023-09-30T13:54:55.395306+0000","last_clean":"2023-09-30T13:54:55.395306+0000","last_became_active":"2023-09-30T13:54:54.461058+0000","last_became_peered":"2023-09-30T13:54:54.461058+0000","last_unstale":"2023-09-30T13:54:55.395306+0000","last_undegraded":"2023-09-30T13:54:55.395306+0000","last_fullsized":"2023-09-30T13:54:55.395306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:25.190712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458145+0000","last_change":"2023-09-30T13:54:49.427182+0000","last_active":"2023-09-30T13:54:54.458145+0000","last_peered":"2023-09-30T13:54:54.458145+0000","last_clean":"2023-09-30T13:54:54.458145+0000","last_became_active":"2023-09-30T13:54:49.426903+0000","last_became_peered":"2023-09-30T13:54:49.426903+0000","last_unstale":"2023-09-30T13:54:54.458145+0000","last_undegraded":"2023-09-30T13:54:54.458145+0000","last_fullsized":"2023-09-30T13:54:54.458145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:03.302440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450403+0000","last_change":"2023-09-30T13:54:50.417073+0000","last_active":"2023-09-30T13:54:54.450403+0000","last_peered":"2023-09-30T13:54:54.450403+0000","last_clean":"2023-09-30T13:54:54.450403+0000","last_became_active":"2023-09-30T13:54:50.416801+0000","last_became_peered":"2023-09-30T13:54:50.416801+0000","last_unstale":"2023-09-30T13:54:54.450403+0000","last_undegraded":"2023-09-30T13:54:54.450403+0000","last_fullsized":"2023-09-30T13:54:54.450403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395323+0000","last_change":"2023-09-30T13:54:54.458847+0000","last_active":"2023-09-30T13:54:55.395323+0000","last_peered":"2023-09-30T13:54:55.395323+0000","last_clean":"2023-09-30T13:54:55.395323+0000","last_became_active":"2023-09-30T13:54:54.457421+0000","last_became_peered":"2023-09-30T13:54:54.457421+0000","last_unstale":"2023-09-30T13:54:55.395323+0000","last_undegraded":"2023-09-30T13:54:55.395323+0000","last_fullsized":"2023-09-30T13:54:55.395323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:58.531700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445534+0000","last_change":"2023-09-30T13:54:50.421056+0000","last_active":"2023-09-30T13:54:54.445534+0000","last_peered":"2023-09-30T13:54:54.445534+0000","last_clean":"2023-09-30T13:54:54.445534+0000","last_became_active":"2023-09-30T13:54:50.420770+0000","last_became_peered":"2023-09-30T13:54:50.420770+0000","last_unstale":"2023-09-30T13:54:54.445534+0000","last_undegraded":"2023-09-30T13:54:54.445534+0000","last_fullsized":"2023-09-30T13:54:54.445534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458473+0000","last_change":"2023-09-30T13:54:49.422297+0000","last_active":"2023-09-30T13:54:54.458473+0000","last_peered":"2023-09-30T13:54:54.458473+0000","last_clean":"2023-09-30T13:54:54.458473+0000","last_became_active":"2023-09-30T13:54:49.422032+0000","last_became_peered":"2023-09-30T13:54:49.422032+0000","last_unstale":"2023-09-30T13:54:54.458473+0000","last_undegraded":"2023-09-30T13:54:54.458473+0000","last_fullsized":"2023-09-30T13:54:54.458473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395905+0000","last_change":"2023-09-30T13:54:54.456854+0000","last_active":"2023-09-30T13:54:55.395905+0000","last_peered":"2023-09-30T13:54:55.395905+0000","last_clean":"2023-09-30T13:54:55.395905+0000","last_became_active":"2023-09-30T13:54:54.456476+0000","last_became_peered":"2023-09-30T13:54:54.456476+0000","last_unstale":"2023-09-30T13:54:55.395905+0000","last_undegraded":"2023-09-30T13:54:55.395905+0000","last_fullsized":"2023-09-30T13:54:55.395905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:28.802733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440683+0000","last_change":"2023-09-30T13:54:50.410713+0000","last_active":"2023-09-30T13:54:54.440683+0000","last_peered":"2023-09-30T13:54:54.440683+0000","last_clean":"2023-09-30T13:54:54.440683+0000","last_became_active":"2023-09-30T13:54:50.410454+0000","last_became_peered":"2023-09-30T13:54:50.410454+0000","last_unstale":"2023-09-30T13:54:54.440683+0000","last_undegraded":"2023-09-30T13:54:54.440683+0000","last_fullsized":"2023-09-30T13:54:54.440683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442060+0000","last_change":"2023-09-30T13:54:49.415626+0000","last_active":"2023-09-30T13:54:54.442060+0000","last_peered":"2023-09-30T13:54:54.442060+0000","last_clean":"2023-09-30T13:54:54.442060+0000","last_became_active":"2023-09-30T13:54:49.415378+0000","last_became_peered":"2023-09-30T13:54:49.415378+0000","last_unstale":"2023-09-30T13:54:54.442060+0000","last_undegraded":"2023-09-30T13:54:54.442060+0000","last_fullsized":"2023-09-30T13:54:54.442060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395657+0000","last_change":"2023-09-30T13:54:54.454291+0000","last_active":"2023-09-30T13:54:55.395657+0000","last_peered":"2023-09-30T13:54:55.395657+0000","last_clean":"2023-09-30T13:54:55.395657+0000","last_became_active":"2023-09-30T13:54:54.453505+0000","last_became_peered":"2023-09-30T13:54:54.453505+0000","last_unstale":"2023-09-30T13:54:55.395657+0000","last_undegraded":"2023-09-30T13:54:55.395657+0000","last_fullsized":"2023-09-30T13:54:55.395657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:56.027992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443495+0000","last_change":"2023-09-30T13:54:50.410244+0000","last_active":"2023-09-30T13:54:54.443495+0000","last_peered":"2023-09-30T13:54:54.443495+0000","last_clean":"2023-09-30T13:54:54.443495+0000","last_became_active":"2023-09-30T13:54:50.409602+0000","last_became_peered":"2023-09-30T13:54:50.409602+0000","last_unstale":"2023-09-30T13:54:54.443495+0000","last_undegraded":"2023-09-30T13:54:54.443495+0000","last_fullsized":"2023-09-30T13:54:54.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439311+0000","last_change":"2023-09-30T13:54:49.418424+0000","last_active":"2023-09-30T13:54:54.439311+0000","last_peered":"2023-09-30T13:54:54.439311+0000","last_clean":"2023-09-30T13:54:54.439311+0000","last_became_active":"2023-09-30T13:54:49.417956+0000","last_became_peered":"2023-09-30T13:54:49.417956+0000","last_unstale":"2023-09-30T13:54:54.439311+0000","last_undegraded":"2023-09-30T13:54:54.439311+0000","last_fullsized":"2023-09-30T13:54:54.439311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556417+0000","last_change":"2023-09-30T13:54:54.462623+0000","last_active":"2023-09-30T13:54:55.556417+0000","last_peered":"2023-09-30T13:54:55.556417+0000","last_clean":"2023-09-30T13:54:55.556417+0000","last_became_active":"2023-09-30T13:54:54.462207+0000","last_became_peered":"2023-09-30T13:54:54.462207+0000","last_unstale":"2023-09-30T13:54:55.556417+0000","last_undegraded":"2023-09-30T13:54:55.556417+0000","last_fullsized":"2023-09-30T13:54:55.556417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443009+0000","last_change":"2023-09-30T13:54:50.413527+0000","last_active":"2023-09-30T13:54:54.443009+0000","last_peered":"2023-09-30T13:54:54.443009+0000","last_clean":"2023-09-30T13:54:54.443009+0000","last_became_active":"2023-09-30T13:54:50.413227+0000","last_became_peered":"2023-09-30T13:54:50.413227+0000","last_unstale":"2023-09-30T13:54:54.443009+0000","last_undegraded":"2023-09-30T13:54:54.443009+0000","last_fullsized":"2023-09-30T13:54:54.443009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:53.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457857+0000","last_change":"2023-09-30T13:54:49.425834+0000","last_active":"2023-09-30T13:54:54.457857+0000","last_peered":"2023-09-30T13:54:54.457857+0000","last_clean":"2023-09-30T13:54:54.457857+0000","last_became_active":"2023-09-30T13:54:49.424534+0000","last_became_peered":"2023-09-30T13:54:49.424534+0000","last_unstale":"2023-09-30T13:54:54.457857+0000","last_undegraded":"2023-09-30T13:54:54.457857+0000","last_fullsized":"2023-09-30T13:54:54.457857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:38.360726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395974+0000","last_change":"2023-09-30T13:54:54.461499+0000","last_active":"2023-09-30T13:54:55.395974+0000","last_peered":"2023-09-30T13:54:55.395974+0000","last_clean":"2023-09-30T13:54:55.395974+0000","last_became_active":"2023-09-30T13:54:54.461112+0000","last_became_peered":"2023-09-30T13:54:54.461112+0000","last_unstale":"2023-09-30T13:54:55.395974+0000","last_undegraded":"2023-09-30T13:54:55.395974+0000","last_fullsized":"2023-09-30T13:54:55.395974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454330+0000","last_change":"2023-09-30T13:54:50.410914+0000","last_active":"2023-09-30T13:54:54.454330+0000","last_peered":"2023-09-30T13:54:54.454330+0000","last_clean":"2023-09-30T13:54:54.454330+0000","last_became_active":"2023-09-30T13:54:50.410418+0000","last_became_peered":"2023-09-30T13:54:50.410418+0000","last_unstale":"2023-09-30T13:54:54.454330+0000","last_undegraded":"2023-09-30T13:54:54.454330+0000","last_fullsized":"2023-09-30T13:54:54.454330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447170+0000","last_change":"2023-09-30T13:54:49.422040+0000","last_active":"2023-09-30T13:54:54.447170+0000","last_peered":"2023-09-30T13:54:54.447170+0000","last_clean":"2023-09-30T13:54:54.447170+0000","last_became_active":"2023-09-30T13:54:49.421750+0000","last_became_peered":"2023-09-30T13:54:49.421750+0000","last_unstale":"2023-09-30T13:54:54.447170+0000","last_undegraded":"2023-09-30T13:54:54.447170+0000","last_fullsized":"2023-09-30T13:54:54.447170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395403+0000","last_change":"2023-09-30T13:54:54.461309+0000","last_active":"2023-09-30T13:54:55.395403+0000","last_peered":"2023-09-30T13:54:55.395403+0000","last_clean":"2023-09-30T13:54:55.395403+0000","last_became_active":"2023-09-30T13:54:54.460864+0000","last_became_peered":"2023-09-30T13:54:54.460864+0000","last_unstale":"2023-09-30T13:54:55.395403+0000","last_undegraded":"2023-09-30T13:54:55.395403+0000","last_fullsized":"2023-09-30T13:54:55.395403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:02.815628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441932+0000","last_change":"2023-09-30T13:54:50.412240+0000","last_active":"2023-09-30T13:54:54.441932+0000","last_peered":"2023-09-30T13:54:54.441932+0000","last_clean":"2023-09-30T13:54:54.441932+0000","last_became_active":"2023-09-30T13:54:50.411943+0000","last_became_peered":"2023-09-30T13:54:50.411943+0000","last_unstale":"2023-09-30T13:54:54.441932+0000","last_undegraded":"2023-09-30T13:54:54.441932+0000","last_fullsized":"2023-09-30T13:54:54.441932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439918+0000","last_change":"2023-09-30T13:54:49.416854+0000","last_active":"2023-09-30T13:54:54.439918+0000","last_peered":"2023-09-30T13:54:54.439918+0000","last_clean":"2023-09-30T13:54:54.439918+0000","last_became_active":"2023-09-30T13:54:49.416581+0000","last_became_peered":"2023-09-30T13:54:49.416581+0000","last_unstale":"2023-09-30T13:54:54.439918+0000","last_undegraded":"2023-09-30T13:54:54.439918+0000","last_fullsized":"2023-09-30T13:54:54.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394833+0000","last_change":"2023-09-30T13:54:54.462965+0000","last_active":"2023-09-30T13:54:55.394833+0000","last_peered":"2023-09-30T13:54:55.394833+0000","last_clean":"2023-09-30T13:54:55.394833+0000","last_became_active":"2023-09-30T13:54:54.462601+0000","last_became_peered":"2023-09-30T13:54:54.462601+0000","last_unstale":"2023-09-30T13:54:55.394833+0000","last_undegraded":"2023-09-30T13:54:55.394833+0000","last_fullsized":"2023-09-30T13:54:55.394833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:43:37.820526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439588+0000","last_change":"2023-09-30T13:54:50.408191+0000","last_active":"2023-09-30T13:54:54.439588+0000","last_peered":"2023-09-30T13:54:54.439588+0000","last_clean":"2023-09-30T13:54:54.439588+0000","last_became_active":"2023-09-30T13:54:50.407941+0000","last_became_peered":"2023-09-30T13:54:50.407941+0000","last_unstale":"2023-09-30T13:54:54.439588+0000","last_undegraded":"2023-09-30T13:54:54.439588+0000","last_fullsized":"2023-09-30T13:54:54.439588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458784+0000","last_change":"2023-09-30T13:54:49.425042+0000","last_active":"2023-09-30T13:54:54.458784+0000","last_peered":"2023-09-30T13:54:54.458784+0000","last_clean":"2023-09-30T13:54:54.458784+0000","last_became_active":"2023-09-30T13:54:49.424790+0000","last_became_peered":"2023-09-30T13:54:49.424790+0000","last_unstale":"2023-09-30T13:54:54.458784+0000","last_undegraded":"2023-09-30T13:54:54.458784+0000","last_fullsized":"2023-09-30T13:54:54.458784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555303+0000","last_change":"2023-09-30T13:54:54.466551+0000","last_active":"2023-09-30T13:54:55.555303+0000","last_peered":"2023-09-30T13:54:55.555303+0000","last_clean":"2023-09-30T13:54:55.555303+0000","last_became_active":"2023-09-30T13:54:54.464011+0000","last_became_peered":"2023-09-30T13:54:54.464011+0000","last_unstale":"2023-09-30T13:54:55.555303+0000","last_undegraded":"2023-09-30T13:54:55.555303+0000","last_fullsized":"2023-09-30T13:54:55.555303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450488+0000","last_change":"2023-09-30T13:54:50.415029+0000","last_active":"2023-09-30T13:54:54.450488+0000","last_peered":"2023-09-30T13:54:54.450488+0000","last_clean":"2023-09-30T13:54:54.450488+0000","last_became_active":"2023-09-30T13:54:50.414756+0000","last_became_peered":"2023-09-30T13:54:50.414756+0000","last_unstale":"2023-09-30T13:54:54.450488+0000","last_undegraded":"2023-09-30T13:54:54.450488+0000","last_fullsized":"2023-09-30T13:54:54.450488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439678+0000","last_change":"2023-09-30T13:54:49.421098+0000","last_active":"2023-09-30T13:54:54.439678+0000","last_peered":"2023-09-30T13:54:54.439678+0000","last_clean":"2023-09-30T13:54:54.439678+0000","last_became_active":"2023-09-30T13:54:49.420826+0000","last_became_peered":"2023-09-30T13:54:49.420826+0000","last_unstale":"2023-09-30T13:54:54.439678+0000","last_undegraded":"2023-09-30T13:54:54.439678+0000","last_fullsized":"2023-09-30T13:54:54.439678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555580+0000","last_change":"2023-09-30T13:54:54.460534+0000","last_active":"2023-09-30T13:54:55.555580+0000","last_peered":"2023-09-30T13:54:55.555580+0000","last_clean":"2023-09-30T13:54:55.555580+0000","last_became_active":"2023-09-30T13:54:54.459808+0000","last_became_peered":"2023-09-30T13:54:54.459808+0000","last_unstale":"2023-09-30T13:54:55.555580+0000","last_undegraded":"2023-09-30T13:54:55.555580+0000","last_fullsized":"2023-09-30T13:54:55.555580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443004+0000","last_change":"2023-09-30T13:54:50.409280+0000","last_active":"2023-09-30T13:54:54.443004+0000","last_peered":"2023-09-30T13:54:54.443004+0000","last_clean":"2023-09-30T13:54:54.443004+0000","last_became_active":"2023-09-30T13:54:50.408982+0000","last_became_peered":"2023-09-30T13:54:50.408982+0000","last_unstale":"2023-09-30T13:54:54.443004+0000","last_undegraded":"2023-09-30T13:54:54.443004+0000","last_fullsized":"2023-09-30T13:54:54.443004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:04.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449516+0000","last_change":"2023-09-30T13:54:49.426134+0000","last_active":"2023-09-30T13:54:54.449516+0000","last_peered":"2023-09-30T13:54:54.449516+0000","last_clean":"2023-09-30T13:54:54.449516+0000","last_became_active":"2023-09-30T13:54:49.425836+0000","last_became_peered":"2023-09-30T13:54:49.425836+0000","last_unstale":"2023-09-30T13:54:54.449516+0000","last_undegraded":"2023-09-30T13:54:54.449516+0000","last_fullsized":"2023-09-30T13:54:54.449516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:09.783758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556338+0000","last_change":"2023-09-30T13:54:54.455762+0000","last_active":"2023-09-30T13:54:55.556338+0000","last_peered":"2023-09-30T13:54:55.556338+0000","last_clean":"2023-09-30T13:54:55.556338+0000","last_became_active":"2023-09-30T13:54:54.455325+0000","last_became_peered":"2023-09-30T13:54:54.455325+0000","last_unstale":"2023-09-30T13:54:55.556338+0000","last_undegraded":"2023-09-30T13:54:55.556338+0000","last_fullsized":"2023-09-30T13:54:55.556338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439147+0000","last_change":"2023-09-30T13:54:50.408742+0000","last_active":"2023-09-30T13:54:54.439147+0000","last_peered":"2023-09-30T13:54:54.439147+0000","last_clean":"2023-09-30T13:54:54.439147+0000","last_became_active":"2023-09-30T13:54:50.408453+0000","last_became_peered":"2023-09-30T13:54:50.408453+0000","last_unstale":"2023-09-30T13:54:54.439147+0000","last_undegraded":"2023-09-30T13:54:54.439147+0000","last_fullsized":"2023-09-30T13:54:54.439147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448390+0000","last_change":"2023-09-30T13:54:49.421234+0000","last_active":"2023-09-30T13:54:54.448390+0000","last_peered":"2023-09-30T13:54:54.448390+0000","last_clean":"2023-09-30T13:54:54.448390+0000","last_became_active":"2023-09-30T13:54:49.420950+0000","last_became_peered":"2023-09-30T13:54:49.420950+0000","last_unstale":"2023-09-30T13:54:54.448390+0000","last_undegraded":"2023-09-30T13:54:54.448390+0000","last_fullsized":"2023-09-30T13:54:54.448390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556539+0000","last_change":"2023-09-30T13:54:54.462900+0000","last_active":"2023-09-30T13:54:55.556539+0000","last_peered":"2023-09-30T13:54:55.556539+0000","last_clean":"2023-09-30T13:54:55.556539+0000","last_became_active":"2023-09-30T13:54:54.459241+0000","last_became_peered":"2023-09-30T13:54:54.459241+0000","last_unstale":"2023-09-30T13:54:55.556539+0000","last_undegraded":"2023-09-30T13:54:55.556539+0000","last_fullsized":"2023-09-30T13:54:55.556539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453782+0000","last_change":"2023-09-30T13:54:50.405590+0000","last_active":"2023-09-30T13:54:54.453782+0000","last_peered":"2023-09-30T13:54:54.453782+0000","last_clean":"2023-09-30T13:54:54.453782+0000","last_became_active":"2023-09-30T13:54:50.405266+0000","last_became_peered":"2023-09-30T13:54:50.405266+0000","last_unstale":"2023-09-30T13:54:54.453782+0000","last_undegraded":"2023-09-30T13:54:54.453782+0000","last_fullsized":"2023-09-30T13:54:54.453782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457949+0000","last_change":"2023-09-30T13:54:49.424227+0000","last_active":"2023-09-30T13:54:54.457949+0000","last_peered":"2023-09-30T13:54:54.457949+0000","last_clean":"2023-09-30T13:54:54.457949+0000","last_became_active":"2023-09-30T13:54:49.423939+0000","last_became_peered":"2023-09-30T13:54:49.423939+0000","last_unstale":"2023-09-30T13:54:54.457949+0000","last_undegraded":"2023-09-30T13:54:54.457949+0000","last_fullsized":"2023-09-30T13:54:54.457949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:20.159794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555733+0000","last_change":"2023-09-30T13:54:54.463551+0000","last_active":"2023-09-30T13:54:55.555733+0000","last_peered":"2023-09-30T13:54:55.555733+0000","last_clean":"2023-09-30T13:54:55.555733+0000","last_became_active":"2023-09-30T13:54:54.463125+0000","last_became_peered":"2023-09-30T13:54:54.463125+0000","last_unstale":"2023-09-30T13:54:55.555733+0000","last_undegraded":"2023-09-30T13:54:55.555733+0000","last_fullsized":"2023-09-30T13:54:55.555733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440199+0000","last_change":"2023-09-30T13:54:50.410239+0000","last_active":"2023-09-30T13:54:54.440199+0000","last_peered":"2023-09-30T13:54:54.440199+0000","last_clean":"2023-09-30T13:54:54.440199+0000","last_became_active":"2023-09-30T13:54:50.409936+0000","last_became_peered":"2023-09-30T13:54:50.409936+0000","last_unstale":"2023-09-30T13:54:54.440199+0000","last_undegraded":"2023-09-30T13:54:54.440199+0000","last_fullsized":"2023-09-30T13:54:54.440199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448279+0000","last_change":"2023-09-30T13:54:49.419889+0000","last_active":"2023-09-30T13:54:54.448279+0000","last_peered":"2023-09-30T13:54:54.448279+0000","last_clean":"2023-09-30T13:54:54.448279+0000","last_became_active":"2023-09-30T13:54:49.419588+0000","last_became_peered":"2023-09-30T13:54:49.419588+0000","last_unstale":"2023-09-30T13:54:54.448279+0000","last_undegraded":"2023-09-30T13:54:54.448279+0000","last_fullsized":"2023-09-30T13:54:54.448279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:38.191440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458057+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:54:54.458057+0000","last_peered":"2023-09-30T13:54:54.458057+0000","last_clean":"2023-09-30T13:54:54.458057+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:54:54.458057+0000","last_undegraded":"2023-09-30T13:54:54.458057+0000","last_fullsized":"2023-09-30T13:54:54.458057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420181+0000","last_change":"2023-09-30T13:54:54.461747+0000","last_active":"2023-09-30T13:54:55.420181+0000","last_peered":"2023-09-30T13:54:55.420181+0000","last_clean":"2023-09-30T13:54:55.420181+0000","last_became_active":"2023-09-30T13:54:54.461313+0000","last_became_peered":"2023-09-30T13:54:54.461313+0000","last_unstale":"2023-09-30T13:54:55.420181+0000","last_undegraded":"2023-09-30T13:54:55.420181+0000","last_fullsized":"2023-09-30T13:54:55.420181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458578+0000","last_change":"2023-09-30T13:54:50.416311+0000","last_active":"2023-09-30T13:54:54.458578+0000","last_peered":"2023-09-30T13:54:54.458578+0000","last_clean":"2023-09-30T13:54:54.458578+0000","last_became_active":"2023-09-30T13:54:50.415316+0000","last_became_peered":"2023-09-30T13:54:50.415316+0000","last_unstale":"2023-09-30T13:54:54.458578+0000","last_undegraded":"2023-09-30T13:54:54.458578+0000","last_fullsized":"2023-09-30T13:54:54.458578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449816+0000","last_change":"2023-09-30T13:54:49.423309+0000","last_active":"2023-09-30T13:54:54.449816+0000","last_peered":"2023-09-30T13:54:54.449816+0000","last_clean":"2023-09-30T13:54:54.449816+0000","last_became_active":"2023-09-30T13:54:49.423038+0000","last_became_peered":"2023-09-30T13:54:49.423038+0000","last_unstale":"2023-09-30T13:54:54.449816+0000","last_undegraded":"2023-09-30T13:54:54.449816+0000","last_fullsized":"2023-09-30T13:54:54.449816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.419816+0000","last_change":"2023-09-30T13:54:54.461245+0000","last_active":"2023-09-30T13:54:55.419816+0000","last_peered":"2023-09-30T13:54:55.419816+0000","last_clean":"2023-09-30T13:54:55.419816+0000","last_became_active":"2023-09-30T13:54:54.460850+0000","last_became_peered":"2023-09-30T13:54:54.460850+0000","last_unstale":"2023-09-30T13:54:55.419816+0000","last_undegraded":"2023-09-30T13:54:55.419816+0000","last_fullsized":"2023-09-30T13:54:55.419816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450189+0000","last_change":"2023-09-30T13:54:50.415242+0000","last_active":"2023-09-30T13:54:54.450189+0000","last_peered":"2023-09-30T13:54:54.450189+0000","last_clean":"2023-09-30T13:54:54.450189+0000","last_became_active":"2023-09-30T13:54:50.414966+0000","last_became_peered":"2023-09-30T13:54:50.414966+0000","last_unstale":"2023-09-30T13:54:54.450189+0000","last_undegraded":"2023-09-30T13:54:54.450189+0000","last_fullsized":"2023-09-30T13:54:54.450189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439617+0000","last_change":"2023-09-30T13:54:49.419341+0000","last_active":"2023-09-30T13:54:54.439617+0000","last_peered":"2023-09-30T13:54:54.439617+0000","last_clean":"2023-09-30T13:54:54.439617+0000","last_became_active":"2023-09-30T13:54:49.419064+0000","last_became_peered":"2023-09-30T13:54:49.419064+0000","last_unstale":"2023-09-30T13:54:54.439617+0000","last_undegraded":"2023-09-30T13:54:54.439617+0000","last_fullsized":"2023-09-30T13:54:54.439617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555529+0000","last_change":"2023-09-30T13:54:54.470669+0000","last_active":"2023-09-30T13:54:55.555529+0000","last_peered":"2023-09-30T13:54:55.555529+0000","last_clean":"2023-09-30T13:54:55.555529+0000","last_became_active":"2023-09-30T13:54:54.470079+0000","last_became_peered":"2023-09-30T13:54:54.470079+0000","last_unstale":"2023-09-30T13:54:55.555529+0000","last_undegraded":"2023-09-30T13:54:55.555529+0000","last_fullsized":"2023-09-30T13:54:55.555529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458977+0000","last_change":"2023-09-30T13:54:50.415862+0000","last_active":"2023-09-30T13:54:54.458977+0000","last_peered":"2023-09-30T13:54:54.458977+0000","last_clean":"2023-09-30T13:54:54.458977+0000","last_became_active":"2023-09-30T13:54:50.415304+0000","last_became_peered":"2023-09-30T13:54:50.415304+0000","last_unstale":"2023-09-30T13:54:54.458977+0000","last_undegraded":"2023-09-30T13:54:54.458977+0000","last_fullsized":"2023-09-30T13:54:54.458977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:43.639609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447671+0000","last_change":"2023-09-30T13:54:49.415340+0000","last_active":"2023-09-30T13:54:54.447671+0000","last_peered":"2023-09-30T13:54:54.447671+0000","last_clean":"2023-09-30T13:54:54.447671+0000","last_became_active":"2023-09-30T13:54:49.415072+0000","last_became_peered":"2023-09-30T13:54:49.415072+0000","last_unstale":"2023-09-30T13:54:54.447671+0000","last_undegraded":"2023-09-30T13:54:54.447671+0000","last_fullsized":"2023-09-30T13:54:54.447671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:14:27.574930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555106+0000","last_change":"2023-09-30T13:54:54.458742+0000","last_active":"2023-09-30T13:54:55.555106+0000","last_peered":"2023-09-30T13:54:55.555106+0000","last_clean":"2023-09-30T13:54:55.555106+0000","last_became_active":"2023-09-30T13:54:54.458302+0000","last_became_peered":"2023-09-30T13:54:54.458302+0000","last_unstale":"2023-09-30T13:54:55.555106+0000","last_undegraded":"2023-09-30T13:54:55.555106+0000","last_fullsized":"2023-09-30T13:54:55.555106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.459145+0000","last_change":"2023-09-30T13:54:50.415857+0000","last_active":"2023-09-30T13:54:54.459145+0000","last_peered":"2023-09-30T13:54:54.459145+0000","last_clean":"2023-09-30T13:54:54.459145+0000","last_became_active":"2023-09-30T13:54:50.415551+0000","last_became_peered":"2023-09-30T13:54:50.415551+0000","last_unstale":"2023-09-30T13:54:54.459145+0000","last_undegraded":"2023-09-30T13:54:54.459145+0000","last_fullsized":"2023-09-30T13:54:54.459145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442277+0000","last_change":"2023-09-30T13:54:49.417788+0000","last_active":"2023-09-30T13:54:54.442277+0000","last_peered":"2023-09-30T13:54:54.442277+0000","last_clean":"2023-09-30T13:54:54.442277+0000","last_became_active":"2023-09-30T13:54:49.417494+0000","last_became_peered":"2023-09-30T13:54:49.417494+0000","last_unstale":"2023-09-30T13:54:54.442277+0000","last_undegraded":"2023-09-30T13:54:54.442277+0000","last_fullsized":"2023-09-30T13:54:54.442277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395085+0000","last_change":"2023-09-30T13:54:54.462891+0000","last_active":"2023-09-30T13:54:55.395085+0000","last_peered":"2023-09-30T13:54:55.395085+0000","last_clean":"2023-09-30T13:54:55.395085+0000","last_became_active":"2023-09-30T13:54:54.461379+0000","last_became_peered":"2023-09-30T13:54:54.461379+0000","last_unstale":"2023-09-30T13:54:55.395085+0000","last_undegraded":"2023-09-30T13:54:55.395085+0000","last_fullsized":"2023-09-30T13:54:55.395085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:43.391644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458032+0000","last_change":"2023-09-30T13:54:50.417980+0000","last_active":"2023-09-30T13:54:54.458032+0000","last_peered":"2023-09-30T13:54:54.458032+0000","last_clean":"2023-09-30T13:54:54.458032+0000","last_became_active":"2023-09-30T13:54:50.417570+0000","last_became_peered":"2023-09-30T13:54:50.417570+0000","last_unstale":"2023-09-30T13:54:54.458032+0000","last_undegraded":"2023-09-30T13:54:54.458032+0000","last_fullsized":"2023-09-30T13:54:54.458032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446933+0000","last_change":"2023-09-30T13:54:49.419847+0000","last_active":"2023-09-30T13:54:54.446933+0000","last_peered":"2023-09-30T13:54:54.446933+0000","last_clean":"2023-09-30T13:54:54.446933+0000","last_became_active":"2023-09-30T13:54:49.419547+0000","last_became_peered":"2023-09-30T13:54:49.419547+0000","last_unstale":"2023-09-30T13:54:54.446933+0000","last_undegraded":"2023-09-30T13:54:54.446933+0000","last_fullsized":"2023-09-30T13:54:54.446933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:59:22.340711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555588+0000","last_change":"2023-09-30T13:54:54.458941+0000","last_active":"2023-09-30T13:54:55.555588+0000","last_peered":"2023-09-30T13:54:55.555588+0000","last_clean":"2023-09-30T13:54:55.555588+0000","last_became_active":"2023-09-30T13:54:54.458230+0000","last_became_peered":"2023-09-30T13:54:54.458230+0000","last_unstale":"2023-09-30T13:54:55.555588+0000","last_undegraded":"2023-09-30T13:54:55.555588+0000","last_fullsized":"2023-09-30T13:54:55.555588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447803+0000","last_change":"2023-09-30T13:54:50.411632+0000","last_active":"2023-09-30T13:54:54.447803+0000","last_peered":"2023-09-30T13:54:54.447803+0000","last_clean":"2023-09-30T13:54:54.447803+0000","last_became_active":"2023-09-30T13:54:50.411281+0000","last_became_peered":"2023-09-30T13:54:50.411281+0000","last_unstale":"2023-09-30T13:54:54.447803+0000","last_undegraded":"2023-09-30T13:54:54.447803+0000","last_fullsized":"2023-09-30T13:54:54.447803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448857+0000","last_change":"2023-09-30T13:54:49.417961+0000","last_active":"2023-09-30T13:54:54.448857+0000","last_peered":"2023-09-30T13:54:54.448857+0000","last_clean":"2023-09-30T13:54:54.448857+0000","last_became_active":"2023-09-30T13:54:49.417131+0000","last_became_peered":"2023-09-30T13:54:49.417131+0000","last_unstale":"2023-09-30T13:54:54.448857+0000","last_undegraded":"2023-09-30T13:54:54.448857+0000","last_fullsized":"2023-09-30T13:54:54.448857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:02.854268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.396016+0000","last_change":"2023-09-30T13:54:54.461774+0000","last_active":"2023-09-30T13:54:55.396016+0000","last_peered":"2023-09-30T13:54:55.396016+0000","last_clean":"2023-09-30T13:54:55.396016+0000","last_became_active":"2023-09-30T13:54:54.461333+0000","last_became_peered":"2023-09-30T13:54:54.461333+0000","last_unstale":"2023-09-30T13:54:55.396016+0000","last_undegraded":"2023-09-30T13:54:55.396016+0000","last_fullsized":"2023-09-30T13:54:55.396016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:07.190629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458382+0000","last_change":"2023-09-30T13:54:50.418751+0000","last_active":"2023-09-30T13:54:54.458382+0000","last_peered":"2023-09-30T13:54:54.458382+0000","last_clean":"2023-09-30T13:54:54.458382+0000","last_became_active":"2023-09-30T13:54:50.418290+0000","last_became_peered":"2023-09-30T13:54:50.418290+0000","last_unstale":"2023-09-30T13:54:54.458382+0000","last_undegraded":"2023-09-30T13:54:54.458382+0000","last_fullsized":"2023-09-30T13:54:54.458382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449427+0000","last_change":"2023-09-30T13:54:49.425647+0000","last_active":"2023-09-30T13:54:54.449427+0000","last_peered":"2023-09-30T13:54:54.449427+0000","last_clean":"2023-09-30T13:54:54.449427+0000","last_became_active":"2023-09-30T13:54:49.425388+0000","last_became_peered":"2023-09-30T13:54:49.425388+0000","last_unstale":"2023-09-30T13:54:54.449427+0000","last_undegraded":"2023-09-30T13:54:54.449427+0000","last_fullsized":"2023-09-30T13:54:54.449427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395641+0000","last_change":"2023-09-30T13:54:54.461862+0000","last_active":"2023-09-30T13:54:55.395641+0000","last_peered":"2023-09-30T13:54:55.395641+0000","last_clean":"2023-09-30T13:54:55.395641+0000","last_became_active":"2023-09-30T13:54:54.461454+0000","last_became_peered":"2023-09-30T13:54:54.461454+0000","last_unstale":"2023-09-30T13:54:55.395641+0000","last_undegraded":"2023-09-30T13:54:55.395641+0000","last_fullsized":"2023-09-30T13:54:55.395641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:41:47.042221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453950+0000","last_change":"2023-09-30T13:54:50.410049+0000","last_active":"2023-09-30T13:54:54.453950+0000","last_peered":"2023-09-30T13:54:54.453950+0000","last_clean":"2023-09-30T13:54:54.453950+0000","last_became_active":"2023-09-30T13:54:50.409797+0000","last_became_peered":"2023-09-30T13:54:50.409797+0000","last_unstale":"2023-09-30T13:54:54.453950+0000","last_undegraded":"2023-09-30T13:54:54.453950+0000","last_fullsized":"2023-09-30T13:54:54.453950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:31.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.455043+0000","last_change":"2023-09-30T13:54:49.419144+0000","last_active":"2023-09-30T13:54:54.455043+0000","last_peered":"2023-09-30T13:54:54.455043+0000","last_clean":"2023-09-30T13:54:54.455043+0000","last_became_active":"2023-09-30T13:54:49.418861+0000","last_became_peered":"2023-09-30T13:54:49.418861+0000","last_unstale":"2023-09-30T13:54:54.455043+0000","last_undegraded":"2023-09-30T13:54:54.455043+0000","last_fullsized":"2023-09-30T13:54:54.455043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555756+0000","last_change":"2023-09-30T13:54:54.461392+0000","last_active":"2023-09-30T13:54:55.555756+0000","last_peered":"2023-09-30T13:54:55.555756+0000","last_clean":"2023-09-30T13:54:55.555756+0000","last_became_active":"2023-09-30T13:54:54.460929+0000","last_became_peered":"2023-09-30T13:54:54.460929+0000","last_unstale":"2023-09-30T13:54:55.555756+0000","last_undegraded":"2023-09-30T13:54:55.555756+0000","last_fullsized":"2023-09-30T13:54:55.555756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458494+0000","last_change":"2023-09-30T13:54:50.416496+0000","last_active":"2023-09-30T13:54:54.458494+0000","last_peered":"2023-09-30T13:54:54.458494+0000","last_clean":"2023-09-30T13:54:54.458494+0000","last_became_active":"2023-09-30T13:54:50.416041+0000","last_became_peered":"2023-09-30T13:54:50.416041+0000","last_unstale":"2023-09-30T13:54:54.458494+0000","last_undegraded":"2023-09-30T13:54:54.458494+0000","last_fullsized":"2023-09-30T13:54:54.458494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:59.305889+0000","last_change":"2023-09-30T13:54:49.424285+0000","last_active":"2023-09-30T13:54:59.305889+0000","last_peered":"2023-09-30T13:54:59.305889+0000","last_clean":"2023-09-30T13:54:59.305889+0000","last_became_active":"2023-09-30T13:54:49.424016+0000","last_became_peered":"2023-09-30T13:54:49.424016+0000","last_unstale":"2023-09-30T13:54:59.305889+0000","last_undegraded":"2023-09-30T13:54:59.305889+0000","last_fullsized":"2023-09-30T13:54:59.305889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555828+0000","last_change":"2023-09-30T13:54:54.460160+0000","last_active":"2023-09-30T13:54:55.555828+0000","last_peered":"2023-09-30T13:54:55.555828+0000","last_clean":"2023-09-30T13:54:55.555828+0000","last_became_active":"2023-09-30T13:54:54.459029+0000","last_became_peered":"2023-09-30T13:54:54.459029+0000","last_unstale":"2023-09-30T13:54:55.555828+0000","last_undegraded":"2023-09-30T13:54:55.555828+0000","last_fullsized":"2023-09-30T13:54:55.555828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443040+0000","last_change":"2023-09-30T13:54:50.415939+0000","last_active":"2023-09-30T13:54:54.443040+0000","last_peered":"2023-09-30T13:54:54.443040+0000","last_clean":"2023-09-30T13:54:54.443040+0000","last_became_active":"2023-09-30T13:54:50.415711+0000","last_became_peered":"2023-09-30T13:54:50.415711+0000","last_unstale":"2023-09-30T13:54:54.443040+0000","last_undegraded":"2023-09-30T13:54:54.443040+0000","last_fullsized":"2023-09-30T13:54:54.443040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439502+0000","last_change":"2023-09-30T13:54:49.421474+0000","last_active":"2023-09-30T13:54:54.439502+0000","last_peered":"2023-09-30T13:54:54.439502+0000","last_clean":"2023-09-30T13:54:54.439502+0000","last_became_active":"2023-09-30T13:54:49.421229+0000","last_became_peered":"2023-09-30T13:54:49.421229+0000","last_unstale":"2023-09-30T13:54:54.439502+0000","last_undegraded":"2023-09-30T13:54:54.439502+0000","last_fullsized":"2023-09-30T13:54:54.439502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395499+0000","last_change":"2023-09-30T13:54:54.462295+0000","last_active":"2023-09-30T13:54:55.395499+0000","last_peered":"2023-09-30T13:54:55.395499+0000","last_clean":"2023-09-30T13:54:55.395499+0000","last_became_active":"2023-09-30T13:54:54.461617+0000","last_became_peered":"2023-09-30T13:54:54.461617+0000","last_unstale":"2023-09-30T13:54:55.395499+0000","last_undegraded":"2023-09-30T13:54:55.395499+0000","last_fullsized":"2023-09-30T13:54:55.395499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:35.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454208+0000","last_change":"2023-09-30T13:54:50.409156+0000","last_active":"2023-09-30T13:54:54.454208+0000","last_peered":"2023-09-30T13:54:54.454208+0000","last_clean":"2023-09-30T13:54:54.454208+0000","last_became_active":"2023-09-30T13:54:50.408875+0000","last_became_peered":"2023-09-30T13:54:50.408875+0000","last_unstale":"2023-09-30T13:54:54.454208+0000","last_undegraded":"2023-09-30T13:54:54.454208+0000","last_fullsized":"2023-09-30T13:54:54.454208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450123+0000","last_change":"2023-09-30T13:54:49.421494+0000","last_active":"2023-09-30T13:54:54.450123+0000","last_peered":"2023-09-30T13:54:54.450123+0000","last_clean":"2023-09-30T13:54:54.450123+0000","last_became_active":"2023-09-30T13:54:49.420772+0000","last_became_peered":"2023-09-30T13:54:49.420772+0000","last_unstale":"2023-09-30T13:54:54.450123+0000","last_undegraded":"2023-09-30T13:54:54.450123+0000","last_fullsized":"2023-09-30T13:54:54.450123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:44.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395038+0000","last_change":"2023-09-30T13:54:54.450703+0000","last_active":"2023-09-30T13:54:55.395038+0000","last_peered":"2023-09-30T13:54:55.395038+0000","last_clean":"2023-09-30T13:54:55.395038+0000","last_became_active":"2023-09-30T13:54:54.450294+0000","last_became_peered":"2023-09-30T13:54:54.450294+0000","last_unstale":"2023-09-30T13:54:55.395038+0000","last_undegraded":"2023-09-30T13:54:55.395038+0000","last_fullsized":"2023-09-30T13:54:55.395038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:04:52.729643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450019+0000","last_change":"2023-09-30T13:54:50.422345+0000","last_active":"2023-09-30T13:54:54.450019+0000","last_peered":"2023-09-30T13:54:54.450019+0000","last_clean":"2023-09-30T13:54:54.450019+0000","last_became_active":"2023-09-30T13:54:50.422097+0000","last_became_peered":"2023-09-30T13:54:50.422097+0000","last_unstale":"2023-09-30T13:54:54.450019+0000","last_undegraded":"2023-09-30T13:54:54.450019+0000","last_fullsized":"2023-09-30T13:54:54.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447068+0000","last_change":"2023-09-30T13:54:49.421580+0000","last_active":"2023-09-30T13:54:54.447068+0000","last_peered":"2023-09-30T13:54:54.447068+0000","last_clean":"2023-09-30T13:54:54.447068+0000","last_became_active":"2023-09-30T13:54:49.421309+0000","last_became_peered":"2023-09-30T13:54:49.421309+0000","last_unstale":"2023-09-30T13:54:54.447068+0000","last_undegraded":"2023-09-30T13:54:54.447068+0000","last_fullsized":"2023-09-30T13:54:54.447068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:17.392031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394992+0000","last_change":"2023-09-30T13:54:54.461962+0000","last_active":"2023-09-30T13:54:55.394992+0000","last_peered":"2023-09-30T13:54:55.394992+0000","last_clean":"2023-09-30T13:54:55.394992+0000","last_became_active":"2023-09-30T13:54:54.461572+0000","last_became_peered":"2023-09-30T13:54:54.461572+0000","last_unstale":"2023-09-30T13:54:55.394992+0000","last_undegraded":"2023-09-30T13:54:55.394992+0000","last_fullsized":"2023-09-30T13:54:55.394992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556083+0000","last_change":"2023-09-30T13:54:54.465345+0000","last_active":"2023-09-30T13:54:55.556083+0000","last_peered":"2023-09-30T13:54:55.556083+0000","last_clean":"2023-09-30T13:54:55.556083+0000","last_became_active":"2023-09-30T13:54:54.464944+0000","last_became_peered":"2023-09-30T13:54:54.464944+0000","last_unstale":"2023-09-30T13:54:55.556083+0000","last_undegraded":"2023-09-30T13:54:55.556083+0000","last_fullsized":"2023-09-30T13:54:55.556083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:22:46.203262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439196+0000","last_change":"2023-09-30T13:54:50.415261+0000","last_active":"2023-09-30T13:54:54.439196+0000","last_peered":"2023-09-30T13:54:54.439196+0000","last_clean":"2023-09-30T13:54:54.439196+0000","last_became_active":"2023-09-30T13:54:50.414934+0000","last_became_peered":"2023-09-30T13:54:50.414934+0000","last_unstale":"2023-09-30T13:54:54.439196+0000","last_undegraded":"2023-09-30T13:54:54.439196+0000","last_fullsized":"2023-09-30T13:54:54.439196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447216+0000","last_change":"2023-09-30T13:54:49.423480+0000","last_active":"2023-09-30T13:54:54.447216+0000","last_peered":"2023-09-30T13:54:54.447216+0000","last_clean":"2023-09-30T13:54:54.447216+0000","last_became_active":"2023-09-30T13:54:49.423220+0000","last_became_peered":"2023-09-30T13:54:49.423220+0000","last_unstale":"2023-09-30T13:54:54.447216+0000","last_undegraded":"2023-09-30T13:54:54.447216+0000","last_fullsized":"2023-09-30T13:54:54.447216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420301+0000","last_change":"2023-09-30T13:54:54.464246+0000","last_active":"2023-09-30T13:54:55.420301+0000","last_peered":"2023-09-30T13:54:55.420301+0000","last_clean":"2023-09-30T13:54:55.420301+0000","last_became_active":"2023-09-30T13:54:54.463379+0000","last_became_peered":"2023-09-30T13:54:54.463379+0000","last_unstale":"2023-09-30T13:54:55.420301+0000","last_undegraded":"2023-09-30T13:54:55.420301+0000","last_fullsized":"2023-09-30T13:54:55.420301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443406+0000","last_change":"2023-09-30T13:54:50.409576+0000","last_active":"2023-09-30T13:54:54.443406+0000","last_peered":"2023-09-30T13:54:54.443406+0000","last_clean":"2023-09-30T13:54:54.443406+0000","last_became_active":"2023-09-30T13:54:50.409205+0000","last_became_peered":"2023-09-30T13:54:50.409205+0000","last_unstale":"2023-09-30T13:54:54.443406+0000","last_undegraded":"2023-09-30T13:54:54.443406+0000","last_fullsized":"2023-09-30T13:54:54.443406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441966+0000","last_change":"2023-09-30T13:54:49.414072+0000","last_active":"2023-09-30T13:54:54.441966+0000","last_peered":"2023-09-30T13:54:54.441966+0000","last_clean":"2023-09-30T13:54:54.441966+0000","last_became_active":"2023-09-30T13:54:49.413795+0000","last_became_peered":"2023-09-30T13:54:49.413795+0000","last_unstale":"2023-09-30T13:54:54.441966+0000","last_undegraded":"2023-09-30T13:54:54.441966+0000","last_fullsized":"2023-09-30T13:54:54.441966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445628+0000","last_change":"2023-09-30T13:54:49.418852+0000","last_active":"2023-09-30T13:54:54.445628+0000","last_peered":"2023-09-30T13:54:54.445628+0000","last_clean":"2023-09-30T13:54:54.445628+0000","last_became_active":"2023-09-30T13:54:49.417214+0000","last_became_peered":"2023-09-30T13:54:49.417214+0000","last_unstale":"2023-09-30T13:54:54.445628+0000","last_undegraded":"2023-09-30T13:54:54.445628+0000","last_fullsized":"2023-09-30T13:54:54.445628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454816+0000","last_change":"2023-09-30T13:54:50.408345+0000","last_active":"2023-09-30T13:54:54.454816+0000","last_peered":"2023-09-30T13:54:54.454816+0000","last_clean":"2023-09-30T13:54:54.454816+0000","last_became_active":"2023-09-30T13:54:50.408060+0000","last_became_peered":"2023-09-30T13:54:50.408060+0000","last_unstale":"2023-09-30T13:54:54.454816+0000","last_undegraded":"2023-09-30T13:54:54.454816+0000","last_fullsized":"2023-09-30T13:54:54.454816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394296+0000","last_change":"2023-09-30T13:54:54.460070+0000","last_active":"2023-09-30T13:54:55.394296+0000","last_peered":"2023-09-30T13:54:55.394296+0000","last_clean":"2023-09-30T13:54:55.394296+0000","last_became_active":"2023-09-30T13:54:54.459607+0000","last_became_peered":"2023-09-30T13:54:54.459607+0000","last_unstale":"2023-09-30T13:54:55.394296+0000","last_undegraded":"2023-09-30T13:54:55.394296+0000","last_fullsized":"2023-09-30T13:54:55.394296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:45.736051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440800+0000","last_change":"2023-09-30T13:54:49.418506+0000","last_active":"2023-09-30T13:54:54.440800+0000","last_peered":"2023-09-30T13:54:54.440800+0000","last_clean":"2023-09-30T13:54:54.440800+0000","last_became_active":"2023-09-30T13:54:49.418247+0000","last_became_peered":"2023-09-30T13:54:49.418247+0000","last_unstale":"2023-09-30T13:54:54.440800+0000","last_undegraded":"2023-09-30T13:54:54.440800+0000","last_fullsized":"2023-09-30T13:54:54.440800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442842+0000","last_change":"2023-09-30T13:54:50.414962+0000","last_active":"2023-09-30T13:54:54.442842+0000","last_peered":"2023-09-30T13:54:54.442842+0000","last_clean":"2023-09-30T13:54:54.442842+0000","last_became_active":"2023-09-30T13:54:50.414716+0000","last_became_peered":"2023-09-30T13:54:50.414716+0000","last_unstale":"2023-09-30T13:54:54.442842+0000","last_undegraded":"2023-09-30T13:54:54.442842+0000","last_fullsized":"2023-09-30T13:54:54.442842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:18.397281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395779+0000","last_change":"2023-09-30T13:54:54.453610+0000","last_active":"2023-09-30T13:54:55.395779+0000","last_peered":"2023-09-30T13:54:55.395779+0000","last_clean":"2023-09-30T13:54:55.395779+0000","last_became_active":"2023-09-30T13:54:54.453208+0000","last_became_peered":"2023-09-30T13:54:54.453208+0000","last_unstale":"2023-09-30T13:54:55.395779+0000","last_undegraded":"2023-09-30T13:54:55.395779+0000","last_fullsized":"2023-09-30T13:54:55.395779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:16:46.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447707+0000","last_change":"2023-09-30T13:54:50.413789+0000","last_active":"2023-09-30T13:54:54.447707+0000","last_peered":"2023-09-30T13:54:54.447707+0000","last_clean":"2023-09-30T13:54:54.447707+0000","last_became_active":"2023-09-30T13:54:50.413515+0000","last_became_peered":"2023-09-30T13:54:50.413515+0000","last_unstale":"2023-09-30T13:54:54.447707+0000","last_undegraded":"2023-09-30T13:54:54.447707+0000","last_fullsized":"2023-09-30T13:54:54.447707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446862+0000","last_change":"2023-09-30T13:54:50.407643+0000","last_active":"2023-09-30T13:54:54.446862+0000","last_peered":"2023-09-30T13:54:54.446862+0000","last_clean":"2023-09-30T13:54:54.446862+0000","last_became_active":"2023-09-30T13:54:50.407392+0000","last_became_peered":"2023-09-30T13:54:50.407392+0000","last_unstale":"2023-09-30T13:54:54.446862+0000","last_undegraded":"2023-09-30T13:54:54.446862+0000","last_fullsized":"2023-09-30T13:54:54.446862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449338+0000","last_change":"2023-09-30T13:54:50.417249+0000","last_active":"2023-09-30T13:54:54.449338+0000","last_peered":"2023-09-30T13:54:54.449338+0000","last_clean":"2023-09-30T13:54:54.449338+0000","last_became_active":"2023-09-30T13:54:50.416968+0000","last_became_peered":"2023-09-30T13:54:50.416968+0000","last_unstale":"2023-09-30T13:54:54.449338+0000","last_undegraded":"2023-09-30T13:54:54.449338+0000","last_fullsized":"2023-09-30T13:54:54.449338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454724+0000","last_change":"2023-09-30T13:54:50.414645+0000","last_active":"2023-09-30T13:54:54.454724+0000","last_peered":"2023-09-30T13:54:54.454724+0000","last_clean":"2023-09-30T13:54:54.454724+0000","last_became_active":"2023-09-30T13:54:50.414355+0000","last_became_peered":"2023-09-30T13:54:50.414355+0000","last_unstale":"2023-09-30T13:54:54.454724+0000","last_undegraded":"2023-09-30T13:54:54.454724+0000","last_fullsized":"2023-09-30T13:54:54.454724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442101+0000","last_change":"2023-09-30T13:54:50.400252+0000","last_active":"2023-09-30T13:54:54.442101+0000","last_peered":"2023-09-30T13:54:54.442101+0000","last_clean":"2023-09-30T13:54:54.442101+0000","last_became_active":"2023-09-30T13:54:50.399917+0000","last_became_peered":"2023-09-30T13:54:50.399917+0000","last_unstale":"2023-09-30T13:54:54.442101+0000","last_undegraded":"2023-09-30T13:54:54.442101+0000","last_fullsized":"2023-09-30T13:54:54.442101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439388+0000","last_change":"2023-09-30T13:54:50.414491+0000","last_active":"2023-09-30T13:54:54.439388+0000","last_peered":"2023-09-30T13:54:54.439388+0000","last_clean":"2023-09-30T13:54:54.439388+0000","last_became_active":"2023-09-30T13:54:50.414221+0000","last_became_peered":"2023-09-30T13:54:50.414221+0000","last_unstale":"2023-09-30T13:54:54.439388+0000","last_undegraded":"2023-09-30T13:54:54.439388+0000","last_fullsized":"2023-09-30T13:54:54.439388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446932+0000","last_change":"2023-09-30T13:54:50.413491+0000","last_active":"2023-09-30T13:54:54.446932+0000","last_peered":"2023-09-30T13:54:54.446932+0000","last_clean":"2023-09-30T13:54:54.446932+0000","last_became_active":"2023-09-30T13:54:50.413226+0000","last_became_peered":"2023-09-30T13:54:50.413226+0000","last_unstale":"2023-09-30T13:54:54.446932+0000","last_undegraded":"2023-09-30T13:54:54.446932+0000","last_fullsized":"2023-09-30T13:54:54.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441831+0000","last_change":"2023-09-30T13:54:50.399450+0000","last_active":"2023-09-30T13:54:54.441831+0000","last_peered":"2023-09-30T13:54:54.441831+0000","last_clean":"2023-09-30T13:54:54.441831+0000","last_became_active":"2023-09-30T13:54:50.399129+0000","last_became_peered":"2023-09-30T13:54:50.399129+0000","last_unstale":"2023-09-30T13:54:54.441831+0000","last_undegraded":"2023-09-30T13:54:54.441831+0000","last_fullsized":"2023-09-30T13:54:54.441831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447123+0000","last_change":"2023-09-30T13:54:50.416017+0000","last_active":"2023-09-30T13:54:54.447123+0000","last_peered":"2023-09-30T13:54:54.447123+0000","last_clean":"2023-09-30T13:54:54.447123+0000","last_became_active":"2023-09-30T13:54:50.415769+0000","last_became_peered":"2023-09-30T13:54:50.415769+0000","last_unstale":"2023-09-30T13:54:54.447123+0000","last_undegraded":"2023-09-30T13:54:54.447123+0000","last_fullsized":"2023-09-30T13:54:54.447123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441869+0000","last_change":"2023-09-30T13:54:50.401717+0000","last_active":"2023-09-30T13:54:54.441869+0000","last_peered":"2023-09-30T13:54:54.441869+0000","last_clean":"2023-09-30T13:54:54.441869+0000","last_became_active":"2023-09-30T13:54:50.401384+0000","last_became_peered":"2023-09-30T13:54:50.401384+0000","last_unstale":"2023-09-30T13:54:54.441869+0000","last_undegraded":"2023-09-30T13:54:54.441869+0000","last_fullsized":"2023-09-30T13:54:54.441869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449251+0000","last_change":"2023-09-30T13:54:50.423066+0000","last_active":"2023-09-30T13:54:54.449251+0000","last_peered":"2023-09-30T13:54:54.449251+0000","last_clean":"2023-09-30T13:54:54.449251+0000","last_became_active":"2023-09-30T13:54:50.422797+0000","last_became_peered":"2023-09-30T13:54:50.422797+0000","last_unstale":"2023-09-30T13:54:54.449251+0000","last_undegraded":"2023-09-30T13:54:54.449251+0000","last_fullsized":"2023-09-30T13:54:54.449251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454616+0000","last_change":"2023-09-30T13:54:50.412413+0000","last_active":"2023-09-30T13:54:54.454616+0000","last_peered":"2023-09-30T13:54:54.454616+0000","last_clean":"2023-09-30T13:54:54.454616+0000","last_became_active":"2023-09-30T13:54:50.412107+0000","last_became_peered":"2023-09-30T13:54:50.412107+0000","last_unstale":"2023-09-30T13:54:54.454616+0000","last_undegraded":"2023-09-30T13:54:54.454616+0000","last_fullsized":"2023-09-30T13:54:54.454616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446754+0000","last_change":"2023-09-30T13:54:50.417833+0000","last_active":"2023-09-30T13:54:54.446754+0000","last_peered":"2023-09-30T13:54:54.446754+0000","last_clean":"2023-09-30T13:54:54.446754+0000","last_became_active":"2023-09-30T13:54:50.417525+0000","last_became_peered":"2023-09-30T13:54:50.417525+0000","last_unstale":"2023-09-30T13:54:54.446754+0000","last_undegraded":"2023-09-30T13:54:54.446754+0000","last_fullsized":"2023-09-30T13:54:54.446754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458795+0000","last_change":"2023-09-30T13:54:50.412766+0000","last_active":"2023-09-30T13:54:54.458795+0000","last_peered":"2023-09-30T13:54:54.458795+0000","last_clean":"2023-09-30T13:54:54.458795+0000","last_became_active":"2023-09-30T13:54:50.412502+0000","last_became_peered":"2023-09-30T13:54:50.412502+0000","last_unstale":"2023-09-30T13:54:54.458795+0000","last_undegraded":"2023-09-30T13:54:54.458795+0000","last_fullsized":"2023-09-30T13:54:54.458795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447122+0000","last_change":"2023-09-30T13:54:50.408372+0000","last_active":"2023-09-30T13:54:54.447122+0000","last_peered":"2023-09-30T13:54:54.447122+0000","last_clean":"2023-09-30T13:54:54.447122+0000","last_became_active":"2023-09-30T13:54:50.408111+0000","last_became_peered":"2023-09-30T13:54:50.408111+0000","last_unstale":"2023-09-30T13:54:54.447122+0000","last_undegraded":"2023-09-30T13:54:54.447122+0000","last_fullsized":"2023-09-30T13:54:54.447122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450494+0000","last_change":"2023-09-30T13:54:50.418485+0000","last_active":"2023-09-30T13:54:54.450494+0000","last_peered":"2023-09-30T13:54:54.450494+0000","last_clean":"2023-09-30T13:54:54.450494+0000","last_became_active":"2023-09-30T13:54:50.417771+0000","last_became_peered":"2023-09-30T13:54:50.417771+0000","last_unstale":"2023-09-30T13:54:54.450494+0000","last_undegraded":"2023-09-30T13:54:54.450494+0000","last_fullsized":"2023-09-30T13:54:54.450494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446955+0000","last_change":"2023-09-30T13:54:50.410885+0000","last_active":"2023-09-30T13:54:54.446955+0000","last_peered":"2023-09-30T13:54:54.446955+0000","last_clean":"2023-09-30T13:54:54.446955+0000","last_became_active":"2023-09-30T13:54:50.410590+0000","last_became_peered":"2023-09-30T13:54:50.410590+0000","last_unstale":"2023-09-30T13:54:54.446955+0000","last_undegraded":"2023-09-30T13:54:54.446955+0000","last_fullsized":"2023-09-30T13:54:54.446955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439246+0000","last_change":"2023-09-30T13:54:50.415957+0000","last_active":"2023-09-30T13:54:54.439246+0000","last_peered":"2023-09-30T13:54:54.439246+0000","last_clean":"2023-09-30T13:54:54.439246+0000","last_became_active":"2023-09-30T13:54:50.415634+0000","last_became_peered":"2023-09-30T13:54:50.415634+0000","last_unstale":"2023-09-30T13:54:54.439246+0000","last_undegraded":"2023-09-30T13:54:54.439246+0000","last_fullsized":"2023-09-30T13:54:54.439246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453850+0000","last_change":"2023-09-30T13:54:50.411326+0000","last_active":"2023-09-30T13:54:54.453850+0000","last_peered":"2023-09-30T13:54:54.453850+0000","last_clean":"2023-09-30T13:54:54.453850+0000","last_became_active":"2023-09-30T13:54:50.410982+0000","last_became_peered":"2023-09-30T13:54:50.410982+0000","last_unstale":"2023-09-30T13:54:54.453850+0000","last_undegraded":"2023-09-30T13:54:54.453850+0000","last_fullsized":"2023-09-30T13:54:54.453850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:41.710382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444714+0000","last_change":"2023-09-30T13:54:50.410846+0000","last_active":"2023-09-30T13:54:54.444714+0000","last_peered":"2023-09-30T13:54:54.444714+0000","last_clean":"2023-09-30T13:54:54.444714+0000","last_became_active":"2023-09-30T13:54:50.410552+0000","last_became_peered":"2023-09-30T13:54:50.410552+0000","last_unstale":"2023-09-30T13:54:54.444714+0000","last_undegraded":"2023-09-30T13:54:54.444714+0000","last_fullsized":"2023-09-30T13:54:54.444714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442982+0000","last_change":"2023-09-30T13:54:50.414413+0000","last_active":"2023-09-30T13:54:54.442982+0000","last_peered":"2023-09-30T13:54:54.442982+0000","last_clean":"2023-09-30T13:54:54.442982+0000","last_became_active":"2023-09-30T13:54:50.413675+0000","last_became_peered":"2023-09-30T13:54:50.413675+0000","last_unstale":"2023-09-30T13:54:54.442982+0000","last_undegraded":"2023-09-30T13:54:54.442982+0000","last_fullsized":"2023-09-30T13:54:54.442982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447232+0000","last_change":"2023-09-30T13:54:50.413676+0000","last_active":"2023-09-30T13:54:54.447232+0000","last_peered":"2023-09-30T13:54:54.447232+0000","last_clean":"2023-09-30T13:54:54.447232+0000","last_became_active":"2023-09-30T13:54:50.412614+0000","last_became_peered":"2023-09-30T13:54:50.412614+0000","last_unstale":"2023-09-30T13:54:54.447232+0000","last_undegraded":"2023-09-30T13:54:54.447232+0000","last_fullsized":"2023-09-30T13:54:54.447232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446834+0000","last_change":"2023-09-30T13:54:50.412729+0000","last_active":"2023-09-30T13:54:54.446834+0000","last_peered":"2023-09-30T13:54:54.446834+0000","last_clean":"2023-09-30T13:54:54.446834+0000","last_became_active":"2023-09-30T13:54:50.412478+0000","last_became_peered":"2023-09-30T13:54:50.412478+0000","last_unstale":"2023-09-30T13:54:54.446834+0000","last_undegraded":"2023-09-30T13:54:54.446834+0000","last_fullsized":"2023-09-30T13:54:54.446834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458895+0000","last_change":"2023-09-30T13:54:50.416012+0000","last_active":"2023-09-30T13:54:54.458895+0000","last_peered":"2023-09-30T13:54:54.458895+0000","last_clean":"2023-09-30T13:54:54.458895+0000","last_became_active":"2023-09-30T13:54:50.414957+0000","last_became_peered":"2023-09-30T13:54:50.414957+0000","last_unstale":"2023-09-30T13:54:54.458895+0000","last_undegraded":"2023-09-30T13:54:54.458895+0000","last_fullsized":"2023-09-30T13:54:54.458895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:54.613251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444109+0000","last_change":"2023-09-30T13:54:50.405513+0000","last_active":"2023-09-30T13:54:54.444109+0000","last_peered":"2023-09-30T13:54:54.444109+0000","last_clean":"2023-09-30T13:54:54.444109+0000","last_became_active":"2023-09-30T13:54:50.404703+0000","last_became_peered":"2023-09-30T13:54:50.404703+0000","last_unstale":"2023-09-30T13:54:54.444109+0000","last_undegraded":"2023-09-30T13:54:54.444109+0000","last_fullsized":"2023-09-30T13:54:54.444109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458099+0000","last_change":"2023-09-30T13:54:50.418187+0000","last_active":"2023-09-30T13:54:54.458099+0000","last_peered":"2023-09-30T13:54:54.458099+0000","last_clean":"2023-09-30T13:54:54.458099+0000","last_became_active":"2023-09-30T13:54:50.417894+0000","last_became_peered":"2023-09-30T13:54:50.417894+0000","last_unstale":"2023-09-30T13:54:54.458099+0000","last_undegraded":"2023-09-30T13:54:54.458099+0000","last_fullsized":"2023-09-30T13:54:54.458099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449166+0000","last_change":"2023-09-30T13:54:50.410069+0000","last_active":"2023-09-30T13:54:54.449166+0000","last_peered":"2023-09-30T13:54:54.449166+0000","last_clean":"2023-09-30T13:54:54.449166+0000","last_became_active":"2023-09-30T13:54:50.409788+0000","last_became_peered":"2023-09-30T13:54:50.409788+0000","last_unstale":"2023-09-30T13:54:54.449166+0000","last_undegraded":"2023-09-30T13:54:54.449166+0000","last_fullsized":"2023-09-30T13:54:54.449166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458341+0000","last_change":"2023-09-30T13:54:50.411521+0000","last_active":"2023-09-30T13:54:54.458341+0000","last_peered":"2023-09-30T13:54:54.458341+0000","last_clean":"2023-09-30T13:54:54.458341+0000","last_became_active":"2023-09-30T13:54:50.411249+0000","last_became_peered":"2023-09-30T13:54:50.411249+0000","last_unstale":"2023-09-30T13:54:54.458341+0000","last_undegraded":"2023-09-30T13:54:54.458341+0000","last_fullsized":"2023-09-30T13:54:54.458341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448866+0000","last_change":"2023-09-30T13:54:50.416620+0000","last_active":"2023-09-30T13:54:54.448866+0000","last_peered":"2023-09-30T13:54:54.448866+0000","last_clean":"2023-09-30T13:54:54.448866+0000","last_became_active":"2023-09-30T13:54:50.416353+0000","last_became_peered":"2023-09-30T13:54:50.416353+0000","last_unstale":"2023-09-30T13:54:54.448866+0000","last_undegraded":"2023-09-30T13:54:54.448866+0000","last_fullsized":"2023-09-30T13:54:54.448866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454120+0000","last_change":"2023-09-30T13:54:50.408896+0000","last_active":"2023-09-30T13:54:54.454120+0000","last_peered":"2023-09-30T13:54:54.454120+0000","last_clean":"2023-09-30T13:54:54.454120+0000","last_became_active":"2023-09-30T13:54:50.407306+0000","last_became_peered":"2023-09-30T13:54:50.407306+0000","last_unstale":"2023-09-30T13:54:54.454120+0000","last_undegraded":"2023-09-30T13:54:54.454120+0000","last_fullsized":"2023-09-30T13:54:54.454120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439826+0000","last_change":"2023-09-30T13:54:50.409514+0000","last_active":"2023-09-30T13:54:54.439826+0000","last_peered":"2023-09-30T13:54:54.439826+0000","last_clean":"2023-09-30T13:54:54.439826+0000","last_became_active":"2023-09-30T13:54:50.409220+0000","last_became_peered":"2023-09-30T13:54:50.409220+0000","last_unstale":"2023-09-30T13:54:54.439826+0000","last_undegraded":"2023-09-30T13:54:54.439826+0000","last_fullsized":"2023-09-30T13:54:54.439826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458792+0000","last_change":"2023-09-30T13:54:50.415599+0000","last_active":"2023-09-30T13:54:54.458792+0000","last_peered":"2023-09-30T13:54:54.458792+0000","last_clean":"2023-09-30T13:54:54.458792+0000","last_became_active":"2023-09-30T13:54:50.414604+0000","last_became_peered":"2023-09-30T13:54:50.414604+0000","last_unstale":"2023-09-30T13:54:54.458792+0000","last_undegraded":"2023-09-30T13:54:54.458792+0000","last_fullsized":"2023-09-30T13:54:54.458792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:55:07.840 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T13:55:07.841 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T13:55:07.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T13:55:07.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T13:55:07.841 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T13:55:07.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.978+0000 7ff59e70f640 1 Processor -- start 2023-09-30T13:55:07.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.978+0000 7ff59e70f640 1 -- start start 2023-09-30T13:55:07.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff59e70f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff59815cbe0 0x7ff5980d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff59e70f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 0x7ff5980d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff59e70f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980d16a0 con 0x7ff5980cd4e0 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff59e70f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980cfcf0 con 0x7ff59815cbe0 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff59e70f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980cf450 con 0x7ff5980d0d00 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff597fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff59815cbe0 0x7ff5980d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff597fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff59815cbe0 0x7ff5980d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39136/0 (socket says 172.21.15.62:39136) 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.979+0000 7ff597fff640 1 -- 172.21.15.62:0/882972525 learned_addr learned my addr 172.21.15.62:0/882972525 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff5977fe640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 0x7ff5980d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff597fff640 1 -- 172.21.15.62:0/882972525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 msgr2=0x7ff5980d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:07.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff597fff640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 0x7ff5980d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff597fff640 1 -- 172.21.15.62:0/882972525 >> v1:172.21.15.135:6789/0 conn(0x7ff5980cd4e0 legacy=0x7ff5980cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff597fff640 1 -- 172.21.15.62:0/882972525 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980cf730 con 0x7ff59815cbe0 2023-09-30T13:55:07.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.980+0000 7ff5977fe640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 0x7ff5980d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:07.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff597fff640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff59815cbe0 0x7ff5980d06b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff588009850 tx=0x7ff58802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9466fa9197ff4653 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff596ffd640 1 -- 172.21.15.62:0/882972525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588004230 con 0x7ff59815cbe0 2023-09-30T13:55:07.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff596ffd640 1 -- 172.21.15.62:0/882972525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588004390 con 0x7ff59815cbe0 2023-09-30T13:55:07.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff596ffd640 1 -- 172.21.15.62:0/882972525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588003810 con 0x7ff59815cbe0 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 -- 172.21.15.62:0/882972525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff59815cbe0 msgr2=0x7ff5980d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff59815cbe0 0x7ff5980d06b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff588009850 tx=0x7ff58802b9f0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 -- 172.21.15.62:0/882972525 shutdown_connections 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff5980d0d00 0x7ff5980d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 --2- 172.21.15.62:0/882972525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff59815cbe0 0x7ff5980d06b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 -- 172.21.15.62:0/882972525 >> 172.21.15.62:0/882972525 conn(0x7ff598089fe0 msgr2=0x7ff5980d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 -- 172.21.15.62:0/882972525 shutdown_connections 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.981+0000 7ff59e70f640 1 -- 172.21.15.62:0/882972525 wait complete. 2023-09-30T13:55:07.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.982+0000 7ff59e70f640 1 Processor -- start 2023-09-30T13:55:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 -- start start 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5980cd4e0 0x7ff5980b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 0x7ff59806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981f20c0 con 0x7ff5980d0d00 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b36a0 con 0x7ff5980cd4e0 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff59e70f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b3980 con 0x7ff59815cbe0 2023-09-30T13:55:07.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39152/0 (socket says 172.21.15.62:39152) 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.983+0000 7ff5977fe640 1 -- 172.21.15.62:0/3572365949 learned_addr learned my addr 172.21.15.62:0/3572365949 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff597fff640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5980cd4e0 0x7ff5980b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff59ccac640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 0x7ff59806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 -- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 msgr2=0x7ff59806ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 0x7ff59806ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 -- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5980cd4e0 msgr2=0x7ff5980b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5980cd4e0 0x7ff5980b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:07.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 -- 172.21.15.62:0/3572365949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff588009460 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff59ccac640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 0x7ff59806ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff5977fe640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00e730 tx=0x7ff58c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c004230 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c004390 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00c8f0 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5980b3c60 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.984+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5980b3f40 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.985+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5980b6a30 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.986+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff58c00ca50 con 0x7ff5980d0d00 2023-09-30T13:55:07.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.986+0000 7ff594ff9640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 0x7ff58406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:07.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.986+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff58c089050 con 0x7ff5980d0d00 2023-09-30T13:55:07.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.986+0000 7ff597fff640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 0x7ff58406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:07.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.987+0000 7ff597fff640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 0x7ff58406d020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff588035000 tx=0x7ff588008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:07.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:07.990+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff5980b6a30 con 0x7ff5980d0d00 2023-09-30T13:55:08.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.211+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff5980b6a30 con 0x7ff5980d0d00 2023-09-30T13:55:08.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.214+0000 7ff594ff9640 1 -- 172.21.15.62:0/3572365949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170640 (secure 0 0 0) 0x7ff5980b6a30 con 0x7ff5980d0d00 2023-09-30T13:55:08.215 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 msgr2=0x7ff58406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 0x7ff58406d020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff588035000 tx=0x7ff588008030 comp rx=0 tx=0).stop 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 msgr2=0x7ff59806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00e730 tx=0x7ff58c00ebf0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 shutdown_connections 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff58406ab60 0x7ff58406d020 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff59815cbe0 0x7ff59806ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5980d0d00 0x7ff59806b530 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 --2- 172.21.15.62:0/3572365949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5980cd4e0 0x7ff5980b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 >> 172.21.15.62:0/3572365949 conn(0x7ff598089fe0 msgr2=0x7ff59815beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:08.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.216+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 shutdown_connections 2023-09-30T13:55:08.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.217+0000 7ff59e70f640 1 -- 172.21.15.62:0/3572365949 wait complete. 2023-09-30T13:55:08.226 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2713400822},{"type":"v1","addr":"172.21.15.135:6833","nonce":2713400822}]},"active_addr":"172.21.15.135:6833/2713400822","active_change":"2023-09-30T13:54:29.660745+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":6032302}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1590640622}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1653867249}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3558342314}]}]} 2023-09-30T13:55:08.231 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T13:55:08.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T13:55:08.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:08.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.337+0000 7f369f67c640 1 Processor -- start 2023-09-30T13:55:08.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 -- start start 2023-09-30T13:55:08.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f369815c9e0 0x7f36980d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36980cf2e0 0x7f36980cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36980cfc70 con 0x7f369815cdc0 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36980d0aa0 con 0x7f36980cf2e0 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.338+0000 7f369f67c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36980d0d80 con 0x7f369815c9e0 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36980cf2e0 0x7f36980cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36980cf2e0 0x7f36980cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39158/0 (socket says 172.21.15.62:39158) 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 -- 172.21.15.62:0/3658477645 learned_addr learned my addr 172.21.15.62:0/3658477645 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369d418640 1 --2- 172.21.15.62:0/3658477645 >> v2:172.21.15.135:3300/0 conn(0x7f369815c9e0 0x7f36980d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 -- 172.21.15.62:0/3658477645 >> v2:172.21.15.135:3300/0 conn(0x7f369815c9e0 msgr2=0x7f36980d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 --2- 172.21.15.62:0/3658477645 >> v2:172.21.15.135:3300/0 conn(0x7f369815c9e0 0x7f36980d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 -- 172.21.15.62:0/3658477645 >> v1:172.21.15.135:6789/0 conn(0x7f369815cdc0 legacy=0x7f36980ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.339+0000 7f369dc19640 1 -- 172.21.15.62:0/3658477645 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36980d1060 con 0x7f36980cf2e0 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369dc19640 1 --2- 172.21.15.62:0/3658477645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36980cf2e0 0x7f36980cf730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f36980723f0 tx=0x7f369002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec01170dc720569e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f368bfff640 1 -- 172.21.15.62:0/3658477645 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369002c9f0 con 0x7f36980cf2e0 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f368bfff640 1 -- 172.21.15.62:0/3658477645 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369002cb50 con 0x7f36980cf2e0 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f368bfff640 1 -- 172.21.15.62:0/3658477645 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900343f0 con 0x7f36980cf2e0 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 -- 172.21.15.62:0/3658477645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36980cf2e0 msgr2=0x7f36980cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 --2- 172.21.15.62:0/3658477645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36980cf2e0 0x7f36980cf730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f36980723f0 tx=0x7f369002be50 comp rx=0 tx=0).stop 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 -- 172.21.15.62:0/3658477645 shutdown_connections 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 --2- 172.21.15.62:0/3658477645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36980cf2e0 0x7f36980cf730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 --2- 172.21.15.62:0/3658477645 >> v2:172.21.15.135:3300/0 conn(0x7f369815c9e0 0x7f36980d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 -- 172.21.15.62:0/3658477645 >> 172.21.15.62:0/3658477645 conn(0x7f3698089fe0 msgr2=0x7f36980d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:08.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 -- 172.21.15.62:0/3658477645 shutdown_connections 2023-09-30T13:55:08.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.340+0000 7f369f67c640 1 -- 172.21.15.62:0/3658477645 wait complete. 2023-09-30T13:55:08.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.341+0000 7f369f67c640 1 Processor -- start 2023-09-30T13:55:08.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 -- start start 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36980cf2e0 0x7f3698153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369815cdc0 0x7f36981f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36981543e0 con 0x7f369815c9e0 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698154550 con 0x7f369815cdc0 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369f67c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36981f2d40 con 0x7f36980cf2e0 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369cc17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369cc17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39174/0 (socket says 172.21.15.62:39174) 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369cc17640 1 -- 172.21.15.62:0/916407358 learned_addr learned my addr 172.21.15.62:0/916407358 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.342+0000 7f369dc19640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369815cdc0 0x7f36981f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369d418640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36980cf2e0 0x7f3698153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 -- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36980cf2e0 msgr2=0x7f3698153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36980cf2e0 0x7f3698153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 -- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369815cdc0 msgr2=0x7f36981f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369815cdc0 0x7f36981f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 -- 172.21.15.62:0/916407358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690009b30 con 0x7f369815c9e0 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369cc17640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3e0 tx=0x7f368c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c011830 con 0x7f369815c9e0 2023-09-30T13:55:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c0119b0 con 0x7f369815c9e0 2023-09-30T13:55:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36981f3020 con 0x7f369815c9e0 2023-09-30T13:55:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c011d60 con 0x7f369815c9e0 2023-09-30T13:55:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.343+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3698154a40 con 0x7f369815c9e0 2023-09-30T13:55:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.344+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3698154c60 con 0x7f369815c9e0 2023-09-30T13:55:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.344+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f368c01a400 con 0x7f369815c9e0 2023-09-30T13:55:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.345+0000 7f3689ffb640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 0x7f367c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.345+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f368c089590 con 0x7f369815c9e0 2023-09-30T13:55:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.345+0000 7f369d418640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 0x7f367c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.346+0000 7f369d418640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 0x7f367c06cff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f369400a950 tx=0x7f3694008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.349+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f368c0544f0 con 0x7f369815c9e0 2023-09-30T13:55:08.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.528+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36980b1400 con 0x7f369815c9e0 2023-09-30T13:55:08.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.529+0000 7f3689ffb640 1 -- 172.21.15.62:0/916407358 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f368c057b10 con 0x7f369815c9e0 2023-09-30T13:55:08.529 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:08.529 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 msgr2=0x7f367c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 0x7f367c06cff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f369400a950 tx=0x7f3694008040 comp rx=0 tx=0).stop 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 msgr2=0x7f36980c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3e0 tx=0x7f368c00b8a0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 shutdown_connections 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f367c06ab30 0x7f367c06cff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369815cdc0 0x7f36981f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f369815c9e0 0x7f36980c6150 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 --2- 172.21.15.62:0/916407358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36980cf2e0 0x7f3698153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 >> 172.21.15.62:0/916407358 conn(0x7f3698089fe0 msgr2=0x7f369815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:08.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 shutdown_connections 2023-09-30T13:55:08.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.531+0000 7f369f67c640 1 -- 172.21.15.62:0/916407358 wait complete. 2023-09-30T13:55:08.541 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T13:55:08.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:08.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.648+0000 7f167802d640 1 Processor -- start 2023-09-30T13:55:08.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.648+0000 7f167802d640 1 -- start start 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.648+0000 7f167802d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f16701598c0 0x7f16700ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f167802d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f167015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f167802d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700b1e20 con 0x7f16700cea30 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f167802d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700b1530 con 0x7f16701598c0 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f167802d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700cf330 con 0x7f16700ceea0 2023-09-30T13:55:08.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f16755c8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f16700cea30 0x7f167015d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45798/0 (socket says 172.21.15.62:45798) 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f16755c8640 1 -- 172.21.15.62:0/4041599961 learned_addr learned my addr 172.21.15.62:0/4041599961 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228934886 0 0) 0x7f16700b1e20 con 0x7f16700cea30 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f165c005730 con 0x7f16700cea30 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1675dc9640 1 --2- 172.21.15.62:0/4041599961 >> v2:172.21.15.135:3300/0 conn(0x7f16701598c0 0x7f16700ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f16765ca640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f167015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795244132 0 0) 0x7f165c005730 con 0x7f16700cea30 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 msgr2=0x7f167015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f167015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 >> v2:172.21.15.135:3300/0 conn(0x7f16701598c0 msgr2=0x7f16700ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 --2- 172.21.15.62:0/4041599961 >> v2:172.21.15.135:3300/0 conn(0x7f16701598c0 0x7f16700ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700b17d0 con 0x7f16700cea30 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f1660001670 con 0x7f16700cea30 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 >> v1:172.21.15.62:6789/0 conn(0x7f16700cea30 legacy=0x7f167015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f165c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f165c0069d0 0x7f165c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f165c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700b1530 con 0x7f165c005b80 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700cf330 con 0x7f165c0069d0 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c00db90 con 0x7f16700ceea0 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f1675dc9640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f165c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.649+0000 7f16755c8640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f165c0069d0 0x7f165c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f16765ca640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f165c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 -- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 msgr2=0x7f165c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f165c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 -- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f165c0069d0 msgr2=0x7f165c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f165c0069d0 0x7f165c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 -- 172.21.15.62:0/4041599961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c005730 con 0x7f165c005b80 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f16765ca640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16700ceea0 0x7f165c007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.650+0000 7f1675dc9640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f165c005fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1668009ab0 tx=0x7f165c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93ada6408c80e47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005990 con 0x7f165c005b80 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668005af0 con 0x7f165c005b80 2023-09-30T13:55:08.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f1674dc7640 1 -- 172.21.15.62:0/4041599961 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005ea0 con 0x7f165c005b80 2023-09-30T13:55:08.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 -- 172.21.15.62:0/4041599961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 msgr2=0x7f165c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 --2- 172.21.15.62:0/4041599961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f165c005fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1668009ab0 tx=0x7f165c007a00 comp rx=0 tx=0).stop 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f16765ca640 1 -- 172.21.15.62:0/4041599961 reap_dead start 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 -- 172.21.15.62:0/4041599961 shutdown_connections 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 -- 172.21.15.62:0/4041599961 >> 172.21.15.62:0/4041599961 conn(0x7f167006a170 msgr2=0x7f167006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 -- 172.21.15.62:0/4041599961 shutdown_connections 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.651+0000 7f167802d640 1 -- 172.21.15.62:0/4041599961 wait complete. 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.652+0000 7f167802d640 1 Processor -- start 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.652+0000 7f167802d640 1 -- start start 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 0x7f16700caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1670152df0 0x7f1670153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670155c50 con 0x7f165c005b80 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670153790 con 0x7f16700cc900 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f167802d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700aef10 con 0x7f1670152df0 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f1675dc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f1675dc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39194/0 (socket says 172.21.15.62:39194) 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f1675dc9640 1 -- 172.21.15.62:0/186103626 learned_addr learned my addr 172.21.15.62:0/186103626 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f16755c8640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 0x7f16700caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.653+0000 7f16765ca640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1670152df0 0x7f1670153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 -- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1670152df0 msgr2=0x7f1670153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1670152df0 0x7f1670153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 -- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 msgr2=0x7f16700caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 0x7f16700caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 -- 172.21.15.62:0/186103626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700ae4e0 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f16755c8640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 0x7f16700caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f1675dc9640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1668036040 tx=0x7f1668004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005e70 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668006030 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16700ae950 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680063e0 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.654+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1670155870 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.655+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16701556d0 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.655+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1668006540 con 0x7f165c005b80 2023-09-30T13:55:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.656+0000 7f16667fc640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 0x7f165406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:08.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.656+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16680ab880 con 0x7f165c005b80 2023-09-30T13:55:08.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.656+0000 7f16755c8640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 0x7f165406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:08.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.656+0000 7f16755c8640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 0x7f165406d020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f167006abf0 tx=0x7f1660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:08.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.660+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f16701556d0 con 0x7f165c005b80 2023-09-30T13:55:08.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.837+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16701556d0 con 0x7f165c005b80 2023-09-30T13:55:08.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.838+0000 7f16667fc640 1 -- 172.21.15.62:0/186103626 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f16701556d0 con 0x7f165c005b80 2023-09-30T13:55:08.838 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:08.839 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 msgr2=0x7f165406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 0x7f165406d020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f167006abf0 tx=0x7f1660009040 comp rx=0 tx=0).stop 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 msgr2=0x7f16700adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1668036040 tx=0x7f1668004730 comp rx=0 tx=0).stop 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 shutdown_connections 2023-09-30T13:55:08.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f165406ab60 0x7f165406d020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1670152df0 0x7f1670153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16700cc900 0x7f16700caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 --2- 172.21.15.62:0/186103626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f165c005b80 0x7f16700adfa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 >> 172.21.15.62:0/186103626 conn(0x7f167006a170 msgr2=0x7f1670071580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 shutdown_connections 2023-09-30T13:55:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:08.840+0000 7f167802d640 1 -- 172.21.15.62:0/186103626 wait complete. 2023-09-30T13:55:08.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T13:55:08.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T13:55:08.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T13:55:08.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T13:55:08.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-30T13:55:08.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-30T13:55:08.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-30T13:55:08.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-30T13:55:09.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.036+0000 7fcb98933640 1 Processor -- start 2023-09-30T13:55:09.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.036+0000 7fcb98933640 1 -- start start 2023-09-30T13:55:09.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.036+0000 7fb6e37f5640 1 Processor -- start 2023-09-30T13:55:09.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.036+0000 7fb6e37f5640 1 -- start start 2023-09-30T13:55:09.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e37f5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb6dc0cc1d0 0x7fb6dc0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fa067778640 1 Processor -- start 2023-09-30T13:55:09.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fcb98933640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcb940c16c0 0x7fcb9406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fcb98933640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940cb340 0x7fcb9406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fcb98933640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb94165080 con 0x7fcb94165510 2023-09-30T13:55:09.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fcb98933640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9406cd50 con 0x7fcb940c16c0 2023-09-30T13:55:09.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fcb98933640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c1aa0 con 0x7fcb940cb340 2023-09-30T13:55:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7f77e092c640 1 Processor -- start 2023-09-30T13:55:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7f77e092c640 1 -- start start 2023-09-30T13:55:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e37f5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0cc990 con 0x7fb6dc160e50 2023-09-30T13:55:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e0d90640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb6dc161230 0x7fb6dc0cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50226/0 (socket says 172.21.15.62:50226) 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e0d90640 1 -- 172.21.15.62:0/1415121965 learned_addr learned my addr 172.21.15.62:0/1415121965 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e1d92640 1 --2- 172.21.15.62:0/1415121965 >> v2:172.21.15.135:3300/0 conn(0x7fb6dc0cc1d0 0x7fb6dc0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0ccc70 con 0x7fb6dc161230 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc0cb920 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fb6d3fff640 1 -- 172.21.15.62:0/1415121965 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278796452 0 0) 0x7fb6dc0ccc70 con 0x7fb6dc161230 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fb6d3fff640 1 -- 172.21.15.62:0/1415121965 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c8003520 con 0x7fb6dc161230 2023-09-30T13:55:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.038+0000 7fa067778640 1 -- start start 2023-09-30T13:55:09.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fb6e1d92640 1 -- 172.21.15.62:0/1415121965 >> v1:172.21.15.135:6789/0 conn(0x7fb6dc161230 legacy=0x7fb6dc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fb6e1d92640 1 -- 172.21.15.62:0/1415121965 >> v1:172.21.15.62:6789/0 conn(0x7fb6dc160e50 legacy=0x7fb6dc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fb6e1d92640 1 -- 172.21.15.62:0/1415121965 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0ccf50 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fcb9259c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcb940c16c0 0x7fcb9406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fcb91d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb94165510 0x7fcb940cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45816/0 (socket says 172.21.15.62:45816) 2023-09-30T13:55:09.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fcb91d9b640 1 -- 172.21.15.62:0/2226822899 learned_addr learned my addr 172.21.15.62:0/2226822899 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:09.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f77e092c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 0x7f77d404f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f77e092c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77d40544d0 0x7f77d4038260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f77e092c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d404fa80 con 0x7f77d4054070 2023-09-30T13:55:09.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f77e092c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d404fcd0 con 0x7f77d40e7590 2023-09-30T13:55:09.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f77e092c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d404ffb0 con 0x7f77d40544d0 2023-09-30T13:55:09.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f064f59e640 1 Processor -- start 2023-09-30T13:55:09.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7f064f59e640 1 -- start start 2023-09-30T13:55:09.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fce8102e640 1 Processor -- start 2023-09-30T13:55:09.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.039+0000 7fce8102e640 1 -- start start 2023-09-30T13:55:09.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77d40544d0 0x7f77d4038260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa413fff640 1 Processor -- start 2023-09-30T13:55:09.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 0x7fa060158990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0600cba50 0x7fa0600c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0600aff60 0x7fa0600b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fcb9259c640 1 -- 172.21.15.62:0/2226822899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940cb340 msgr2=0x7fcb9406c440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T13:55:09.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600b0920 con 0x7fa0600aff60 2023-09-30T13:55:09.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600c9430 con 0x7fa0600cba50 2023-09-30T13:55:09.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa067778640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c9710 con 0x7fa06006d980 2023-09-30T13:55:09.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa413fff640 1 -- start start 2023-09-30T13:55:09.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fcb9259c640 1 --2- 172.21.15.62:0/2226822899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940cb340 0x7fcb9406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fcb9259c640 1 -- 172.21.15.62:0/2226822899 >> v1:172.21.15.62:6789/0 conn(0x7fcb94165510 legacy=0x7fcb940cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77d40544d0 0x7f77d4038260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42616/0 (socket says 172.21.15.62:42616) 2023-09-30T13:55:09.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 -- 172.21.15.62:0/4039534772 learned_addr learned my addr 172.21.15.62:0/4039534772 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77da59c640 1 --2- 172.21.15.62:0/4039534772 >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 0x7f77d404f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 -- 172.21.15.62:0/4039534772 >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 msgr2=0x7f77d404f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 --2- 172.21.15.62:0/4039534772 >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 0x7f77d404f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 -- 172.21.15.62:0/4039534772 >> v1:172.21.15.135:6789/0 conn(0x7f77d4054070 legacy=0x7f77d4037b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77dad9d640 1 -- 172.21.15.62:0/4039534772 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4053870 con 0x7f77d40544d0 2023-09-30T13:55:09.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa065514640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 0x7fa060158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fcb9259c640 1 -- 172.21.15.62:0/2226822899 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940c8c90 con 0x7fcb940c16c0 2023-09-30T13:55:09.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa065514640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 0x7fa060158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38148/0 (socket says 172.21.15.62:38148) 2023-09-30T13:55:09.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa065514640 1 -- 172.21.15.62:0/2521792284 learned_addr learned my addr 172.21.15.62:0/2521792284 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77d959a640 1 -- 172.21.15.62:0/4039534772 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085443076 0 0) 0x7f77d404fa80 con 0x7f77d4054070 2023-09-30T13:55:09.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7fa065d15640 1 --2- 172.21.15.62:0/2521792284 >> v2:172.21.15.62:3300/0 conn(0x7fa0600aff60 0x7fa0600b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f77da59c640 1 --2- 172.21.15.62:0/4039534772 >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 0x7f77d404f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064f59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0650160c10 0x7f06500b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064f59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 0x7f06500cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fce8102e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce7c1588e0 0x7fce7c0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.040+0000 7f31da2ff640 1 Processor -- start 2023-09-30T13:55:09.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f31da2ff640 1 -- start start 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31da2ff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa064d13640 1 --2- 172.21.15.62:0/2521792284 >> v2:172.21.15.135:3300/0 conn(0x7fa0600cba50 0x7fa0600c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa065d15640 1 -- 172.21.15.62:0/2521792284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 msgr2=0x7fa060158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa065d15640 1 --2- 172.21.15.62:0/2521792284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 0x7fa060158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa065d15640 1 -- 172.21.15.62:0/2521792284 >> v2:172.21.15.135:3300/0 conn(0x7fa0600cba50 msgr2=0x7fa0600c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa065d15640 1 --2- 172.21.15.62:0/2521792284 >> v2:172.21.15.135:3300/0 conn(0x7fa0600cba50 0x7fa0600c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa065d15640 1 -- 172.21.15.62:0/2521792284 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600c99f0 con 0x7fa0600aff60 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fa413fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 0x7fa40c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa413fff640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c053230 con 0x7fa40c006a80 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa4137fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa40c0e6e60 0x7fa40c0e9250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50242/0 (socket says 172.21.15.62:50242) 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa4137fe640 1 -- 172.21.15.62:0/4095431974 learned_addr learned my addr 172.21.15.62:0/4095431974 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:09.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0078d0 con 0x7fa40c0e6e60 2023-09-30T13:55:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c007bb0 con 0x7fa40c0066a0 2023-09-30T13:55:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f77dad9d640 1 --2- 172.21.15.62:0/4039534772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40544d0 0x7f77d4038260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0734e0 tx=0x7f77dc0a5840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddcbe00bf0985b77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f77d959a640 1 -- 172.21.15.62:0/4039534772 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0b0070 con 0x7f77d40544d0 2023-09-30T13:55:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f77d959a640 1 -- 172.21.15.62:0/4039534772 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc0ab450 con 0x7f77d40544d0 2023-09-30T13:55:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f77d959a640 1 -- 172.21.15.62:0/4039534772 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0a8070 con 0x7f77d40544d0 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0650160c10 0x7f06500b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0650160c10 0x7f06500b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42634/0 (socket says 172.21.15.62:42634) 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064dd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 0x7f06500cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064ed9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f06500b1100 0x7f06500cafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45830/0 (socket says 172.21.15.62:45830) 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064dd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 0x7f06500cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39238/0 (socket says 172.21.15.62:39238) 2023-09-30T13:55:09.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064e59c640 1 -- 172.21.15.62:0/1337346211 learned_addr learned my addr 172.21.15.62:0/1337346211 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0650164930 con 0x7f06500b1100 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650165790 con 0x7f0650160ff0 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650164b80 con 0x7f0650160c10 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f064e59c640 1 -- 172.21.15.62:0/1337346211 >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 msgr2=0x7f06500cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f064e59c640 1 --2- 172.21.15.62:0/1337346211 >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 0x7f06500cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f064e59c640 1 -- 172.21.15.62:0/1337346211 >> v1:172.21.15.62:6789/0 conn(0x7f06500b1100 legacy=0x7f06500cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f064e59c640 1 -- 172.21.15.62:0/1337346211 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650164e60 con 0x7f0650160c10 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fce8102e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8102e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c06d780 con 0x7fce7c158cc0 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.041+0000 7fce7bfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce7c1588e0 0x7fce7c0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38162/0 (socket says 172.21.15.62:38162) 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 -- 172.21.15.62:0/1119954541 learned_addr learned my addr 172.21.15.62:0/1119954541 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c06da60 con 0x7fce7c1588e0 2023-09-30T13:55:09.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06dd40 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa412ffd640 1 --2- 172.21.15.62:0/4095431974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 0x7fa40c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997299739 0 0) 0x7fa40c0078d0 con 0x7fa40c0e6e60 2023-09-30T13:55:09.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fcb9259c640 1 --2- 172.21.15.62:0/2226822899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940c16c0 0x7fcb9406bf00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb840097a0 tx=0x7fcb8402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124916eb2fdb3556 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31d92fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3fc003520 con 0x7fa40c0e6e60 2023-09-30T13:55:09.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31da2ff640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d406be50 con 0x7f31d40ca940 2023-09-30T13:55:09.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31d92fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38172/0 (socket says 172.21.15.62:38172) 2023-09-30T13:55:09.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31d92fd640 1 -- 172.21.15.62:0/2088699968 learned_addr learned my addr 172.21.15.62:0/2088699968 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d4158f50 con 0x7f31d406a460 2023-09-30T13:55:09.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d406ce60 con 0x7f31d406e1c0 2023-09-30T13:55:09.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f77e092c640 1 -- 172.21.15.62:0/4039534772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40544d0 msgr2=0x7f77d4038260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7f77e092c640 1 --2- 172.21.15.62:0/4039534772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40544d0 0x7f77d4038260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0734e0 tx=0x7f77dc0a5840 comp rx=0 tx=0).stop 2023-09-30T13:55:09.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fb6e1d92640 1 --2- 172.21.15.62:0/1415121965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0c9220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009d90 tx=0x7fb6d402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9383646d60617302 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 -- 172.21.15.62:0/4039534772 shutdown_connections 2023-09-30T13:55:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909439997 0 0) 0x7fa3fc003520 con 0x7fa40c0e6e60 2023-09-30T13:55:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fa412ffd640 1 -- 172.21.15.62:0/4095431974 >> v1:172.21.15.135:6789/0 conn(0x7fa40c0e6e60 legacy=0x7fa40c0e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fa412ffd640 1 -- 172.21.15.62:0/4095431974 >> v1:172.21.15.62:6789/0 conn(0x7fa40c006a80 legacy=0x7fa40c006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fa412ffd640 1 -- 172.21.15.62:0/4095431974 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c053480 con 0x7fa40c0066a0 2023-09-30T13:55:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 --2- 172.21.15.62:0/4039534772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40544d0 0x7f77d4038260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 --2- 172.21.15.62:0/4039534772 >> v2:172.21.15.62:3300/0 conn(0x7f77d40e7590 0x7f77d404f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 -- 172.21.15.62:0/4039534772 >> 172.21.15.62:0/4039534772 conn(0x7f77d4009fe0 msgr2=0x7f77d400a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 -- 172.21.15.62:0/4039534772 shutdown_connections 2023-09-30T13:55:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f31d92fd640 1 -- 172.21.15.62:0/2088699968 >> v1:172.21.15.135:6789/0 conn(0x7f31d406a460 legacy=0x7f31d40700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f31d92fd640 1 -- 172.21.15.62:0/2088699968 >> v1:172.21.15.62:6789/0 conn(0x7f31d40ca940 legacy=0x7f31d4069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f31d92fd640 1 -- 172.21.15.62:0/2088699968 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40cada0 con 0x7f31d406e1c0 2023-09-30T13:55:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f77e092c640 1 -- 172.21.15.62:0/4039534772 wait complete. 2023-09-30T13:55:09.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fb6d3fff640 1 -- 172.21.15.62:0/1415121965 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d402cbf0 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fb6d3fff640 1 -- 172.21.15.62:0/1415121965 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d402cd50 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fb6d3fff640 1 -- 172.21.15.62:0/1415121965 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4034660 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fa065d15640 1 --2- 172.21.15.62:0/2521792284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0600aff60 0x7fa0600b03e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0600682e0 tx=0x7fa05002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b22d0c70901ec0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fcb9159a640 1 -- 172.21.15.62:0/2226822899 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8402f050 con 0x7fcb940c16c0 2023-09-30T13:55:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7f064e59c640 1 --2- 172.21.15.62:0/1337346211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0650160c10 0x7f06500b1bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f065006e130 tx=0x7f064002b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca6df19ac66d464a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 -- 172.21.15.62:0/1119954541 >> v2:172.21.15.135:3300/0 conn(0x7fce7c1588e0 msgr2=0x7fce7c0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 --2- 172.21.15.62:0/1119954541 >> v2:172.21.15.135:3300/0 conn(0x7fce7c1588e0 0x7fce7c0704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 -- 172.21.15.62:0/1119954541 >> v1:172.21.15.62:6789/0 conn(0x7fce7c158cc0 legacy=0x7fce7c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.042+0000 7fce8082d640 1 -- 172.21.15.62:0/1119954541 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c06e020 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.043+0000 7fcb9159a640 1 -- 172.21.15.62:0/2226822899 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84031700 con 0x7fcb940c16c0 2023-09-30T13:55:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7f064d59a640 1 -- 172.21.15.62:0/1337346211 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640030890 con 0x7f0650160c10 2023-09-30T13:55:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7f064d59a640 1 -- 172.21.15.62:0/1337346211 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06400309f0 con 0x7f0650160c10 2023-09-30T13:55:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7f064d59a640 1 -- 172.21.15.62:0/1337346211 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640030dc0 con 0x7f0650160c10 2023-09-30T13:55:09.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa057fff640 1 -- 172.21.15.62:0/2521792284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050031830 con 0x7fa0600aff60 2023-09-30T13:55:09.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fce8082d640 1 --2- 172.21.15.62:0/1119954541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c2e0 tx=0x7fce7402e420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284dd4fb7a7ebb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa057fff640 1 -- 172.21.15.62:0/2521792284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050031990 con 0x7fa0600aff60 2023-09-30T13:55:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fcb9159a640 1 -- 172.21.15.62:0/2226822899 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84031a90 con 0x7fcb940c16c0 2023-09-30T13:55:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa057fff640 1 -- 172.21.15.62:0/2521792284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050031d20 con 0x7fa0600aff60 2023-09-30T13:55:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa412ffd640 1 --2- 172.21.15.62:0/4095431974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 0x7fa40c03a940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b0e0 tx=0x7fa40402c0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fefaff7ea54faf65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc0cc1d0 msgr2=0x7fb6dc0c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fb6e37f5640 1 --2- 172.21.15.62:0/1415121965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0c9220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009d90 tx=0x7fb6d402be40 comp rx=0 tx=0).stop 2023-09-30T13:55:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fce7affd640 1 -- 172.21.15.62:0/1119954541 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400a4e0 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 shutdown_connections 2023-09-30T13:55:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fb6e37f5640 1 --2- 172.21.15.62:0/1415121965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0c9220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 >> 172.21.15.62:0/1415121965 conn(0x7fb6dc06a430 msgr2=0x7fb6dc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7f31d92fd640 1 --2- 172.21.15.62:0/2088699968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009880 tx=0x7f31d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5021d136f7d6f7b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fce7affd640 1 -- 172.21.15.62:0/1119954541 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74031050 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fce7affd640 1 -- 172.21.15.62:0/1119954541 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400a840 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414067d20 con 0x7fa40c0066a0 2023-09-30T13:55:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7f31cbfff640 1 -- 172.21.15.62:0/2088699968 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0004230 con 0x7f31d406e1c0 2023-09-30T13:55:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40402cc50 con 0x7fa40c0066a0 2023-09-30T13:55:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fcb98933640 1 -- 172.21.15.62:0/2226822899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940c16c0 msgr2=0x7fcb9406bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.044+0000 7fcb98933640 1 --2- 172.21.15.62:0/2226822899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940c16c0 0x7fcb9406bf00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb840097a0 tx=0x7fcb8402b7a0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f31cbfff640 1 -- 172.21.15.62:0/2088699968 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0004390 con 0x7f31d406e1c0 2023-09-30T13:55:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f31cbfff640 1 -- 172.21.15.62:0/2088699968 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0031830 con 0x7f31d406e1c0 2023-09-30T13:55:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa411ffb640 1 -- 172.21.15.62:0/4095431974 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404034440 con 0x7fa40c0066a0 2023-09-30T13:55:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0650160c10 msgr2=0x7f06500b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 -- 172.21.15.62:0/2521792284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0600aff60 msgr2=0x7fa0600b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 --2- 172.21.15.62:0/2521792284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0600aff60 0x7fa0600b03e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0600682e0 tx=0x7fa05002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 -- 172.21.15.62:0/2226822899 shutdown_connections 2023-09-30T13:55:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 --2- 172.21.15.62:0/2226822899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940cb340 0x7fcb9406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 --2- 172.21.15.62:0/2226822899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940c16c0 0x7fcb9406bf00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 -- 172.21.15.62:0/2226822899 >> 172.21.15.62:0/2226822899 conn(0x7fcb940afec0 msgr2=0x7fcb940b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f064f59e640 1 --2- 172.21.15.62:0/1337346211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0650160c10 0x7f06500b1bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f065006e130 tx=0x7f064002b9d0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 -- 172.21.15.62:0/2521792284 shutdown_connections 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 --2- 172.21.15.62:0/2521792284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0600aff60 0x7fa0600b03e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 --2- 172.21.15.62:0/2521792284 >> v2:172.21.15.135:3300/0 conn(0x7fa0600cba50 0x7fa0600c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 --2- 172.21.15.62:0/2521792284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa06006d980 0x7fa060158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 -- 172.21.15.62:0/2521792284 >> 172.21.15.62:0/2521792284 conn(0x7fa0600caf60 msgr2=0x7fa0600cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 -- 172.21.15.62:0/2521792284 shutdown_connections 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fa067778640 1 -- 172.21.15.62:0/2521792284 wait complete. 2023-09-30T13:55:09.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 -- 172.21.15.62:0/2226822899 shutdown_connections 2023-09-30T13:55:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 msgr2=0x7fce7c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fce8102e640 1 --2- 172.21.15.62:0/1119954541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c2e0 tx=0x7fce7402e420 comp rx=0 tx=0).stop 2023-09-30T13:55:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 msgr2=0x7f31d406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2088699968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009880 tx=0x7f31d002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 shutdown_connections 2023-09-30T13:55:09.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7fcb98933640 1 -- 172.21.15.62:0/2226822899 wait complete. 2023-09-30T13:55:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fce8102e640 1 --2- 172.21.15.62:0/1119954541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c0c9750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fce8102e640 1 --2- 172.21.15.62:0/1119954541 >> v2:172.21.15.135:3300/0 conn(0x7fce7c1588e0 0x7fce7c0704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 >> 172.21.15.62:0/1119954541 conn(0x7fce7c0b0570 msgr2=0x7fce7c0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 shutdown_connections 2023-09-30T13:55:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 msgr2=0x7fa40c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2088699968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d406dba0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 >> 172.21.15.62:0/2088699968 conn(0x7f31d40b0080 msgr2=0x7f31d40b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 --2- 172.21.15.62:0/4095431974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 0x7fa40c03a940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b0e0 tx=0x7fa40402c0a0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f77e092c640 1 Processor -- start 2023-09-30T13:55:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.045+0000 7f77e092c640 1 -- start start 2023-09-30T13:55:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 shutdown_connections 2023-09-30T13:55:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fce8102e640 1 -- 172.21.15.62:0/1119954541 wait complete. 2023-09-30T13:55:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 shutdown_connections 2023-09-30T13:55:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 shutdown_connections 2023-09-30T13:55:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 --2- 172.21.15.62:0/1337346211 >> v2:172.21.15.62:3300/0 conn(0x7f0650160ff0 0x7f06500cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 --2- 172.21.15.62:0/1337346211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0650160c10 0x7f06500b1bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 >> 172.21.15.62:0/1337346211 conn(0x7f065006d240 msgr2=0x7f065006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f31da2ff640 1 -- 172.21.15.62:0/2088699968 wait complete. 2023-09-30T13:55:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 shutdown_connections 2023-09-30T13:55:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 --2- 172.21.15.62:0/4095431974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0066a0 0x7fa40c03a940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f77e092c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77d4054070 0x7f77d4171440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f77e092c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 0x7f77d4185e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 shutdown_connections 2023-09-30T13:55:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 >> 172.21.15.62:0/4095431974 conn(0x7fa40c00a550 msgr2=0x7fa40c00a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 shutdown_connections 2023-09-30T13:55:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f064f59e640 1 -- 172.21.15.62:0/1337346211 wait complete. 2023-09-30T13:55:09.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7fa413fff640 1 -- 172.21.15.62:0/4095431974 wait complete. 2023-09-30T13:55:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fa067778640 1 Processor -- start 2023-09-30T13:55:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f77e092c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40e7590 0x7f77d4188a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fa067778640 1 -- start start 2023-09-30T13:55:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fcb98933640 1 Processor -- start 2023-09-30T13:55:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.046+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 0x7f77d4185e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 0x7f77d4185e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38174/0 (socket says 172.21.15.62:38174) 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77dad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40e7590 0x7f77d4188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77dad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40e7590 0x7f77d4188a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42650/0 (socket says 172.21.15.62:42650) 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77d9d9b640 1 -- 172.21.15.62:0/1392179550 learned_addr learned my addr 172.21.15.62:0/1392179550 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41899e0 con 0x7f77d4054070 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4185450 con 0x7f77d40e7590 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4189420 con 0x7f77d40544d0 2023-09-30T13:55:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77da59c640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77d4054070 0x7f77d4171440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 shutdown_connections 2023-09-30T13:55:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77d9d9b640 1 -- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40e7590 msgr2=0x7f77d4188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7f31da2ff640 1 Processor -- start 2023-09-30T13:55:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1415121965 wait complete. 2023-09-30T13:55:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fce8102e640 1 Processor -- start 2023-09-30T13:55:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7f31da2ff640 1 -- start start 2023-09-30T13:55:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa067778640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 0x7fa0600c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7fcb98933640 1 -- start start 2023-09-30T13:55:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fcb98933640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 0x7fcb9415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa065514640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 0x7fa0600c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fcb98933640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940cb340 0x7fcb940c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa065514640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 0x7fa0600c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39256/0 (socket says 172.21.15.62:39256) 2023-09-30T13:55:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fcb98933640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94165510 0x7fcb940c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fce8102e640 1 -- start start 2023-09-30T13:55:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa065514640 1 -- 172.21.15.62:0/4185682269 learned_addr learned my addr 172.21.15.62:0/4185682269 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb98933640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c7db0 con 0x7fcb940cb340 2023-09-30T13:55:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 0x7fcb9415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 0x7fcb9415ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38188/0 (socket says 172.21.15.62:38188) 2023-09-30T13:55:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa067778640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0600aff60 0x7fa0600c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 -- 172.21.15.62:0/3819762566 learned_addr learned my addr 172.21.15.62:0/3819762566 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.048+0000 7fa067778640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0600cba50 0x7fa0600c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c0f30 con 0x7fa06006d980 2023-09-30T13:55:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c2df0 con 0x7fa0600aff60 2023-09-30T13:55:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c1790 con 0x7fa0600cba50 2023-09-30T13:55:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c2f40 con 0x7fcb94165510 2023-09-30T13:55:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c6ec0 con 0x7fcb940c16c0 2023-09-30T13:55:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f064f59e640 1 Processor -- start 2023-09-30T13:55:09.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f064f59e640 1 -- start start 2023-09-30T13:55:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f31da2ff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 0x7f31d41590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065d15640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0600cba50 0x7fa0600c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa413fff640 1 Processor -- start 2023-09-30T13:55:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.047+0000 7f77d9d9b640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77d40e7590 0x7f77d4188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb91d9b640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940cb340 0x7fcb940c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f77d9d9b640 1 -- 172.21.15.62:0/1392179550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77d4054070 msgr2=0x7f77d4171440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f77d9d9b640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77d4054070 0x7f77d4171440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f77d9d9b640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009400 con 0x7f77d40544d0 2023-09-30T13:55:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa413fff640 1 -- start start 2023-09-30T13:55:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f77da59c640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77d4054070 0x7f77d4171440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fb6e37f5640 1 Processor -- start 2023-09-30T13:55:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065514640 1 -- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0600cba50 msgr2=0x7fa0600c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065514640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0600cba50 0x7fa0600c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb92d9d640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94165510 0x7fcb940c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 -- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94165510 msgr2=0x7fcb940c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f31d92fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 0x7f31d41590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f31d92fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 0x7f31d41590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39272/0 (socket says 172.21.15.62:39272) 2023-09-30T13:55:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94165510 0x7fcb940c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 -- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940cb340 msgr2=0x7fcb940c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7f31da2ff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d41f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31d92fd640 1 -- 172.21.15.62:0/2051524983 learned_addr learned my addr 172.21.15.62:0/2051524983 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065514640 1 -- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0600aff60 msgr2=0x7fa0600c37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T13:55:09.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065514640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0600aff60 0x7fa0600c37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fa065514640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009400 con 0x7fa06006d980 2023-09-30T13:55:09.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fcb9259c640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940cb340 0x7fcb940c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb9259c640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009400 con 0x7fcb940c16c0 2023-09-30T13:55:09.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb92d9d640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb94165510 0x7fcb940c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:09.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fa065d15640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0600cba50 0x7fa0600c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb91d9b640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb940cb340 0x7fcb940c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:09.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31d8afc640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d41f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fa065514640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 0x7fa0600c3280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0580070b0 tx=0x7fa05800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d40ca940 0x7f31d40cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb9259c640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 0x7fcb9415ff00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb840098c0 tx=0x7fcb840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b1950 con 0x7f31d406a460 2023-09-30T13:55:09.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d415f930 con 0x7f31d40ca940 2023-09-30T13:55:09.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d415feb0 con 0x7f31d406e1c0 2023-09-30T13:55:09.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f064f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06500b1100 0x7f06500b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31d9afe640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d40ca940 0x7f31d40cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800dd80 con 0x7fa06006d980 2023-09-30T13:55:09.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600c1a70 con 0x7fa06006d980 2023-09-30T13:55:09.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.049+0000 7fb6e37f5640 1 -- start start 2023-09-30T13:55:09.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fb6e37f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0650160c10 0x7f06500b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e37f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 0x7fb6dc163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06500b1100 0x7f06500b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06500b1100 0x7f06500b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42700/0 (socket says 172.21.15.62:42700) 2023-09-30T13:55:09.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 0x7fa40c174590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064e59c640 1 -- 172.21.15.62:0/151370506 learned_addr learned my addr 172.21.15.62:0/151370506 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e37f5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6dc15b000 0x7fb6dc0c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40c006a80 0x7fa40c036a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064f59e640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0650160ff0 0x7f065015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e0d90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 0x7fb6dc163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e1591640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e0d90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 0x7fb6dc163eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42712/0 (socket says 172.21.15.62:42712) 2023-09-30T13:55:09.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e1591640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39276/0 (socket says 172.21.15.62:39276) 2023-09-30T13:55:09.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0e6e60 0x7fa40c178260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064dd9b640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0650160c10 0x7f06500b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa412ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 0x7fa40c174590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e0d90640 1 -- 172.21.15.62:0/1568992409 learned_addr learned my addr 172.21.15.62:0/1568992409 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 0x7fce7c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c158cc0 0x7fce7c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa412ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 0x7fa40c174590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39290/0 (socket says 172.21.15.62:39290) 2023-09-30T13:55:09.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ab8d0 con 0x7fce7c158cc0 2023-09-30T13:55:09.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0c8e80 con 0x7fce7c1588e0 2023-09-30T13:55:09.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8102e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0c66a0 con 0x7fce7c0ccfb0 2023-09-30T13:55:09.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce8082d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c158cc0 0x7fce7c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c95d0 con 0x7f0650160ff0 2023-09-30T13:55:09.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 0x7fce7c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 0x7fce7c0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42716/0 (socket says 172.21.15.62:42716) 2023-09-30T13:55:09.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 -- 172.21.15.62:0/998422564 learned_addr learned my addr 172.21.15.62:0/998422564 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0650162230 con 0x7f06500b1100 2023-09-30T13:55:09.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e1d92640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6dc15b000 0x7fb6dc0c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa412ffd640 1 -- 172.21.15.62:0/471779940 learned_addr learned my addr 172.21.15.62:0/471779940 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc15b4b0 con 0x7fb6dc0cc1d0 2023-09-30T13:55:09.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800f040 con 0x7fa06006d980 2023-09-30T13:55:09.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c92f0 con 0x7f0650160c10 2023-09-30T13:55:09.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc162e10 con 0x7fb6dc160e50 2023-09-30T13:55:09.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0490a0 con 0x7fa40c0066a0 2023-09-30T13:55:09.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1630f0 con 0x7fb6dc15b000 2023-09-30T13:55:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa4137fe640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0e6e60 0x7fa40c178260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa4127fc640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40c006a80 0x7fa40c036a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0373a0 con 0x7fa40c006a80 2023-09-30T13:55:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7f31d92fd640 1 -- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 msgr2=0x7f31d41f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f31d92fd640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f31d406e1c0 0x7f31d41f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c037680 con 0x7fa40c0e6e60 2023-09-30T13:55:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f77d9d9b640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 0x7f77d4185e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c410 tx=0x7f77cc00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 -- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 msgr2=0x7fce7c14a040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T13:55:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce7c0ccfb0 0x7fce7c14a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7fce7b7fe640 1 -- 172.21.15.62:0/998422564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c158cc0 msgr2=0x7fce7c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f31d92fd640 1 -- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d40ca940 msgr2=0x7f31d40cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f31d92fd640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31d40ca940 0x7f31d40cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0035f0 con 0x7f77d40544d0 2023-09-30T13:55:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058015620 con 0x7fa06006d980 2023-09-30T13:55:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fce7b7fe640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c158cc0 0x7fce7c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fce7b7fe640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7400c050 con 0x7fce7c1588e0 2023-09-30T13:55:09.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f31d92fd640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0009460 con 0x7f31d406a460 2023-09-30T13:55:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84033bf0 con 0x7fcb940c16c0 2023-09-30T13:55:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84033d50 con 0x7fcb940c16c0 2023-09-30T13:55:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8403d650 con 0x7fcb940c16c0 2023-09-30T13:55:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb940c71a0 con 0x7fcb940c16c0 2023-09-30T13:55:09.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.050+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb940c7760 con 0x7fcb940c16c0 2023-09-30T13:55:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fce8082d640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce7c158cc0 0x7fce7c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.051+0000 7f31d92fd640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 0x7f31d41590e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000c00 tx=0x7f31d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003950 con 0x7f31d406a460 2023-09-30T13:55:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4189700 con 0x7f77d40544d0 2023-09-30T13:55:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d4185940 con 0x7f77d40544d0 2023-09-30T13:55:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa412ffd640 1 -- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0e6e60 msgr2=0x7fa40c178260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa412ffd640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa40c0e6e60 0x7fa40c178260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa412ffd640 1 -- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40c006a80 msgr2=0x7fa40c036a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa412ffd640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40c006a80 0x7fa40c036a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa412ffd640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009400 con 0x7fa40c0066a0 2023-09-30T13:55:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fce7b7fe640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 0x7fce7c0c5b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce70001ab0 tx=0x7fce70014420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600c2a80 con 0x7fa06006d980 2023-09-30T13:55:09.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fa4127fc640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa40c006a80 0x7fa40c036a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:09.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc003770 con 0x7f77d40544d0 2023-09-30T13:55:09.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc003b20 con 0x7f77d40544d0 2023-09-30T13:55:09.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fa412ffd640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 0x7fa40c174590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b0e0 tx=0x7fa4040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb78000fc0 con 0x7fcb940c16c0 2023-09-30T13:55:09.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 -- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06500b1100 msgr2=0x7f06500b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d003f070 con 0x7f31d406a460 2023-09-30T13:55:09.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003cb0 con 0x7f31d406a460 2023-09-30T13:55:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06500b1100 0x7f06500b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 -- 172.21.15.62:0/151370506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0650160ff0 msgr2=0x7f065015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0650160ff0 0x7f065015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400094d0 con 0x7f0650160c10 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70017070 con 0x7fce7c1588e0 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70014b30 con 0x7fce7c1588e0 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700050d0 con 0x7fce7c1588e0 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0c6980 con 0x7fce7c1588e0 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0abe50 con 0x7fce7c1588e0 2023-09-30T13:55:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0600ca040 con 0x7fa06006d980 2023-09-30T13:55:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7f064dd9b640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0650160c10 0x7f06500b4df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f064400e880 tx=0x7f064400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400c940 con 0x7f0650160c10 2023-09-30T13:55:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce7c06d410 con 0x7fce7c1588e0 2023-09-30T13:55:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400caa0 con 0x7f0650160c10 2023-09-30T13:55:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400ce50 con 0x7f0650160c10 2023-09-30T13:55:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650161be0 con 0x7f0650160c10 2023-09-30T13:55:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500c8e60 con 0x7f0650160c10 2023-09-30T13:55:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40b10b0 con 0x7f31d406a460 2023-09-30T13:55:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40b1670 con 0x7f31d406a460 2023-09-30T13:55:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f77cc003c80 con 0x7f77d40544d0 2023-09-30T13:55:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7f77caffd640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77bc06ab30 0x7f77bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fb6e0d90640 1 -- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6dc15b000 msgr2=0x7fb6dc0c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fb6e0d90640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6dc15b000 0x7fb6dc0c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fb6e0d90640 1 -- 172.21.15.62:0/1568992409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6dc0cc1d0 msgr2=0x7fb6dc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fb6e0d90640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6dc0cc1d0 0x7fb6dc0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.052+0000 7fb6e0d90640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4009a70 con 0x7fb6dc160e50 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.053+0000 7fb6e0d90640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 0x7fb6dc163eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001eb0 tx=0x7fb6cc00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc005ce0 con 0x7fb6dc160e50 2023-09-30T13:55:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc005e40 con 0x7fb6dc160e50 2023-09-30T13:55:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0072f0 con 0x7fb6dc160e50 2023-09-30T13:55:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.054+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc1633d0 con 0x7fb6dc160e50 2023-09-30T13:55:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc163990 con 0x7fb6dc160e50 2023-09-30T13:55:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404034c00 con 0x7fa40c0066a0 2023-09-30T13:55:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77c0000fc0 con 0x7f77d40544d0 2023-09-30T13:55:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7f77da59c640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77bc06ab30 0x7f77bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77cc088aa0 con 0x7f77d40544d0 2023-09-30T13:55:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c048d30 con 0x7fa40c0066a0 2023-09-30T13:55:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.055+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c04c5b0 con 0x7fa40c0066a0 2023-09-30T13:55:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06500c90e0 con 0x7f0650160c10 2023-09-30T13:55:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404034d60 con 0x7fa40c0066a0 2023-09-30T13:55:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40403e680 con 0x7fa40c0066a0 2023-09-30T13:55:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f77caffd640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f77bc0740f0 0x7f77bc076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77bc076c00 con 0x7f77bc0740f0 2023-09-30T13:55:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa058015780 con 0x7fa06006d980 2023-09-30T13:55:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77cc001120 con 0x7f77d40544d0 2023-09-30T13:55:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fce70010850 con 0x7fce7c1588e0 2023-09-30T13:55:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f77da59c640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77bc06ab30 0x7f77bc06cff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77d0011380 tx=0x7f77d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f77dad9d640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f77bc0740f0 0x7f77bc076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.056+0000 7f31b77fe640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31d406c380 con 0x7f31d406a460 2023-09-30T13:55:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce78ff9640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fa055ffb640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa04406ac30 0x7fa04406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7f77dad9d640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f77bc0740f0 0x7f77bc076530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce700919f0 con 0x7fce7c1588e0 2023-09-30T13:55:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce78ff9640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7fce68074240 0x7fce68076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce68076d50 con 0x7fce68074240 2023-09-30T13:55:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce70091da0 con 0x7fce7c1588e0 2023-09-30T13:55:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce7bfff640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0644013470 con 0x7f0650160c10 2023-09-30T13:55:09.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fa064d13640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa04406ac30 0x7fa04406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb6cc007510 con 0x7fb6dc160e50 2023-09-30T13:55:09.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fce8082d640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7fce68074240 0x7fce68076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa058089fa0 con 0x7fa06006d980 2023-09-30T13:55:09.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3f4000fc0 con 0x7fa40c0066a0 2023-09-30T13:55:09.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7f063effd640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f063006ac00 0x7f063006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.057+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0644089500 con 0x7f0650160c10 2023-09-30T13:55:09.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f064e59c640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f063006ac00 0x7f063006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f063effd640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7f06300741c0 0x7f0630076600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6d1ffb640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb6c006ab80 0x7fb6c006d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== osd.4 v2:172.21.15.135:6824/2988495300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f77bc076c00 con 0x7f77bc0740f0 2023-09-30T13:55:09.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6dc0cd510 con 0x7fb6dc160e50 2023-09-30T13:55:09.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fa055ffb640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fa044074270 0x7fa0440766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa044076d80 con 0x7fa044074270 2023-09-30T13:55:09.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa05808a350 con 0x7fa06006d980 2023-09-30T13:55:09.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fce7bfff640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0b49b0 tx=0x7fce6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6cc0888f0 con 0x7fb6dc160e50 2023-09-30T13:55:09.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6e1591640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb6c006ab80 0x7fb6c006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6d1ffb640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fb6c0074140 0x7fb6c0076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6c0076c50 con 0x7fb6c0074140 2023-09-30T13:55:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6cc007ea0 con 0x7fb6dc160e50 2023-09-30T13:55:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0630076cd0 con 0x7f06300741c0 2023-09-30T13:55:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f064e59c640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f063006ac00 0x7f063006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f064002ba10 tx=0x7f0640008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0644054580 con 0x7f0650160c10 2023-09-30T13:55:09.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6e1d92640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fb6c0074140 0x7fb6c0076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7f064ed9d640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7f06300741c0 0x7f0630076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fce8082d640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7fce68074240 0x7fce68076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fb6e1591640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb6c006ab80 0x7fb6c006d040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8004f60 tx=0x7fb6d8007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.058+0000 7fa064d13640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa04406ac30 0x7fa04406d0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0600ae2a0 tx=0x7fa05c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa065d15640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fa044074270 0x7fa0440766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa40403e7e0 con 0x7fa40c0066a0 2023-09-30T13:55:09.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fb6e1d92640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fb6c0074140 0x7fb6c0076580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7f064ed9d640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7f06300741c0 0x7f0630076600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa3fb7fe640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa40006ab80 0x7fa40006d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa065d15640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fa044074270 0x7fa0440766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== osd.6 v2:172.21.15.135:6800/3317239655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fce68076d50 con 0x7fce68074240 2023-09-30T13:55:09.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4040ab530 con 0x7fa40c0066a0 2023-09-30T13:55:09.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.059+0000 7fa3fb7fe640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7fa4000741c0 0x7fa400076600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa4127fc640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa40006ab80 0x7fa40006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa400076cd0 con 0x7fa4000741c0 2023-09-30T13:55:09.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4040adc40 con 0x7fa40c0066a0 2023-09-30T13:55:09.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa4137fe640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7fa4000741c0 0x7fa400076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== osd.7 v2:172.21.15.135:6816/53145653 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb6c0076c50 con 0x7fb6c0074140 2023-09-30T13:55:09.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa4127fc640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa40006ab80 0x7fa40006d040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa40c04f0a0 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fa4137fe640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7fa4000741c0 0x7fa400076600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== osd.1 v2:172.21.15.62:6800/2839251162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa044076d80 con 0x7fa044074270 2023-09-30T13:55:09.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f31d0041030 con 0x7f31d406a460 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7f31c9ffb640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31b806ac00 0x7f31b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31d00abac0 con 0x7f31d406a460 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7f31c9ffb640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f31b8074240 0x7f31b8076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31b8076d50 con 0x7f31b8074240 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31d00abe70 con 0x7f31d406a460 2023-09-30T13:55:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fcb8403a050 con 0x7fcb940c16c0 2023-09-30T13:55:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== osd.5 v2:172.21.15.135:6808/2369531037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0630076cd0 con 0x7f06300741c0 2023-09-30T13:55:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fcb82ffd640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcb7406ac30 0x7fcb7406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.060+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb840ab6e0 con 0x7fcb940c16c0 2023-09-30T13:55:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7f31d8afc640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31b806ac00 0x7f31b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7fcb82ffd640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7fcb74074270 0x7fcb740766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== osd.2 v2:172.21.15.62:6808/756004547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa400076cd0 con 0x7fa4000741c0 2023-09-30T13:55:09.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7f31d9afe640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f31b8074240 0x7f31b8076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb74076d80 con 0x7fcb74074270 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb8402f020 con 0x7fcb940c16c0 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.061+0000 7fcb92d9d640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7fcb74074270 0x7fcb740766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7fcb92d9d640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7fcb74074270 0x7fcb740766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7fcb91d9b640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcb7406ac30 0x7fcb7406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.063+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== osd.3 v2:172.21.15.62:6824/3656322715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcb74076d80 con 0x7fcb74074270 2023-09-30T13:55:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7f31d8afc640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31b806ac00 0x7f31b806d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31d40c53c0 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.062+0000 7f31d9afe640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f31b8074240 0x7f31b8076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.064+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== osd.0 v2:172.21.15.62:6812/1670179498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f31b8076d50 con 0x7f31b8074240 2023-09-30T13:55:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.071+0000 7fcb91d9b640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcb7406ac30 0x7fcb7406d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb94160f80 tx=0x7fcb8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.088+0000 7f77e092c640 1 -- 172.21.15.62:0/1392179550 --> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77c0002cb0 con 0x7f77bc0740f0 2023-09-30T13:55:09.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.089+0000 7f77caffd640 1 -- 172.21.15.62:0/1392179550 <== osd.4 v2:172.21.15.135:6824/2988495300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77c0002cb0 con 0x7f77bc0740f0 2023-09-30T13:55:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f77bc0740f0 msgr2=0x7f77bc076530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f77bc0740f0 0x7f77bc076530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77bc06ab30 msgr2=0x7f77bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77bc06ab30 0x7f77bc06cff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77d0011380 tx=0x7f77d0009190 comp rx=0 tx=0).stop 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 msgr2=0x7f77d4185e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77c8ff9640 1 --2- 172.21.15.62:0/1392179550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77d40544d0 0x7f77d4185e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c410 tx=0x7f77cc00c8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.090+0000 7f77dad9d640 1 -- 172.21.15.62:0/1392179550 reap_dead start 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.091+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 shutdown_connections 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.091+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 >> 172.21.15.62:0/1392179550 conn(0x7f77d4009fe0 msgr2=0x7f77d4052cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.091+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 shutdown_connections 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.091+0000 7f77c8ff9640 1 -- 172.21.15.62:0/1392179550 wait complete. 2023-09-30T13:55:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.091+0000 7fb6e37f5640 1 -- 172.21.15.62:0/1568992409 --> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6dc15b940 con 0x7fb6c0074140 2023-09-30T13:55:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.092+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 --> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce7c06e300 con 0x7fce68074240 2023-09-30T13:55:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.092+0000 7fb6d1ffb640 1 -- 172.21.15.62:0/1568992409 <== osd.7 v2:172.21.15.135:6816/53145653 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb6dc15b940 con 0x7fb6c0074140 2023-09-30T13:55:09.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.092+0000 7fce78ff9640 1 -- 172.21.15.62:0/998422564 <== osd.6 v2:172.21.15.135:6800/3317239655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce74001030 con 0x7fce68074240 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7fce68074240 msgr2=0x7fce68076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7fce68074240 0x7fce68076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ac00 msgr2=0x7fce6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0b49b0 tx=0x7fce6c008040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 msgr2=0x7fce7c0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 --2- 172.21.15.62:0/998422564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce7c1588e0 0x7fce7c0c5b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce70001ab0 tx=0x7fce70014420 comp rx=0 tx=0).stop 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8082d640 1 -- 172.21.15.62:0/998422564 reap_dead start 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.093+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 shutdown_connections 2023-09-30T13:55:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 >> 172.21.15.62:0/998422564 conn(0x7fce7c0b0570 msgr2=0x7fce7c157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fb6c0074140 msgr2=0x7fb6c0076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 shutdown_connections 2023-09-30T13:55:09.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 --> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0600c9cd0 con 0x7fa044074270 2023-09-30T13:55:09.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fce8102e640 1 -- 172.21.15.62:0/998422564 wait complete. 2023-09-30T13:55:09.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fb6c0074140 0x7fb6c0076580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb6c006ab80 msgr2=0x7fb6c006d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb6c006ab80 0x7fb6c006d040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8004f60 tx=0x7fb6d8007e30 comp rx=0 tx=0).stop 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 msgr2=0x7fb6dc163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 --2- 172.21.15.62:0/1568992409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6dc160e50 0x7fb6dc163eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001eb0 tx=0x7fb6cc00c820 comp rx=0 tx=0).stop 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6e1d92640 1 -- 172.21.15.62:0/1568992409 reap_dead start 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 shutdown_connections 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 --> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3f4002cb0 con 0x7fa4000741c0 2023-09-30T13:55:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 >> 172.21.15.62:0/1568992409 conn(0x7fb6dc06a430 msgr2=0x7fb6dc165070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7f31b77fe640 1 -- 172.21.15.62:0/2051524983 --> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31d406c0a0 con 0x7f31b8074240 2023-09-30T13:55:09.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 shutdown_connections 2023-09-30T13:55:09.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.094+0000 7fb6bf7fe640 1 -- 172.21.15.62:0/1568992409 wait complete. 2023-09-30T13:55:09.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7fa055ffb640 1 -- 172.21.15.62:0/4185682269 <== osd.1 v2:172.21.15.62:6800/2839251162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa050031b80 con 0x7fa044074270 2023-09-30T13:55:09.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7fa3fb7fe640 1 -- 172.21.15.62:0/471779940 <== osd.2 v2:172.21.15.62:6808/756004547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3f4002cb0 con 0x7fa4000741c0 2023-09-30T13:55:09.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7f31c9ffb640 1 -- 172.21.15.62:0/2051524983 <== osd.0 v2:172.21.15.62:6812/1670179498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31cc009bb0 con 0x7f31b8074240 2023-09-30T13:55:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7fa4000741c0 msgr2=0x7fa400076600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7fa413fff640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7fa4000741c0 0x7fa400076600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.095+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa40006ab80 msgr2=0x7fa40006d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa40006ab80 0x7fa40006d040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa40c04f0a0 tx=0x7fa408009040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 msgr2=0x7fa40c174590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 --2- 172.21.15.62:0/471779940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa40c0066a0 0x7fa40c174590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa40400b0e0 tx=0x7fa4040046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fa044074270 msgr2=0x7fa0440766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa4137fe640 1 -- 172.21.15.62:0/471779940 reap_dead start 2023-09-30T13:55:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fa044074270 0x7fa0440766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 shutdown_connections 2023-09-30T13:55:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 >> 172.21.15.62:0/471779940 conn(0x7fa40c00a550 msgr2=0x7fa40c050260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa04406ac30 msgr2=0x7fa04406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa04406ac30 0x7fa04406d0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa0600ae2a0 tx=0x7fa05c008040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 msgr2=0x7fa0600c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 --2- 172.21.15.62:0/4185682269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa06006d980 0x7fa0600c3280 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0580070b0 tx=0x7fa05800d4a0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa065d15640 1 -- 172.21.15.62:0/4185682269 reap_dead start 2023-09-30T13:55:09.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 shutdown_connections 2023-09-30T13:55:09.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa413fff640 1 -- 172.21.15.62:0/471779940 wait complete. 2023-09-30T13:55:09.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 --> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb78002cb0 con 0x7fcb74074270 2023-09-30T13:55:09.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f31b8074240 msgr2=0x7f31b8076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f31b8074240 0x7f31b8076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7f064f59e640 1 -- 172.21.15.62:0/151370506 --> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0650165420 con 0x7f06300741c0 2023-09-30T13:55:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 shutdown_connections 2023-09-30T13:55:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.096+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 >> 172.21.15.62:0/4185682269 conn(0x7fa0600caf60 msgr2=0x7fa060149a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31b806ac00 msgr2=0x7f31b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31b806ac00 0x7f31b806d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31d40c53c0 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 shutdown_connections 2023-09-30T13:55:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7fa067778640 1 -- 172.21.15.62:0/4185682269 wait complete. 2023-09-30T13:55:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 msgr2=0x7f31d41590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f063effd640 1 -- 172.21.15.62:0/151370506 <== osd.5 v2:172.21.15.135:6808/2369531037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06480017e0 con 0x7f06300741c0 2023-09-30T13:55:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7fcb82ffd640 1 -- 172.21.15.62:0/3819762566 <== osd.3 v2:172.21.15.62:6824/3656322715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb78002cb0 con 0x7fcb74074270 2023-09-30T13:55:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f31da2ff640 1 --2- 172.21.15.62:0/2051524983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31d406a460 0x7f31d41590e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000c00 tx=0x7f31d00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.097+0000 7f31d9afe640 1 -- 172.21.15.62:0/2051524983 reap_dead start 2023-09-30T13:55:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 shutdown_connections 2023-09-30T13:55:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 >> 172.21.15.62:0/2051524983 conn(0x7f31d40b0080 msgr2=0x7f31d4157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7f06300741c0 msgr2=0x7f0630076600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7f06300741c0 0x7f0630076600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7fcb74074270 msgr2=0x7fcb740766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7fcb74074270 0x7fcb740766b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 shutdown_connections 2023-09-30T13:55:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f063006ac00 msgr2=0x7f063006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f063006ac00 0x7f063006d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f064002ba10 tx=0x7f0640008030 comp rx=0 tx=0).stop 2023-09-30T13:55:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f31da2ff640 1 -- 172.21.15.62:0/2051524983 wait complete. 2023-09-30T13:55:09.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0650160c10 msgr2=0x7f06500b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 --2- 172.21.15.62:0/151370506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0650160c10 0x7f06500b4df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f064400e880 tx=0x7f064400ed40 comp rx=0 tx=0).stop 2023-09-30T13:55:09.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcb7406ac30 msgr2=0x7fcb7406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcb7406ac30 0x7fcb7406d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb94160f80 tx=0x7fcb8c009040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f064ed9d640 1 -- 172.21.15.62:0/151370506 reap_dead start 2023-09-30T13:55:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 shutdown_connections 2023-09-30T13:55:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 >> 172.21.15.62:0/151370506 conn(0x7f065006d240 msgr2=0x7f06500cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 msgr2=0x7fcb9415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb98933640 1 --2- 172.21.15.62:0/3819762566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb940c16c0 0x7fcb9415ff00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb840098c0 tx=0x7fcb840046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7fcb92d9d640 1 -- 172.21.15.62:0/3819762566 reap_dead start 2023-09-30T13:55:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 shutdown_connections 2023-09-30T13:55:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.098+0000 7f063cff9640 1 -- 172.21.15.62:0/151370506 wait complete. 2023-09-30T13:55:09.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.099+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 shutdown_connections 2023-09-30T13:55:09.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.099+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 >> 172.21.15.62:0/3819762566 conn(0x7fcb940afec0 msgr2=0x7fcb940cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.099+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 shutdown_connections 2023-09-30T13:55:09.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.100+0000 7fcb98933640 1 -- 172.21.15.62:0/3819762566 wait complete. 2023-09-30T13:55:09.195 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T13:55:09.196 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.197 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T13:55:09.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T13:55:09.199 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T13:55:09.200 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T13:55:09.201 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T13:55:09.202 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T13:55:09.203 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:09.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T13:55:09.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.418+0000 7f5d332bb640 1 Processor -- start 2023-09-30T13:55:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.418+0000 7f5d332bb640 1 -- start start 2023-09-30T13:55:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.419+0000 7f5d332bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d2c158a20 0x7f5d2c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.419+0000 7f5d332bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.419+0000 7f5d332bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0c9430 con 0x7f5d2c0cba50 2023-09-30T13:55:09.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.419+0000 7f5d332bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c9710 con 0x7f5d2c158a20 2023-09-30T13:55:09.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.419+0000 7f5d332bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c99f0 con 0x7f5d2c06d980 2023-09-30T13:55:09.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f38f31c0640 1 Processor -- start 2023-09-30T13:55:09.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f38f31c0640 1 -- start start 2023-09-30T13:55:09.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f5d30856640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f5d30856640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38256/0 (socket says 172.21.15.62:38256) 2023-09-30T13:55:09.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f5d30856640 1 -- 172.21.15.62:0/458105459 learned_addr learned my addr 172.21.15.62:0/458105459 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f5d31858640 1 --1- 172.21.15.62:0/458105459 >> v1:172.21.15.62:6789/0 conn(0x7f5d2c0cba50 0x7f5d2c15c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45884/0 (socket says 172.21.15.62:45884) 2023-09-30T13:55:09.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.420+0000 7f5d31057640 1 --2- 172.21.15.62:0/458105459 >> v2:172.21.15.135:3300/0 conn(0x7f5d2c158a20 0x7f5d2c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f59d11ee640 1 Processor -- start 2023-09-30T13:55:09.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f59d11ee640 1 -- start start 2023-09-30T13:55:09.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f5d30856640 1 -- 172.21.15.62:0/458105459 >> v2:172.21.15.135:3300/0 conn(0x7f5d2c158a20 msgr2=0x7f5d2c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f5d30856640 1 --2- 172.21.15.62:0/458105459 >> v2:172.21.15.135:3300/0 conn(0x7f5d2c158a20 0x7f5d2c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f5d30856640 1 -- 172.21.15.62:0/458105459 >> v1:172.21.15.62:6789/0 conn(0x7f5d2c0cba50 legacy=0x7f5d2c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f5d30856640 1 -- 172.21.15.62:0/458105459 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0c9cd0 con 0x7f5d2c06d980 2023-09-30T13:55:09.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.421+0000 7f5cb359e640 1 Processor -- start 2023-09-30T13:55:09.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38f31c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f38ec06d980 0x7f38ec0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38f31c0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0c9430 con 0x7f38ec0b04a0 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38f31c0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0c9710 con 0x7f38ec158a20 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38f31c0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec0b0950 con 0x7f38ec06d980 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38ebfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f38ec06d980 0x7f38ec0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38ebfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f38ec06d980 0x7f38ec0aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42748/0 (socket says 172.21.15.62:42748) 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38ebfff640 1 -- 172.21.15.62:0/2796831525 learned_addr learned my addr 172.21.15.62:0/2796831525 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59d11ee640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc160e50 0x7f59cc0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59d11ee640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59cc161230 0x7f59cc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59d11ee640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc0cc990 con 0x7f59cc0cc1d0 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59d11ee640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0ccc70 con 0x7f59cc161230 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59d11ee640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0ccf50 con 0x7f59cc160e50 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38ebfff640 1 -- 172.21.15.62:0/2796831525 >> v1:172.21.15.135:6789/0 conn(0x7f38ec158a20 legacy=0x7f38ec0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f38ebfff640 1 -- 172.21.15.62:0/2796831525 >> v1:172.21.15.62:6789/0 conn(0x7f38ec0b04a0 legacy=0x7f38ec0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f5cb359e640 1 -- start start 2023-09-30T13:55:09.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f5d30856640 1 --2- 172.21.15.62:0/458105459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009e50 tx=0x7f5d2402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae86556f30a9677 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7fb19edcc640 1 Processor -- start 2023-09-30T13:55:09.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.422+0000 7f59ca59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59cc161230 0x7f59cc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f59cc161230 0x7f59cc0cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39312/0 (socket says 172.21.15.62:39312) 2023-09-30T13:55:09.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 -- 172.21.15.62:0/4030936036 learned_addr learned my addr 172.21.15.62:0/4030936036 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59cad9d640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc160e50 0x7f59cc0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 -- 172.21.15.62:0/4030936036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc160e50 msgr2=0x7f59cc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc160e50 0x7f59cc0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7fb19edcc640 1 -- start start 2023-09-30T13:55:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f717a127640 1 Processor -- start 2023-09-30T13:55:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 -- 172.21.15.62:0/4030936036 >> v1:172.21.15.135:6789/0 conn(0x7f59cc0cc1d0 legacy=0x7f59cc0c9220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T13:55:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f59ca59c640 1 -- 172.21.15.62:0/4030936036 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0cd230 con 0x7f59cc161230 2023-09-30T13:55:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f5d23fff640 1 -- 172.21.15.62:0/458105459 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2402cb00 con 0x7f5d2c06d980 2023-09-30T13:55:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f5d23fff640 1 -- 172.21.15.62:0/458105459 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2402cc60 con 0x7f5d2c06d980 2023-09-30T13:55:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f5d23fff640 1 -- 172.21.15.62:0/458105459 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240343f0 con 0x7f5d2c06d980 2023-09-30T13:55:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f38ebfff640 1 -- 172.21.15.62:0/2796831525 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0c99f0 con 0x7f38ec06d980 2023-09-30T13:55:09.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.423+0000 7f717a127640 1 -- start start 2023-09-30T13:55:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5cb359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7fb19edcc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1980adfe0 0x7fb19806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7fb19edcc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19806a460 con 0x7fb198065a20 2023-09-30T13:55:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5d332bb640 1 -- 172.21.15.62:0/458105459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 msgr2=0x7f5d2c0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5d332bb640 1 --2- 172.21.15.62:0/458105459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009e50 tx=0x7f5d2402bf60 comp rx=0 tx=0).stop 2023-09-30T13:55:09.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5cb259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f59ca59c640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc161230 0x7f59cc0cda30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009870 tx=0x7f59c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdc66717e25692 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5cb359e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5cb40cfb50 0x7f5cb40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7f5cb259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38274/0 (socket says 172.21.15.62:38274) 2023-09-30T13:55:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb259c640 1 -- 172.21.15.62:0/561884496 learned_addr learned my addr 172.21.15.62:0/561884496 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb415ce60 con 0x7f5cb40d2260 2023-09-30T13:55:09.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f717a127640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f717a127640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f716c006690 0x7f716c0380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 -- 172.21.15.62:0/458105459 shutdown_connections 2023-09-30T13:55:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 --2- 172.21.15.62:0/458105459 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c06d980 0x7f5d2c0aff60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 --2- 172.21.15.62:0/458105459 >> v2:172.21.15.135:3300/0 conn(0x7f5d2c158a20 0x7f5d2c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 -- 172.21.15.62:0/458105459 >> 172.21.15.62:0/458105459 conn(0x7f5d2c0caf60 msgr2=0x7f5d2c0cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb40d18c0 con 0x7f5cb40cfb50 2023-09-30T13:55:09.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40d09d0 con 0x7f5cb415ca80 2023-09-30T13:55:09.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f717a127640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c057010 con 0x7f716c038610 2023-09-30T13:55:09.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 -- 172.21.15.62:0/458105459 shutdown_connections 2023-09-30T13:55:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7fb19edcc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19806e240 con 0x7fb1980ce0f0 2023-09-30T13:55:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.424+0000 7fb19edcc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb198065eb0 con 0x7fb1980adfe0 2023-09-30T13:55:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb19cb68640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb1980ce0f0 0x7fb1980ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50272/0 (socket says 172.21.15.62:50272) 2023-09-30T13:55:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb19cb68640 1 -- 172.21.15.62:0/1205657948 learned_addr learned my addr 172.21.15.62:0/1205657948 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb19d369640 1 --2- 172.21.15.62:0/1205657948 >> v2:172.21.15.62:3300/0 conn(0x7fb1980adfe0 0x7fb19806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f717a127640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c058e80 con 0x7f716c006690 2023-09-30T13:55:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f7179125640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f717a127640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c056ce0 con 0x7f716c0de3c0 2023-09-30T13:55:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f7179125640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38282/0 (socket says 172.21.15.62:38282) 2023-09-30T13:55:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f7179125640 1 -- 172.21.15.62:0/1485462278 learned_addr learned my addr 172.21.15.62:0/1485462278 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f907bc02640 1 Processor -- start 2023-09-30T13:55:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f38ebfff640 1 --2- 172.21.15.62:0/2796831525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec06d980 0x7f38ec0aff60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38e0007390 tx=0x7f38e002c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94a161f30bc80d3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808797231 0 0) 0x7fb19806e240 con 0x7fb1980ce0f0 2023-09-30T13:55:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184003520 con 0x7fb1980ce0f0 2023-09-30T13:55:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f907bc02640 1 -- start start 2023-09-30T13:55:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f38eb7fe640 1 -- 172.21.15.62:0/2796831525 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0008df0 con 0x7f38ec06d980 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5d332bb640 1 -- 172.21.15.62:0/458105459 wait complete. 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550378836 0 0) 0x7fb184003520 con 0x7fb1980ce0f0 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 >> v2:172.21.15.62:3300/0 conn(0x7fb1980adfe0 msgr2=0x7fb19806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 --2- 172.21.15.62:0/1205657948 >> v2:172.21.15.62:3300/0 conn(0x7fb1980adfe0 0x7fb19806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 >> v1:172.21.15.62:6789/0 conn(0x7fb198065a20 legacy=0x7fb198069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19806dc80 con 0x7fb1980ce0f0 2023-09-30T13:55:09.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb1880019f0 con 0x7fb1980ce0f0 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 >> v1:172.21.15.135:6789/0 conn(0x7fb1980ce0f0 legacy=0x7fb1980ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb184003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1840047c0 0x7fb184004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb184005380 0x7fb18400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198065eb0 con 0x7fb1840047c0 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400c240 con 0x7fb184005380 2023-09-30T13:55:09.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400c400 con 0x7fb1840039c0 2023-09-30T13:55:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f7179125640 1 -- 172.21.15.62:0/1485462278 >> v2:172.21.15.62:3300/0 conn(0x7f716c006690 msgr2=0x7f716c0380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f7179125640 1 --2- 172.21.15.62:0/1485462278 >> v2:172.21.15.62:3300/0 conn(0x7f716c006690 0x7f716c0380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f7179125640 1 -- 172.21.15.62:0/1485462278 >> v1:172.21.15.62:6789/0 conn(0x7f716c038610 legacy=0x7f716c0eb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f7179125640 1 -- 172.21.15.62:0/1485462278 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0588c0 con 0x7f716c0de3c0 2023-09-30T13:55:09.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb184003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f59c9d9b640 1 -- 172.21.15.62:0/4030936036 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0031640 con 0x7f59cc161230 2023-09-30T13:55:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb259c640 1 -- 172.21.15.62:0/561884496 >> v2:172.21.15.62:3300/0 conn(0x7f5cb40cfb50 msgr2=0x7f5cb40b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb259c640 1 --2- 172.21.15.62:0/561884496 >> v2:172.21.15.62:3300/0 conn(0x7f5cb40cfb50 0x7f5cb40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb259c640 1 -- 172.21.15.62:0/561884496 >> v1:172.21.15.62:6789/0 conn(0x7f5cb40d2260 legacy=0x7f5cb40cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f5cb259c640 1 -- 172.21.15.62:0/561884496 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40d26c0 con 0x7f5cb415ca80 2023-09-30T13:55:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.425+0000 7f38eb7fe640 1 -- 172.21.15.62:0/2796831525 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e000a0d0 con 0x7f38ec06d980 2023-09-30T13:55:09.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 -- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb184005380 msgr2=0x7fb18400b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T13:55:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb184005380 0x7fb18400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 -- 172.21.15.62:0/1205657948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1840047c0 msgr2=0x7fb184004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T13:55:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1840047c0 0x7fb184004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7fb19cb68640 1 -- 172.21.15.62:0/1205657948 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184003520 con 0x7fb1840039c0 2023-09-30T13:55:09.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f59c9d9b640 1 -- 172.21.15.62:0/4030936036 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c00317a0 con 0x7f59cc161230 2023-09-30T13:55:09.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.426+0000 7f59c9d9b640 1 -- 172.21.15.62:0/4030936036 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0031b30 con 0x7f59cc161230 2023-09-30T13:55:09.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907bc02640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f907406e540 0x7f90740cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907999e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f907406e540 0x7f90740cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907999e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f907406e540 0x7f90740cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42760/0 (socket says 172.21.15.62:42760) 2023-09-30T13:55:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907919d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f90741597c0 0x7f907406e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50282/0 (socket says 172.21.15.62:50282) 2023-09-30T13:55:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907999e640 1 -- 172.21.15.62:0/249289381 learned_addr learned my addr 172.21.15.62:0/249289381 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f38eb7fe640 1 -- 172.21.15.62:0/2796831525 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e000a460 con 0x7f38ec06d980 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5d332bb640 1 Processor -- start 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5d332bb640 1 -- start start 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5cb259c640 1 --2- 172.21.15.62:0/561884496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009e50 tx=0x7f5cac02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca916211f338ef7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5cb159a640 1 -- 172.21.15.62:0/561884496 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac02ca80 con 0x7f5cb415ca80 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5cb159a640 1 -- 172.21.15.62:0/561884496 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac02cbe0 con 0x7f5cb415ca80 2023-09-30T13:55:09.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f5cb159a640 1 -- 172.21.15.62:0/561884496 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0343f0 con 0x7f5cb415ca80 2023-09-30T13:55:09.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7fb19d369640 1 -- 172.21.15.62:0/1205657948 reap_dead start 2023-09-30T13:55:09.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f7179125640 1 --2- 172.21.15.62:0/1485462278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f717002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a4a3d1a16e4628 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f716bfff640 1 -- 172.21.15.62:0/1485462278 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170030840 con 0x7f716c0de3c0 2023-09-30T13:55:09.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f716bfff640 1 -- 172.21.15.62:0/1485462278 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71700309a0 con 0x7f716c0de3c0 2023-09-30T13:55:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f716bfff640 1 -- 172.21.15.62:0/1485462278 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170030d30 con 0x7f716c0de3c0 2023-09-30T13:55:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740cdd80 con 0x7f907406f310 2023-09-30T13:55:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 -- 172.21.15.62:0/2796831525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec06d980 msgr2=0x7f38ec0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f59d11ee640 1 -- 172.21.15.62:0/4030936036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc161230 msgr2=0x7f59cc0cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc161230 0x7f59cc0cda30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009870 tx=0x7f59c002b8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 --2- 172.21.15.62:0/2796831525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec06d980 0x7f38ec0aff60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38e0007390 tx=0x7f38e002c980 comp rx=0 tx=0).stop 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 -- 172.21.15.62:0/2796831525 shutdown_connections 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 --2- 172.21.15.62:0/2796831525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec06d980 0x7f38ec0aff60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 -- 172.21.15.62:0/2796831525 >> 172.21.15.62:0/2796831525 conn(0x7f38ec0caf60 msgr2=0x7f38ec0cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.427+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740ccc30 con 0x7f90741597c0 2023-09-30T13:55:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940238613 0 0) 0x7f90740cdd80 con 0x7f907406f310 2023-09-30T13:55:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740cd4e0 con 0x7f907406e540 2023-09-30T13:55:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb184003dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a7b0 tx=0x7fb1840057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465d8d14363d528e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060003520 con 0x7f907406f310 2023-09-30T13:55:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 -- 172.21.15.62:0/2796831525 shutdown_connections 2023-09-30T13:55:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f38f31c0640 1 -- 172.21.15.62:0/2796831525 wait complete. 2023-09-30T13:55:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188034630 con 0x7fb1840039c0 2023-09-30T13:55:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18802f070 con 0x7fb1840039c0 2023-09-30T13:55:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7fb1977fe640 1 -- 172.21.15.62:0/1205657948 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188034630 con 0x7fb1840039c0 2023-09-30T13:55:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f717a127640 1 -- 172.21.15.62:0/1485462278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 msgr2=0x7f716c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910033413 0 0) 0x7f9060003520 con 0x7f907406f310 2023-09-30T13:55:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 >> v2:172.21.15.135:3300/0 conn(0x7f907406e540 msgr2=0x7f90740cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 --2- 172.21.15.62:0/249289381 >> v2:172.21.15.135:3300/0 conn(0x7f907406e540 0x7f90740cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 >> v1:172.21.15.135:6789/0 conn(0x7f90741597c0 legacy=0x7f907406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740cd7c0 con 0x7f907406f310 2023-09-30T13:55:09.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f5d332bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 0x7f5d2c144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f717a127640 1 --2- 172.21.15.62:0/1485462278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f717002b980 comp rx=0 tx=0).stop 2023-09-30T13:55:09.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f9070001670 con 0x7f907406f310 2023-09-30T13:55:09.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 >> v1:172.21.15.62:6789/0 conn(0x7f907406f310 legacy=0x7f907415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 msgr2=0x7f5cb40d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f5cb359e640 1 --2- 172.21.15.62:0/561884496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009e50 tx=0x7f5cac02bee0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 0x7f9060003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90600047c0 0x7f9060004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90600052a0 0x7f906000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740cd4e0 con 0x7f90600047c0 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906000e380 con 0x7f9060003970 2023-09-30T13:55:09.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906000e540 con 0x7f90600052a0 2023-09-30T13:55:09.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.428+0000 7f5d332bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 0x7f5d2c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d332bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 0x7f5d2c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f717a127640 1 -- 172.21.15.62:0/1485462278 shutdown_connections 2023-09-30T13:55:09.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f717a127640 1 --2- 172.21.15.62:0/1485462278 >> v2:172.21.15.62:3300/0 conn(0x7f716c006690 0x7f716c0380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f717a127640 1 --2- 172.21.15.62:0/1485462278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c006150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d332bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c146c20 con 0x7f5d2c158a20 2023-09-30T13:55:09.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f717a127640 1 -- 172.21.15.62:0/1485462278 >> 172.21.15.62:0/1485462278 conn(0x7f716c055a80 msgr2=0x7f716c055e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d332bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c14c140 con 0x7f5d2c06d980 2023-09-30T13:55:09.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 shutdown_connections 2023-09-30T13:55:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 --2- 172.21.15.62:0/561884496 >> v2:172.21.15.62:3300/0 conn(0x7f5cb40cfb50 0x7f5cb40b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d332bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c14b530 con 0x7f5d2c0cba50 2023-09-30T13:55:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 --2- 172.21.15.62:0/561884496 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb415ca80 0x7f5cb40d1d20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 >> 172.21.15.62:0/561884496 conn(0x7f5cb406af30 msgr2=0x7f5cb406b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907999e640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 0x7f9060003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907919d640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90600047c0 0x7f9060004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d31057640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 0x7f5d2c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d31057640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 0x7f5d2c144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42768/0 (socket says 172.21.15.62:42768) 2023-09-30T13:55:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d31057640 1 -- 172.21.15.62:0/314715201 learned_addr learned my addr 172.21.15.62:0/314715201 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907a19f640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90600052a0 0x7f906000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 shutdown_connections 2023-09-30T13:55:09.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7fb19edcc640 1 -- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 msgr2=0x7fb184003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb184003dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a7b0 tx=0x7fb1840057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f59d11ee640 1 -- 172.21.15.62:0/4030936036 shutdown_connections 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc161230 0x7f59cc0cda30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4030936036 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc160e50 0x7f59cc0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f59d11ee640 1 -- 172.21.15.62:0/4030936036 >> 172.21.15.62:0/4030936036 conn(0x7f59cc06a430 msgr2=0x7f59cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5cb359e640 1 -- 172.21.15.62:0/561884496 wait complete. 2023-09-30T13:55:09.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7fb19edcc640 1 -- 172.21.15.62:0/1205657948 shutdown_connections 2023-09-30T13:55:09.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1205657948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb184003dc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7fb19edcc640 1 -- 172.21.15.62:0/1205657948 >> 172.21.15.62:0/1205657948 conn(0x7fb1980b0850 msgr2=0x7fb1980b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907999e640 1 -- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90600052a0 msgr2=0x7f906000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907999e640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90600052a0 0x7f906000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f907999e640 1 -- 172.21.15.62:0/249289381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90600047c0 msgr2=0x7f9060004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f907999e640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90600047c0 0x7f9060004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f907999e640 1 -- 172.21.15.62:0/249289381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740cd7c0 con 0x7f9060003970 2023-09-30T13:55:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f59d11ee640 1 -- 172.21.15.62:0/4030936036 shutdown_connections 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d31858640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 0x7f5d2c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.429+0000 7f5d30856640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 0x7f5d2c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 -- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 msgr2=0x7f5d2c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 0x7f5d2c144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 -- 172.21.15.62:0/314715201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 msgr2=0x7f5d2c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 0x7f5d2c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 -- 172.21.15.62:0/314715201 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009b30 con 0x7f5d2c0cba50 2023-09-30T13:55:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f907a19f640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90600052a0 0x7f906000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d31858640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 0x7f5d2c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f907919d640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90600047c0 0x7f9060004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f907a19f640 1 -- 172.21.15.62:0/249289381 reap_dead start 2023-09-30T13:55:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d30856640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 0x7f5d2c0b1330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d24032000 tx=0x7f5d24004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7efda18cf640 1 Processor -- start 2023-09-30T13:55:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f59d11ee640 1 -- 172.21.15.62:0/4030936036 wait complete. 2023-09-30T13:55:09.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7efda18cf640 1 -- start start 2023-09-30T13:55:09.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f38f31c0640 1 Processor -- start 2023-09-30T13:55:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2403e450 con 0x7f5d2c0cba50 2023-09-30T13:55:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2403e5b0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2403e960 con 0x7f5d2c0cba50 2023-09-30T13:55:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f38f31c0640 1 -- start start 2023-09-30T13:55:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f717a127640 1 -- 172.21.15.62:0/1485462278 shutdown_connections 2023-09-30T13:55:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.430+0000 7f717a127640 1 -- 172.21.15.62:0/1485462278 wait complete. 2023-09-30T13:55:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.431+0000 7fb19edcc640 1 -- 172.21.15.62:0/1205657948 shutdown_connections 2023-09-30T13:55:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.431+0000 7f5d332bb640 1 -- 172.21.15.62:0/314715201 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c14b810 con 0x7f5d2c0cba50 2023-09-30T13:55:09.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.431+0000 7fb19edcc640 1 -- 172.21.15.62:0/1205657948 wait complete. 2023-09-30T13:55:09.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f5d332bb640 1 -- 172.21.15.62:0/314715201 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c14bdd0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f907999e640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 0x7f9060003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90640098a0 tx=0x7f90600057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1451c3f236e81218 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efda18cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c160160 0x7efd9c0d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.431+0000 7f5cb359e640 1 Processor -- start 2023-09-30T13:55:09.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.431+0000 7f5cb359e640 1 -- start start 2023-09-30T13:55:09.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efda18cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9c0d3600 0x7efd9c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efda18cf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c0cda60 con 0x7efd9c0b5cd0 2023-09-30T13:55:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efda18cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0d18a0 con 0x7efd9c0d3600 2023-09-30T13:55:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efda18cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c160540 con 0x7efd9c160160 2023-09-30T13:55:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f59d11ee640 1 Processor -- start 2023-09-30T13:55:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064030630 con 0x7f9060003970 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064030790 con 0x7f9060003970 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd9a7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9c0d3600 0x7efd9c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd9b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efd9c0b5cd0 0x7efd9c0cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45948/0 (socket says 172.21.15.62:45948) 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd9b7fe640 1 -- 172.21.15.62:0/578579583 learned_addr learned my addr 172.21.15.62:0/578579583 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd9affd640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c160160 0x7efd9c0d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f907899c640 1 -- 172.21.15.62:0/249289381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064030b20 con 0x7f9060003970 2023-09-30T13:55:09.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f59d11ee640 1 -- start start 2023-09-30T13:55:09.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7f5cb359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd99ffb640 1 -- 172.21.15.62:0/578579583 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434388619 0 0) 0x7efd9c0cda60 con 0x7efd9c0b5cd0 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.432+0000 7efd99ffb640 1 -- 172.21.15.62:0/578579583 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd84003520 con 0x7efd9c0b5cd0 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7efd9a7fc640 1 -- 172.21.15.62:0/578579583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c160160 msgr2=0x7efd9c0d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7efd9a7fc640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c160160 0x7efd9c0d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7efd9a7fc640 1 -- 172.21.15.62:0/578579583 >> v1:172.21.15.62:6789/0 conn(0x7efd9c0b5cd0 legacy=0x7efd9c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7efd9a7fc640 1 -- 172.21.15.62:0/578579583 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0cd450 con 0x7efd9c0d3600 2023-09-30T13:55:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7fb19edcc640 1 Processor -- start 2023-09-30T13:55:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7fb19edcc640 1 -- start start 2023-09-30T13:55:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39380/0 (socket says 172.21.15.62:39380) 2023-09-30T13:55:09.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb259c640 1 -- 172.21.15.62:0/2368335010 learned_addr learned my addr 172.21.15.62:0/2368335010 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f717a127640 1 Processor -- start 2023-09-30T13:55:09.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 0x7f5cb415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f717a127640 1 -- start start 2023-09-30T13:55:09.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 msgr2=0x7f9060003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f907bc02640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 0x7f9060003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90640098a0 tx=0x7f90600057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cb415ca80 0x7f5cb415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40caab0 con 0x7f5cb40cfb50 2023-09-30T13:55:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 shutdown_connections 2023-09-30T13:55:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f907bc02640 1 --2- 172.21.15.62:0/249289381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9060003970 0x7f9060003d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.433+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 >> 172.21.15.62:0/249289381 conn(0x7f90740cbd20 msgr2=0x7f90740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f5cb1d9b640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 0x7f5cb415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 shutdown_connections 2023-09-30T13:55:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f0f5c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f0f5c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38328/0 (socket says 172.21.15.62:38328) 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38ebfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39392/0 (socket says 172.21.15.62:39392) 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec158a20 0x7f38ec157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59d11ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0cc1d0 0x7f59cc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59d11ee640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59d11ee640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc0b2a40 0x7f59cc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59ca59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59ca59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39398/0 (socket says 172.21.15.62:39398) 2023-09-30T13:55:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f5d332bb640 1 -- 172.21.15.62:0/314715201 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c0ca5f0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59ca59c640 1 -- 172.21.15.62:0/4118211173 learned_addr learned my addr 172.21.15.62:0/4118211173 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59cad9d640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0cc1d0 0x7f59cc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f0f5c640 1 -- 172.21.15.62:0/512757454 learned_addr learned my addr 172.21.15.62:0/512757454 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1f0250 con 0x7f38ec0b04a0 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1464e0 con 0x7f38ec158a20 2023-09-30T13:55:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1467c0 con 0x7f38ec06d980 2023-09-30T13:55:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7fb19edcc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59cb59e640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc0b2a40 0x7f59cc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b1460 con 0x7f59cc160e50 2023-09-30T13:55:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b1740 con 0x7f59cc0cc1d0 2023-09-30T13:55:09.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f38f175d640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec158a20 0x7f38ec157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19edcc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 0x7fb1980c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19cb68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7efd9a7fc640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c0b5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd900097a0 tx=0x7efd9002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a1bc86dc40510 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19cb68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38346/0 (socket says 172.21.15.62:38346) 2023-09-30T13:55:09.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19cb68640 1 -- 172.21.15.62:0/1598440744 learned_addr learned my addr 172.21.15.62:0/1598440744 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40cb070 con 0x7f5cb415ca80 2023-09-30T13:55:09.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.434+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb4159920 con 0x7f5cb40d2260 2023-09-30T13:55:09.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b1a20 con 0x7f59cc0b2a40 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 -- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec158a20 msgr2=0x7f38ec157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec158a20 0x7f38ec157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 -- 172.21.15.62:0/512757454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 msgr2=0x7f38ec157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0007040 con 0x7f38ec06d980 2023-09-30T13:55:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 0x7fb1980aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38ebfff640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5d2403eac0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 0x7f716c04e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f716c038610 0x7f716c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c04b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c04d570 con 0x7f716c038610 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0cef90 con 0x7f716c006690 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f717a127640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c04ecd0 con 0x7f716c0de3c0 2023-09-30T13:55:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb197fff640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 0x7fb1980c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f7179125640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 0x7f716c04e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19815e380 con 0x7fb1981fa5a0 2023-09-30T13:55:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f7179125640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 0x7f716c04e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42802/0 (socket says 172.21.15.62:42802) 2023-09-30T13:55:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19d369640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 0x7fb1980aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f7179125640 1 -- 172.21.15.62:0/2004556361 learned_addr learned my addr 172.21.15.62:0/2004556361 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f7179926640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c04b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb2d9d640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cb415ca80 0x7f5cb415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f38f0f5c640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c760 tx=0x7f38e400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980af0d0 con 0x7fb1980ae710 2023-09-30T13:55:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c3410 con 0x7fb1840039c0 2023-09-30T13:55:09.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7efd99ffb640 1 -- 172.21.15.62:0/578579583 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90030610 con 0x7efd9c0d3600 2023-09-30T13:55:09.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f7178924640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f716c038610 0x7f716c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7efd99ffb640 1 -- 172.21.15.62:0/578579583 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90030770 con 0x7efd9c0d3600 2023-09-30T13:55:09.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5d21ffb640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 0x7f5d1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d240ac010 con 0x7f5d2c0cba50 2023-09-30T13:55:09.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19cb68640 1 -- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 msgr2=0x7fb1980aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 -- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 msgr2=0x7f716c04e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 0x7f716c04e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 -- 172.21.15.62:0/2004556361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f716c038610 msgr2=0x7f716c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f716c038610 0x7f716c0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 -- 172.21.15.62:0/2004556361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700094d0 con 0x7f716c0de3c0 2023-09-30T13:55:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f907bc02640 1 -- 172.21.15.62:0/249289381 wait complete. 2023-09-30T13:55:09.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb259c640 1 -- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 msgr2=0x7f5cb415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 0x7fb1980aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19cb68640 1 -- 172.21.15.62:0/1598440744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 msgr2=0x7fb1980c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 0x7fb1980c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19cb68640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980b2d90 con 0x7fb1840039c0 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f7179926640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c04b4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7174069670 tx=0x7f7174072520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb259c640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 0x7f5cb415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb259c640 1 -- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cb415ca80 msgr2=0x7f5cb415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb259c640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cb415ca80 0x7f5cb415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7f5cb259c640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac009b30 con 0x7f5cb40cfb50 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f5cb259c640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009e50 tx=0x7f5cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f59ca59c640 1 -- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc0b2a40 msgr2=0x7f59cc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f59ca59c640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc0b2a40 0x7f59cc0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f59ca59c640 1 -- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0cc1d0 msgr2=0x7f59cc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f59ca59c640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0cc1d0 0x7f59cc1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f59ca59c640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00094d0 con 0x7f59cc160e50 2023-09-30T13:55:09.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f5cb1d9b640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 0x7f5cb415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb19d369640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 0x7fb1980aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7fb197fff640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 0x7fb1980c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.435+0000 7efd99ffb640 1 -- 172.21.15.62:0/578579583 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90030b00 con 0x7efd9c0d3600 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 -- 172.21.15.62:0/578579583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 msgr2=0x7efd9c0b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c0b5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd900097a0 tx=0x7efd9002b960 comp rx=0 tx=0).stop 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 -- 172.21.15.62:0/578579583 shutdown_connections 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c0b5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 --2- 172.21.15.62:0/578579583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c160160 0x7efd9c0d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7efda18cf640 1 -- 172.21.15.62:0/578579583 >> 172.21.15.62:0/578579583 conn(0x7efd9c089fe0 msgr2=0x7efd9c0d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac03e660 con 0x7f5cb40cfb50 2023-09-30T13:55:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.436+0000 7f5d31057640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 0x7f5d1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac03e800 con 0x7f5cb40cfb50 2023-09-30T13:55:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac03ebb0 con 0x7f5cb40cfb50 2023-09-30T13:55:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7fb19cb68640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a8d0 tx=0x7fb188001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f59ca59c640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59c00090b0 tx=0x7f59c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7efda18cf640 1 -- 172.21.15.62:0/578579583 shutdown_connections 2023-09-30T13:55:09.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7efda18cf640 1 -- 172.21.15.62:0/578579583 wait complete. 2023-09-30T13:55:09.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb4159c00 con 0x7f5cb40cfb50 2023-09-30T13:55:09.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb4158750 con 0x7f5cb40cfb50 2023-09-30T13:55:09.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f5d31057640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 0x7f5d1006d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c14c740 tx=0x7f5d28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.437+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c003a9f0 con 0x7f59cc160e50 2023-09-30T13:55:09.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc0cb8d0 con 0x7f59cc160e50 2023-09-30T13:55:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc0b1fe0 con 0x7f59cc160e50 2023-09-30T13:55:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c003ab70 con 0x7f59cc160e50 2023-09-30T13:55:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00443f0 con 0x7f59cc160e50 2023-09-30T13:55:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f907bc02640 1 Processor -- start 2023-09-30T13:55:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f907bc02640 1 -- start start 2023-09-30T13:55:09.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.438+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb404e920 con 0x7f5cb40cfb50 2023-09-30T13:55:09.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5cac02cd50 con 0x7f5cb40cfb50 2023-09-30T13:55:09.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f5ca2ffd640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 0x7f5c9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7efda18cf640 1 Processor -- start 2023-09-30T13:55:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f907bc02640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 0x7f90740b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5cac0ac280 con 0x7f5cb40cfb50 2023-09-30T13:55:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f5cb1d9b640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 0x7f5c9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7efda18cf640 1 -- start start 2023-09-30T13:55:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f907bc02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 0x7f9074069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f907bc02640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 0x7f9074156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f907999e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 0x7f90740b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.439+0000 7f907999e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 0x7f90740b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38366/0 (socket says 172.21.15.62:38366) 2023-09-30T13:55:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907919d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 0x7f9074069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907919d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 0x7f9074069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42820/0 (socket says 172.21.15.62:42820) 2023-09-30T13:55:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907999e640 1 -- 172.21.15.62:0/3511041884 learned_addr learned my addr 172.21.15.62:0/3511041884 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 0x7f9074156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90741f0bf0 con 0x7f90741561d0 2023-09-30T13:55:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc0b1b60 con 0x7f59cc160e50 2023-09-30T13:55:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b4ef0 con 0x7f907415bce0 2023-09-30T13:55:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b42e0 con 0x7f9060003970 2023-09-30T13:55:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f5cb1d9b640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 0x7f5c9406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40cd8f0 tx=0x7f5ca4007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 -- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 msgr2=0x7f90740b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 0x7f90740b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 -- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 msgr2=0x7f9074069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 0x7f9074069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f907a19f640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740b45c0 con 0x7f90741561d0 2023-09-30T13:55:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7efda18cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c0b5cd0 0x7efd9c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efda18cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5d240dead0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4003b70 con 0x7f38ec06d980 2023-09-30T13:55:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4003cf0 con 0x7f38ec06d980 2023-09-30T13:55:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400aa90 con 0x7f38ec06d980 2023-09-30T13:55:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec146aa0 con 0x7f38ec06d980 2023-09-30T13:55:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.440+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188034630 con 0x7fb1840039c0 2023-09-30T13:55:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec147060 con 0x7f38ec06d980 2023-09-30T13:55:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efda18cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c160160 0x7efd9c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188034ae0 con 0x7fb1840039c0 2023-09-30T13:55:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efda18cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1f34c0 con 0x7efd9c0d3600 2023-09-30T13:55:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1980b3070 con 0x7fb1840039c0 2023-09-30T13:55:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efda18cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c09c700 con 0x7efd9c160160 2023-09-30T13:55:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efd9a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efda18cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c15b430 con 0x7efd9c0b5cd0 2023-09-30T13:55:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efd9a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39418/0 (socket says 172.21.15.62:39418) 2023-09-30T13:55:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efd9a7fc640 1 -- 172.21.15.62:0/1395238296 learned_addr learned my addr 172.21.15.62:0/1395238296 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f59c002f050 con 0x7f59cc160e50 2023-09-30T13:55:09.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1980b3630 con 0x7fb1840039c0 2023-09-30T13:55:09.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188034e50 con 0x7fb1840039c0 2023-09-30T13:55:09.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.442+0000 7f59b37fe640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 0x7f59b806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.442+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59c00ab130 con 0x7f59cc160e50 2023-09-30T13:55:09.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740728e0 con 0x7f716c0de3c0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174072a40 con 0x7f716c0de3c0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.442+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174072e10 con 0x7f716c0de3c0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.442+0000 7f717a127640 1 -- 172.21.15.62:0/2004556361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c04cbd0 con 0x7f716c0de3c0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.442+0000 7f717a127640 1 -- 172.21.15.62:0/2004556361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c04d190 con 0x7f716c0de3c0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7efd9affd640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c0b5cd0 0x7efd9c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.441+0000 7f907a19f640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 0x7f9074156650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90740cdf50 tx=0x7f907000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc005250 con 0x7f38ec06d980 2023-09-30T13:55:09.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 -- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c0b5cd0 msgr2=0x7efd9c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c0b5cd0 0x7efd9c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 -- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c160160 msgr2=0x7efd9c15aef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T13:55:09.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c160160 0x7efd9c15aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 -- 172.21.15.62:0/1395238296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009400 con 0x7efd9c0d3600 2023-09-30T13:55:09.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7f59cad9d640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 0x7f59b806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19815e4c0 con 0x7fb1840039c0 2023-09-30T13:55:09.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7efd9a7fc640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd900098c0 tx=0x7efd900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb188031030 con 0x7fb1840039c0 2023-09-30T13:55:09.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f38e400abf0 con 0x7f38ec06d980 2023-09-30T13:55:09.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7f59cad9d640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 0x7f59b806cff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009b40 tx=0x7f59bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7fb1957fa640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 0x7fb17806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.443+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c04d6b0 con 0x7f716c0de3c0 2023-09-30T13:55:09.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1880ab880 con 0x7fb1840039c0 2023-09-30T13:55:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7fb197fff640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 0x7fb17806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7f38e97fa640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 0x7f38d806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38e40892c0 con 0x7f38ec06d980 2023-09-30T13:55:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f717408f070 con 0x7f716c0de3c0 2023-09-30T13:55:09.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.444+0000 7f38ebfff640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 0x7f38d806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7fb197fff640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 0x7fb17806d070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb19815bb40 tx=0x7fb180009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7f7169ffb640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 0x7f715806d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7f38ebfff640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 0x7f38d806cff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38e0036000 tx=0x7f38e000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71741024f0 con 0x7f716c0de3c0 2023-09-30T13:55:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7f7179125640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 0x7f715806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.445+0000 7f7179125640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 0x7f715806d040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f717002b9c0 tx=0x7f7170008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.446+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5cac077370 con 0x7f5cb40cfb50 2023-09-30T13:55:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.448+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb19815e4c0 con 0x7fb1840039c0 2023-09-30T13:55:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.452+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f38e4054180 con 0x7f38ec06d980 2023-09-30T13:55:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070005270 con 0x7f90741561d0 2023-09-30T13:55:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070005410 con 0x7f90741561d0 2023-09-30T13:55:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000b8c0 con 0x7f90741561d0 2023-09-30T13:55:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f59cc0b1b60 con 0x7f59cc160e50 2023-09-30T13:55:09.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9003e070 con 0x7efd9c0d3600 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90039990 con 0x7efd9c0d3600 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c15d320 con 0x7efd9c0d3600 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.454+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90039d40 con 0x7efd9c0d3600 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.456+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c15d8e0 con 0x7efd9c0d3600 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.457+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740b48a0 con 0x7f90741561d0 2023-09-30T13:55:09.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.457+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c09c890 con 0x7efd9c0d3600 2023-09-30T13:55:09.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.457+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9074156b90 con 0x7f90741561d0 2023-09-30T13:55:09.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.458+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f716c04d6b0 con 0x7f716c0de3c0 2023-09-30T13:55:09.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.459+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f907000ba20 con 0x7f90741561d0 2023-09-30T13:55:09.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.460+0000 7f906a7fc640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 0x7f905806d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.460+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9070057950 con 0x7f90741561d0 2023-09-30T13:55:09.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.460+0000 7f907999e640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 0x7f905806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.460+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efd9004b400 con 0x7efd9c0d3600 2023-09-30T13:55:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.460+0000 7efd83fff640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 0x7efd8806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.461+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd900ab960 con 0x7efd9c0d3600 2023-09-30T13:55:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.461+0000 7efd9affd640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 0x7efd8806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.461+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90740b5030 con 0x7f90741561d0 2023-09-30T13:55:09.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.462+0000 7f907999e640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 0x7f905806d040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9064006e00 tx=0x7f9064031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.462+0000 7efd9affd640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 0x7efd8806d020 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd940074a0 tx=0x7efd9400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:09.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.470+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efd900768b0 con 0x7efd9c0d3600 2023-09-30T13:55:09.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.479+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9070054420 con 0x7f90741561d0 2023-09-30T13:55:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.829+0000 7f5d332bb640 1 -- 172.21.15.62:0/314715201 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5d2c14c2b0 con 0x7f5d2c0cba50 2023-09-30T13:55:09.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.830+0000 7f5d21ffb640 1 -- 172.21.15.62:0/314715201 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d24077000 con 0x7f5d2c0cba50 2023-09-30T13:55:09.830 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.833+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 msgr2=0x7f5d1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.833+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 0x7f5d1006d0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c14c740 tx=0x7f5d28009190 comp rx=0 tx=0).stop 2023-09-30T13:55:09.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.833+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 msgr2=0x7f5d2c0b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.833+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 0x7f5d2c0b1330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d24032000 tx=0x7f5d24004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.833+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 shutdown_connections 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5d1006ac30 0x7f5d1006d0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d2c158a20 0x7f5d2c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d2c0cba50 0x7f5d2c0b1330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 --2- 172.21.15.62:0/314715201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d2c06d980 0x7f5d2c144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 >> 172.21.15.62:0/314715201 conn(0x7f5d2c0caf60 msgr2=0x7f5d2c0c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 shutdown_connections 2023-09-30T13:55:09.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.834+0000 7f5d0f7fe640 1 -- 172.21.15.62:0/314715201 wait complete. 2023-09-30T13:55:09.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2023-09-30T13:55:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.853+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5cb40008d0 con 0x7f5cb40cfb50 2023-09-30T13:55:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.854+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb19815e4c0 con 0x7fb1840039c0 2023-09-30T13:55:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.854+0000 7f5ca2ffd640 1 -- 172.21.15.62:0/2368335010 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5cac07a990 con 0x7f5cb40cfb50 2023-09-30T13:55:09.854 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.855+0000 7fb1957fa640 1 -- 172.21.15.62:0/1598440744 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb19815e4c0 con 0x7fb1840039c0 2023-09-30T13:55:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 msgr2=0x7f5c9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 0x7f5c9406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40cd8f0 tx=0x7f5ca4007e30 comp rx=0 tx=0).stop 2023-09-30T13:55:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 msgr2=0x7f5cb4158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009e50 tx=0x7f5cac004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 shutdown_connections 2023-09-30T13:55:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c9406ac00 0x7f5c9406d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cb415ca80 0x7f5cb415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5cb40d2260 0x7f5cb415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 --2- 172.21.15.62:0/2368335010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cb40cfb50 0x7f5cb4158210 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 >> 172.21.15.62:0/2368335010 conn(0x7f5cb406af30 msgr2=0x7f5cb40b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 shutdown_connections 2023-09-30T13:55:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.857+0000 7f5cb359e640 1 -- 172.21.15.62:0/2368335010 wait complete. 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 msgr2=0x7fb17806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 0x7fb17806d070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb19815bb40 tx=0x7fb180009040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 msgr2=0x7fb19815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a8d0 tx=0x7fb188001cb0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 shutdown_connections 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb17806abb0 0x7fb17806d070 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb19815bb40 tx=0x7fb180009040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1980ae710 0x7fb1980aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1981fa5a0 0x7fb1980c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 --2- 172.21.15.62:0/1598440744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1840039c0 0x7fb19815aed0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 >> 172.21.15.62:0/1598440744 conn(0x7fb1980b0850 msgr2=0x7fb19806cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 shutdown_connections 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.858+0000 7fb19edcc640 1 -- 172.21.15.62:0/1598440744 wait complete. 2023-09-30T13:55:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.861+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f38cc005500 con 0x7f38ec06d980 2023-09-30T13:55:09.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.862+0000 7f38e97fa640 1 -- 172.21.15.62:0/512757454 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38e4003e60 con 0x7f38ec06d980 2023-09-30T13:55:09.863 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.864+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59cc0b1b60 con 0x7f59cc160e50 2023-09-30T13:55:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 msgr2=0x7f38d806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 0x7f38d806cff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38e0036000 tx=0x7f38e000a000 comp rx=0 tx=0).stop 2023-09-30T13:55:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 msgr2=0x7f38ec1efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c760 tx=0x7f38e400cc20 comp rx=0 tx=0).stop 2023-09-30T13:55:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f59b37fe640 1 -- 172.21.15.62:0/4118211173 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59cc0b1b60 con 0x7f59cc160e50 2023-09-30T13:55:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 shutdown_connections 2023-09-30T13:55:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f38d806ab30 0x7f38d806cff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.866 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38ec158a20 0x7f38ec157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38ec0b04a0 0x7f38ec157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 --2- 172.21.15.62:0/512757454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38ec06d980 0x7f38ec1efd10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 >> 172.21.15.62:0/512757454 conn(0x7f38ec0caf60 msgr2=0x7f38ec0ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 shutdown_connections 2023-09-30T13:55:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.865+0000 7f38f31c0640 1 -- 172.21.15.62:0/512757454 wait complete. 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd9c073e70 con 0x7efd9c0d3600 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 msgr2=0x7f59b806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 0x7f59b806cff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009b40 tx=0x7f59bc009190 comp rx=0 tx=0).stop 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 msgr2=0x7f59cc0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59c00090b0 tx=0x7f59c00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 shutdown_connections 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f59b806ab30 0x7f59b806cff0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59cc0b2a40 0x7f59cc0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59cc160e50 0x7f59cc0b2500 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 --2- 172.21.15.62:0/4118211173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59cc0cc1d0 0x7f59cc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 >> 172.21.15.62:0/4118211173 conn(0x7f59cc06a430 msgr2=0x7f59cc0701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.869 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.868+0000 7efd83fff640 1 -- 172.21.15.62:0/1395238296 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd90034020 con 0x7efd9c0d3600 2023-09-30T13:55:09.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.869+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 shutdown_connections 2023-09-30T13:55:09.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.869+0000 7f59d11ee640 1 -- 172.21.15.62:0/4118211173 wait complete. 2023-09-30T13:55:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.872+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 msgr2=0x7efd8806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.872+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 0x7efd8806d020 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd940074a0 tx=0x7efd9400b040 comp rx=0 tx=0).stop 2023-09-30T13:55:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.872+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 msgr2=0x7efd9c1f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.872+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd900098c0 tx=0x7efd900046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 shutdown_connections 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8806ab60 0x7efd8806d020 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c160160 0x7efd9c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c0d3600 0x7efd9c1f2f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 --2- 172.21.15.62:0/1395238296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c0b5cd0 0x7efd9c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 >> 172.21.15.62:0/1395238296 conn(0x7efd9c089fe0 msgr2=0x7efd9c0b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 shutdown_connections 2023-09-30T13:55:09.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7efda18cf640 1 -- 172.21.15.62:0/1395238296 wait complete. 2023-09-30T13:55:09.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.873+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f716c04d6b0 con 0x7f716c0de3c0 2023-09-30T13:55:09.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.874+0000 7f7169ffb640 1 -- 172.21.15.62:0/2004556361 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f716c04d6b0 con 0x7f716c0de3c0 2023-09-30T13:55:09.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-09-30T13:55:09.875 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2023-09-30T13:55:09.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.876+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f907404e920 con 0x7f90741561d0 2023-09-30T13:55:09.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.877+0000 7f906a7fc640 1 -- 172.21.15.62:0/3511041884 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9070054420 con 0x7f90741561d0 2023-09-30T13:55:09.877 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-09-30T13:55:09.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.877+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 msgr2=0x7f715806d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.877+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 0x7f715806d040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f717002b9c0 tx=0x7f7170008030 comp rx=0 tx=0).stop 2023-09-30T13:55:09.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.877+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 msgr2=0x7f716c04b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.877+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c04b4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7174069670 tx=0x7f7174072520 comp rx=0 tx=0).stop 2023-09-30T13:55:09.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 shutdown_connections 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f715806ab80 0x7f715806d040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f716c0de3c0 0x7f716c04b4d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f716c038610 0x7f716c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 --2- 172.21.15.62:0/2004556361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716c006690 0x7f716c04e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 >> 172.21.15.62:0/2004556361 conn(0x7f716c055a80 msgr2=0x7f716c0e82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 shutdown_connections 2023-09-30T13:55:09.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.878+0000 7f71577fe640 1 -- 172.21.15.62:0/2004556361 wait complete. 2023-09-30T13:55:09.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 msgr2=0x7f905806d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 0x7f905806d040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9064006e00 tx=0x7f9064031000 comp rx=0 tx=0).stop 2023-09-30T13:55:09.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 msgr2=0x7f9074156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 0x7f9074156650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90740cdf50 tx=0x7f907000dc00 comp rx=0 tx=0).stop 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 shutdown_connections 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f905806ab80 0x7f905806d040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90741561d0 0x7f9074156650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f907415bce0 0x7f9074069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 --2- 172.21.15.62:0/3511041884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9060003970 0x7f90740b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.880+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 >> 172.21.15.62:0/3511041884 conn(0x7f90740cbd20 msgr2=0x7f90740aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.881+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 shutdown_connections 2023-09-30T13:55:09.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:09.881+0000 7f907bc02640 1 -- 172.21.15.62:0/3511041884 wait complete. 2023-09-30T13:55:09.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-09-30T13:55:09.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2023-09-30T13:55:09.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2023-09-30T13:55:09.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2023-09-30T13:55:09.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2023-09-30T13:55:10.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-30T13:55:10.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T13:55:10.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-30T13:55:10.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-30T13:55:10.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T13:55:10.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T13:55:10.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T13:55:10.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-30T13:55:11.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.029+0000 7f4518ca9640 1 Processor -- start 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.030+0000 7f4518ca9640 1 -- start start 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.031+0000 7f4518ca9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140c16c0 0x7f451406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.031+0000 7f4518ca9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45140cb340 0x7f451406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.031+0000 7f4518ca9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4514165080 con 0x7f4514165510 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.031+0000 7f4518ca9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451406cd50 con 0x7f45140cb340 2023-09-30T13:55:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.031+0000 7f4518ca9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c1aa0 con 0x7f45140c16c0 2023-09-30T13:55:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4511d9b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4514165510 0x7f45140cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50288/0 (socket says 172.21.15.62:50288) 2023-09-30T13:55:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4511d9b640 1 -- 172.21.15.62:0/532971892 learned_addr learned my addr 172.21.15.62:0/532971892 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:11.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4512d9d640 1 --2- 172.21.15.62:0/532971892 >> v2:172.21.15.135:3300/0 conn(0x7f45140cb340 0x7f451406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f451259c640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140c16c0 0x7f451406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4512d9d640 1 -- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140c16c0 msgr2=0x7f451406bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4512d9d640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140c16c0 0x7f451406bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4512d9d640 1 -- 172.21.15.62:0/532971892 >> v1:172.21.15.135:6789/0 conn(0x7f4514165510 legacy=0x7f45140cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.032+0000 7f4512d9d640 1 -- 172.21.15.62:0/532971892 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140c8c90 con 0x7f45140cb340 2023-09-30T13:55:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.034+0000 7f4512d9d640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45140cb340 0x7f451406c440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45080097a0 tx=0x7f450802b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5976bff9a0c5186 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.034+0000 7f451159a640 1 -- 172.21.15.62:0/532971892 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508031740 con 0x7f45140cb340 2023-09-30T13:55:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.034+0000 7f451159a640 1 -- 172.21.15.62:0/532971892 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080318a0 con 0x7f45140cb340 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.035+0000 7f4518ca9640 1 -- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45140cb340 msgr2=0x7f451406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.035+0000 7f4518ca9640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45140cb340 0x7f451406c440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45080097a0 tx=0x7f450802b7e0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 -- 172.21.15.62:0/532971892 shutdown_connections 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45140cb340 0x7f451406c440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 --2- 172.21.15.62:0/532971892 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140c16c0 0x7f451406bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 -- 172.21.15.62:0/532971892 >> 172.21.15.62:0/532971892 conn(0x7f45140afec0 msgr2=0x7f45140b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 -- 172.21.15.62:0/532971892 shutdown_connections 2023-09-30T13:55:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.036+0000 7f4518ca9640 1 -- 172.21.15.62:0/532971892 wait complete. 2023-09-30T13:55:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.038+0000 7f4518ca9640 1 Processor -- start 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.038+0000 7f4518ca9640 1 -- start start 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.039+0000 7f4518ca9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4518ca9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 0x7f4514070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f451259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f451259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39420/0 (socket says 172.21.15.62:39420) 2023-09-30T13:55:11.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f451259c640 1 -- 172.21.15.62:0/1378522418 learned_addr learned my addr 172.21.15.62:0/1378522418 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4518ca9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4514165510 0x7f45140b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4511d9b640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 0x7f4514070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451414b1a0 con 0x7f45140c16c0 2023-09-30T13:55:11.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b2ab0 con 0x7f4514165510 2023-09-30T13:55:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.040+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514147270 con 0x7f45140cb340 2023-09-30T13:55:11.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 -- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4514165510 msgr2=0x7f45140b3550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4514165510 0x7f45140b3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 -- 172.21.15.62:0/1378522418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 msgr2=0x7f4514147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009400 con 0x7f45140cb340 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f451259c640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.041+0000 7f4511d9b640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 0x7f4514070040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f450c00cb10 tx=0x7f450c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.042+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ac70 con 0x7f45140cb340 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.042+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00add0 con 0x7f45140cb340 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.042+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c012600 con 0x7f45140cb340 2023-09-30T13:55:11.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.042+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451414aec0 con 0x7f45140cb340 2023-09-30T13:55:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.042+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45140b3030 con 0x7f45140cb340 2023-09-30T13:55:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.045+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f450c012760 con 0x7f45140cb340 2023-09-30T13:55:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.046+0000 7f4502ffd640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 0x7f44f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.046+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f450c089320 con 0x7f45140cb340 2023-09-30T13:55:11.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.047+0000 7f451259c640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 0x7f44f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.047+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45140b2910 con 0x7f45140cb340 2023-09-30T13:55:11.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.047+0000 7f451259c640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 0x7f44f406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4504009ed0 tx=0x7f4504009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.053+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f45140b2910 con 0x7f45140cb340 2023-09-30T13:55:11.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.080+0000 7faf33543640 1 Processor -- start 2023-09-30T13:55:11.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.081+0000 7faf33543640 1 -- start start 2023-09-30T13:55:11.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7fb56c15a640 1 Processor -- start 2023-09-30T13:55:11.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7faf33543640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf2c160c20 0x7faf2c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7f42ea2ec640 1 Processor -- start 2023-09-30T13:55:11.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7faf33543640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faf2c161000 0x7faf2c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7faf33543640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0ce4e0 con 0x7faf2c0c1560 2023-09-30T13:55:11.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7f833f59e640 1 Processor -- start 2023-09-30T13:55:11.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7faf33543640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0ce2f0 con 0x7faf2c160c20 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.082+0000 7faf33543640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0afd10 con 0x7faf2c161000 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf2c160c20 0x7faf2c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf2c160c20 0x7faf2c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39426/0 (socket says 172.21.15.62:39426) 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 -- 172.21.15.62:0/2326917735 learned_addr learned my addr 172.21.15.62:0/2326917735 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf31d40640 1 --2- 172.21.15.62:0/2326917735 >> v2:172.21.15.135:3300/0 conn(0x7faf2c161000 0x7faf2c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 -- 172.21.15.62:0/2326917735 >> v2:172.21.15.135:3300/0 conn(0x7faf2c161000 msgr2=0x7faf2c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 --2- 172.21.15.62:0/2326917735 >> v2:172.21.15.135:3300/0 conn(0x7faf2c161000 0x7faf2c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 -- 172.21.15.62:0/2326917735 >> v1:172.21.15.135:6789/0 conn(0x7faf2c0c1560 legacy=0x7faf2c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7faf32541640 1 -- 172.21.15.62:0/2326917735 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0ce7c0 con 0x7faf2c160c20 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.083+0000 7fb56c15a640 1 -- start start 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7fb56c15a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7fb56c15a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb56406a290 0x7fb5640cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7fb56c15a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56406b650 con 0x7fb564165310 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7fb56c15a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5641656f0 con 0x7fb56406a290 2023-09-30T13:55:11.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7fb56c15a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56406aa40 con 0x7fb5640c98a0 2023-09-30T13:55:11.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7f833f59e640 1 -- start start 2023-09-30T13:55:11.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.084+0000 7f42ea2ec640 1 -- start start 2023-09-30T13:55:11.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f376651d640 1 Processor -- start 2023-09-30T13:55:11.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38404/0 (socket says 172.21.15.62:38404) 2023-09-30T13:55:11.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 -- 172.21.15.62:0/2401753700 learned_addr learned my addr 172.21.15.62:0/2401753700 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f17fe4a9640 1 Processor -- start 2023-09-30T13:55:11.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb56a6f7640 1 --2- 172.21.15.62:0/2401753700 >> v2:172.21.15.135:3300/0 conn(0x7fb56406a290 0x7fb5640cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42ea2ec640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42e40c16c0 0x7f42e406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f17fe4a9640 1 -- start start 2023-09-30T13:55:11.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f833f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 0x7f8338047bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42ea2ec640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e4165080 con 0x7f42e40cb340 2023-09-30T13:55:11.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42ea2ec640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e406cd50 con 0x7f42e4165510 2023-09-30T13:55:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f833f59e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8338037b50 con 0x7f8338005ec0 2023-09-30T13:55:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f833f59e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833804f710 con 0x7f8338006a50 2023-09-30T13:55:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f833f59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833804f150 con 0x7f83380eac80 2023-09-30T13:55:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833dd9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8338005ec0 0x7f8338006340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45970/0 (socket says 172.21.15.62:45970) 2023-09-30T13:55:11.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833dd9b640 1 -- 172.21.15.62:0/2883591687 learned_addr learned my addr 172.21.15.62:0/2883591687 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42ea2ec640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40c1aa0 con 0x7f42e40c16c0 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42e37fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f42e4165510 0x7f42e40cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50310/0 (socket says 172.21.15.62:50310) 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42e37fe640 1 -- 172.21.15.62:0/2559652360 learned_addr learned my addr 172.21.15.62:0/2559652360 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f42e3fff640 1 --2- 172.21.15.62:0/2559652360 >> v2:172.21.15.135:3300/0 conn(0x7f42e40c16c0 0x7f42e406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f42e3fff640 1 -- 172.21.15.62:0/2559652360 >> v1:172.21.15.135:6789/0 conn(0x7f42e4165510 legacy=0x7f42e40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f42e3fff640 1 -- 172.21.15.62:0/2559652360 >> v1:172.21.15.62:6789/0 conn(0x7f42e40cb340 legacy=0x7f42e406fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f8e77fff640 1 Processor -- start 2023-09-30T13:55:11.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7f376651d640 1 -- start start 2023-09-30T13:55:11.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833e59c640 1 --2- 172.21.15.62:0/2883591687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 0x7f8338047bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f376651d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f376015bc80 0x7f37600c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f376651d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37600cdb40 0x7f376006c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f376651d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37600c9130 con 0x7f376006bf00 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f376651d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376006e750 con 0x7f376015bc80 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f376651d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376006c8d0 con 0x7f37600cdb40 2023-09-30T13:55:11.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f3764aba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37600cdb40 0x7f376006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37600cdb40 0x7f376006c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42888/0 (socket says 172.21.15.62:42888) 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 -- 172.21.15.62:0/2131896301 learned_addr learned my addr 172.21.15.62:0/2131896301 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f375ffff640 1 --2- 172.21.15.62:0/2131896301 >> v2:172.21.15.62:3300/0 conn(0x7f376015bc80 0x7f37600c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 -- 172.21.15.62:0/2131896301 >> v2:172.21.15.62:3300/0 conn(0x7f376015bc80 msgr2=0x7f37600c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 --2- 172.21.15.62:0/2131896301 >> v2:172.21.15.62:3300/0 conn(0x7f376015bc80 0x7f37600c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 -- 172.21.15.62:0/2401753700 >> v2:172.21.15.135:3300/0 conn(0x7fb56406a290 msgr2=0x7fb5640cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 --2- 172.21.15.62:0/2401753700 >> v2:172.21.15.135:3300/0 conn(0x7fb56406a290 0x7fb5640cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 -- 172.21.15.62:0/2401753700 >> v1:172.21.15.135:6789/0 conn(0x7fb564165310 legacy=0x7fb5640c9190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.085+0000 7fb5696f5640 1 -- 172.21.15.62:0/2401753700 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406ad20 con 0x7fb5640c98a0 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7fb5696f5640 1 --2- 172.21.15.62:0/2401753700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009e50 tx=0x7fb55c02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec450dcba2399d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7faf32541640 1 --2- 172.21.15.62:0/2326917735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c160c20 0x7faf2c0cddb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0adf90 tx=0x7faf2403cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fcac38b12dbc5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 0x7f17f00eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f17f0053010 0x7f17f00534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f0050370 con 0x7f17f0053010 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00064b0 con 0x7f17f00eb2f0 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f17fe4a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00ebc70 con 0x7f17f00e78e0 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38430/0 (socket says 172.21.15.62:38430) 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 -- 172.21.15.62:0/3167782462 learned_addr learned my addr 172.21.15.62:0/3167782462 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f77fe640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 0x7f17f00eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833e59c640 1 -- 172.21.15.62:0/2883591687 >> v1:172.21.15.135:6789/0 conn(0x7f8338006a50 legacy=0x7f8338052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833e59c640 1 -- 172.21.15.62:0/2883591687 >> v1:172.21.15.62:6789/0 conn(0x7f8338005ec0 legacy=0x7f8338006340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f833e59c640 1 -- 172.21.15.62:0/2883591687 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833804f430 con 0x7f83380eac80 2023-09-30T13:55:11.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f42e3fff640 1 -- 172.21.15.62:0/2559652360 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40c8c90 con 0x7f42e40c16c0 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 -- 172.21.15.62:0/2131896301 >> v1:172.21.15.62:6789/0 conn(0x7f376006bf00 legacy=0x7f376015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f3764aba640 1 -- 172.21.15.62:0/2131896301 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376006e470 con 0x7f37600cdb40 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17fca46640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.62:3300/0 conn(0x7f17f0053010 0x7f17f00534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7fb568ef4640 1 -- 172.21.15.62:0/2401753700 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c02ca10 con 0x7fb5640c98a0 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7fb568ef4640 1 -- 172.21.15.62:0/2401753700 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c02cb70 con 0x7fb5640c98a0 2023-09-30T13:55:11.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7fb568ef4640 1 -- 172.21.15.62:0/2401753700 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0343f0 con 0x7fb5640c98a0 2023-09-30T13:55:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7faf3153f640 1 -- 172.21.15.62:0/2326917735 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2403d720 con 0x7faf2c160c20 2023-09-30T13:55:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7faf3153f640 1 -- 172.21.15.62:0/2326917735 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2403d880 con 0x7faf2c160c20 2023-09-30T13:55:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7faf3153f640 1 -- 172.21.15.62:0/2326917735 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2403dc10 con 0x7faf2c160c20 2023-09-30T13:55:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.086+0000 7f8e77fff640 1 -- start start 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f8e77fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8e700eac80 0x7f8e70047bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f8e77fff640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e70037b50 con 0x7f8e70006a50 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f8e77fff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7004f710 con 0x7f8e70005ec0 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f8e77fff640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7004f150 con 0x7f8e700eac80 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 -- 172.21.15.62:0/3167782462 >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 msgr2=0x7f17f00eb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 0x7f17f00eb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 -- 172.21.15.62:0/3167782462 >> v2:172.21.15.62:3300/0 conn(0x7f17f0053010 msgr2=0x7f17f00534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.62:3300/0 conn(0x7f17f0053010 0x7f17f00534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e76ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8e700eac80 0x7f8e70047bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e777fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8e70006a50 0x7f8e70052f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45994/0 (socket says 172.21.15.62:45994) 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e777fe640 1 -- 172.21.15.62:0/2362151801 learned_addr learned my addr 172.21.15.62:0/2362151801 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:11.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f833e59c640 1 --2- 172.21.15.62:0/2883591687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 0x7f8338047bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8334009750 tx=0x7f833402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a8276f70c987de5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f7fff640 1 -- 172.21.15.62:0/3167782462 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f004fdb0 con 0x7f17f00e78e0 2023-09-30T13:55:11.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.087+0000 7f17f77fe640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 0x7f17f00eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:11.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f833d59a640 1 -- 172.21.15.62:0/2883591687 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334031710 con 0x7f83380eac80 2023-09-30T13:55:11.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f42e3fff640 1 --2- 172.21.15.62:0/2559652360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e406bf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42d40097a0 tx=0x7f42d402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9705a61f8ba68a0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f833d59a640 1 -- 172.21.15.62:0/2883591687 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833402f050 con 0x7f83380eac80 2023-09-30T13:55:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f833d59a640 1 -- 172.21.15.62:0/2883591687 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334031a90 con 0x7f83380eac80 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7faf33543640 1 -- 172.21.15.62:0/2326917735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c160c20 msgr2=0x7faf2c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7faf33543640 1 --2- 172.21.15.62:0/2326917735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c160c20 0x7faf2c0cddb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0adf90 tx=0x7faf2403cb80 comp rx=0 tx=0).stop 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 -- 172.21.15.62:0/2326917735 shutdown_connections 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 --2- 172.21.15.62:0/2326917735 >> v2:172.21.15.135:3300/0 conn(0x7faf2c161000 0x7faf2c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 --2- 172.21.15.62:0/2326917735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c160c20 0x7faf2c0cddb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 -- 172.21.15.62:0/2326917735 >> 172.21.15.62:0/2326917735 conn(0x7faf2c0714c0 msgr2=0x7faf2c0718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 -- 172.21.15.62:0/2401753700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 msgr2=0x7fb564069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 --2- 172.21.15.62:0/2401753700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009e50 tx=0x7fb55c02be70 comp rx=0 tx=0).stop 2023-09-30T13:55:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 -- 172.21.15.62:0/2326917735 shutdown_connections 2023-09-30T13:55:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3167782462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17f80734e0 tx=0x7f17f80a5600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87be8c0a3ebfefac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f17f6ffd640 1 -- 172.21.15.62:0/3167782462 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80ac600 con 0x7f17f00e78e0 2023-09-30T13:55:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f17f6ffd640 1 -- 172.21.15.62:0/3167782462 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80a8050 con 0x7f17f00e78e0 2023-09-30T13:55:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f17f6ffd640 1 -- 172.21.15.62:0/3167782462 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80aca60 con 0x7f17f00e78e0 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7faf33543640 1 -- 172.21.15.62:0/2326917735 wait complete. 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 -- 172.21.15.62:0/2401753700 shutdown_connections 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 --2- 172.21.15.62:0/2401753700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5640c98a0 0x7fb564069d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 --2- 172.21.15.62:0/2401753700 >> v2:172.21.15.135:3300/0 conn(0x7fb56406a290 0x7fb5640cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7fb56c15a640 1 -- 172.21.15.62:0/2401753700 >> 172.21.15.62:0/2401753700 conn(0x7fb5640b06c0 msgr2=0x7fb5640b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 -- 172.21.15.62:0/2883591687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 msgr2=0x7f8338047bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 --2- 172.21.15.62:0/2883591687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 0x7f8338047bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8334009750 tx=0x7f833402b7b0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e75ffb640 1 -- 172.21.15.62:0/2362151801 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494354358 0 0) 0x7f8e70037b50 con 0x7f8e70006a50 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e76ffd640 1 -- 172.21.15.62:0/2362151801 >> v1:172.21.15.135:6789/0 conn(0x7f8e70005ec0 legacy=0x7f8e70006340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e76ffd640 1 -- 172.21.15.62:0/2362151801 >> v1:172.21.15.62:6789/0 conn(0x7f8e70006a50 legacy=0x7f8e70052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f8e76ffd640 1 -- 172.21.15.62:0/2362151801 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7004f430 con 0x7f8e700eac80 2023-09-30T13:55:11.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f42e2ffd640 1 -- 172.21.15.62:0/2559652360 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d402e070 con 0x7f42e40c16c0 2023-09-30T13:55:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.088+0000 7f42e2ffd640 1 -- 172.21.15.62:0/2559652360 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d40315a0 con 0x7f42e40c16c0 2023-09-30T13:55:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f3764aba640 1 --2- 172.21.15.62:0/2131896301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37600cdb40 0x7f376006c390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f376006fc90 tx=0x7f375402de90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f558c72d59adaa1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 -- 172.21.15.62:0/2883591687 shutdown_connections 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 --2- 172.21.15.62:0/2883591687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83380eac80 0x7f8338047bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 -- 172.21.15.62:0/2883591687 >> 172.21.15.62:0/2883591687 conn(0x7f8338009fe0 msgr2=0x7f833800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 -- 172.21.15.62:0/2883591687 shutdown_connections 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f42ea2ec640 1 -- 172.21.15.62:0/2559652360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 msgr2=0x7f42e406bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f42e2ffd640 1 -- 172.21.15.62:0/2559652360 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d402e070 con 0x7f42e40c16c0 2023-09-30T13:55:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/2559652360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e406bf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42d40097a0 tx=0x7f42d402b840 comp rx=0 tx=0).stop 2023-09-30T13:55:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f833f59e640 1 -- 172.21.15.62:0/2883591687 wait complete. 2023-09-30T13:55:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f42ea2ec640 1 -- 172.21.15.62:0/2559652360 shutdown_connections 2023-09-30T13:55:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/2559652360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e406bf00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f42ea2ec640 1 -- 172.21.15.62:0/2559652360 >> 172.21.15.62:0/2559652360 conn(0x7f42e40afec0 msgr2=0x7f42e40b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f42ea2ec640 1 -- 172.21.15.62:0/2559652360 shutdown_connections 2023-09-30T13:55:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f42ea2ec640 1 -- 172.21.15.62:0/2559652360 wait complete. 2023-09-30T13:55:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.089+0000 7f8e76ffd640 1 --2- 172.21.15.62:0/2362151801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e700eac80 0x7f8e70047bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802cb00 tx=0x7f8e780a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78947156d0ed619 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f375effd640 1 -- 172.21.15.62:0/2131896301 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375402ec40 con 0x7f37600cdb40 2023-09-30T13:55:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f8e75ffb640 1 -- 172.21.15.62:0/2362151801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e780ae680 con 0x7f8e700eac80 2023-09-30T13:55:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f375effd640 1 -- 172.21.15.62:0/2131896301 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754032070 con 0x7f37600cdb40 2023-09-30T13:55:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f8e75ffb640 1 -- 172.21.15.62:0/2362151801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e780ae7e0 con 0x7f8e700eac80 2023-09-30T13:55:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f375effd640 1 -- 172.21.15.62:0/2131896301 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754038400 con 0x7f37600cdb40 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3167782462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 msgr2=0x7f17f004f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 --2- 172.21.15.62:0/3167782462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17f80734e0 tx=0x7f17f80a5600 comp rx=0 tx=0).stop 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3167782462 shutdown_connections 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.62:3300/0 conn(0x7f17f0053010 0x7f17f00534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 --2- 172.21.15.62:0/3167782462 >> v2:172.21.15.135:3300/0 conn(0x7f17f00eb2f0 0x7f17f00eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 --2- 172.21.15.62:0/3167782462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00e78e0 0x7f17f004f290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3167782462 >> 172.21.15.62:0/3167782462 conn(0x7f17f0054c40 msgr2=0x7f17f0055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3167782462 shutdown_connections 2023-09-30T13:55:11.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 -- 172.21.15.62:0/2131896301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37600cdb40 msgr2=0x7f376006c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 --2- 172.21.15.62:0/2131896301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37600cdb40 0x7f376006c390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f376006fc90 tx=0x7f375402de90 comp rx=0 tx=0).stop 2023-09-30T13:55:11.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.090+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3167782462 wait complete. 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 -- 172.21.15.62:0/2131896301 shutdown_connections 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 --2- 172.21.15.62:0/2131896301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37600cdb40 0x7f376006c390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 --2- 172.21.15.62:0/2131896301 >> v2:172.21.15.62:3300/0 conn(0x7f376015bc80 0x7f37600c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 -- 172.21.15.62:0/2131896301 >> 172.21.15.62:0/2131896301 conn(0x7f37600ce390 msgr2=0x7f37600ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f8e77fff640 1 -- 172.21.15.62:0/2362151801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e700eac80 msgr2=0x7f8e70047bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f8e77fff640 1 --2- 172.21.15.62:0/2362151801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e700eac80 0x7f8e70047bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802cb00 tx=0x7f8e780a5790 comp rx=0 tx=0).stop 2023-09-30T13:55:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7faf33543640 1 Processor -- start 2023-09-30T13:55:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 -- 172.21.15.62:0/2131896301 shutdown_connections 2023-09-30T13:55:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7faf33543640 1 -- start start 2023-09-30T13:55:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f42ea2ec640 1 Processor -- start 2023-09-30T13:55:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.091+0000 7f376651d640 1 -- 172.21.15.62:0/2131896301 wait complete. 2023-09-30T13:55:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7fb56c15a640 1 -- 172.21.15.62:0/2401753700 shutdown_connections 2023-09-30T13:55:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f8e77fff640 1 -- 172.21.15.62:0/2362151801 shutdown_connections 2023-09-30T13:55:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f8e77fff640 1 --2- 172.21.15.62:0/2362151801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e700eac80 0x7f8e70047bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f8e77fff640 1 -- 172.21.15.62:0/2362151801 >> 172.21.15.62:0/2362151801 conn(0x7f8e70009fe0 msgr2=0x7f8e7000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f42ea2ec640 1 -- start start 2023-09-30T13:55:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7faf33543640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f17fe4a9640 1 Processor -- start 2023-09-30T13:55:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f17fe4a9640 1 -- start start 2023-09-30T13:55:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e40cb340 0x7f42e4070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42e4165510 0x7f42e40708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42898/0 (socket says 172.21.15.62:42898) 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42e3fff640 1 -- 172.21.15.62:0/667011307 learned_addr learned my addr 172.21.15.62:0/667011307 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c7480 con 0x7f42e40cb340 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41faa60 con 0x7f42e40c16c0 2023-09-30T13:55:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c6900 con 0x7f42e4165510 2023-09-30T13:55:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f8e77fff640 1 -- 172.21.15.62:0/2362151801 shutdown_connections 2023-09-30T13:55:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7fb56c15a640 1 -- 172.21.15.62:0/2401753700 wait complete. 2023-09-30T13:55:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7fb56c15a640 1 Processor -- start 2023-09-30T13:55:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f8e77fff640 1 -- 172.21.15.62:0/2362151801 wait complete. 2023-09-30T13:55:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f376651d640 1 Processor -- start 2023-09-30T13:55:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e8889640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42e4165510 0x7f42e40708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f376651d640 1 -- start start 2023-09-30T13:55:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7faf32541640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f17fe4a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f8e77fff640 1 Processor -- start 2023-09-30T13:55:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f17fe4a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17f00e78e0 0x7f17f00e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 -- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42e4165510 msgr2=0x7f42e40708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42e4165510 0x7f42e40708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 -- 172.21.15.62:0/667011307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e40cb340 msgr2=0x7f42e4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e40cb340 0x7f42e4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4009400 con 0x7f42e40c16c0 2023-09-30T13:55:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f8e77fff640 1 -- start start 2023-09-30T13:55:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39502/0 (socket says 172.21.15.62:39502) 2023-09-30T13:55:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f17f7fff640 1 -- 172.21.15.62:0/3337293419 learned_addr learned my addr 172.21.15.62:0/3337293419 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f42e3fff640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17f77fe640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17f00e78e0 0x7f17f00e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4003a20 con 0x7f42e40c16c0 2023-09-30T13:55:11.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7fb56c15a640 1 -- start start 2023-09-30T13:55:11.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e40c6be0 con 0x7f42e40c16c0 2023-09-30T13:55:11.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e40c71a0 con 0x7f42e40c16c0 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5640c98a0 0x7fb5640b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 0x7fb5640cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640bf140 con 0x7fb564165310 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b2740 con 0x7fb5640c98a0 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb56c15a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56414a770 con 0x7fb56406a290 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376006bf00 0x7f37600c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37600cdb40 0x7f37600c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600c4e50 con 0x7f376006bf00 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600b18a0 con 0x7f376015bc80 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f376651d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600b0f90 con 0x7f37600cdb40 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17fe4a9640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00eb2f0 0x7f17f00d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00e7ef0 con 0x7f17f0053010 2023-09-30T13:55:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb5696f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5640c98a0 0x7fb5640b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f3764aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f3764aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42920/0 (socket says 172.21.15.62:42920) 2023-09-30T13:55:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f375f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37600cdb40 0x7f37600c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb569ef6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb569ef6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38458/0 (socket says 172.21.15.62:38458) 2023-09-30T13:55:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f3764aba640 1 -- 172.21.15.62:0/149088427 learned_addr learned my addr 172.21.15.62:0/149088427 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7fb569ef6640 1 -- 172.21.15.62:0/1692176846 learned_addr learned my addr 172.21.15.62:0/1692176846 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00e66a0 con 0x7f17f00e78e0 2023-09-30T13:55:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00e6980 con 0x7f17f00eb2f0 2023-09-30T13:55:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f17fca46640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00eb2f0 0x7f17f00d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f833f59e640 1 Processor -- start 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.092+0000 7f833f59e640 1 -- start start 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 0x7f83380d7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 0x7f833804a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380e4800 con 0x7f8338006a50 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39480/0 (socket says 172.21.15.62:39480) 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833dd9b640 1 -- 172.21.15.62:0/908161963 learned_addr learned my addr 172.21.15.62:0/908161963 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380e40d0 con 0x7f83380eac80 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83380e3df0 con 0x7f8338005ec0 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.093+0000 7f833ed9d640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 0x7f833804a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833e59c640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 0x7f83380d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833dd9b640 1 -- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 msgr2=0x7f83380d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833dd9b640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 0x7f83380d7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833dd9b640 1 -- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 msgr2=0x7f833804a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833dd9b640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 0x7f833804a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7f833dd9b640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009400 con 0x7f8338006a50 2023-09-30T13:55:11.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb56a6f7640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 0x7fb5640cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f833ed9d640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 0x7f833804a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:11.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f833e59c640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 0x7f83380d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:11.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 0x7f8e700e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 -- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5640c98a0 msgr2=0x7fb5640b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 -- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00eb2f0 msgr2=0x7f17f00d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00eb2f0 0x7f17f00d5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 -- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17f00e78e0 msgr2=0x7f17f00e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17f00e78e0 0x7f17f00e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00e6c60 con 0x7f17f0053010 2023-09-30T13:55:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5640c98a0 0x7fb5640b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f375ffff640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376006bf00 0x7f37600c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 -- 172.21.15.62:0/1692176846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 msgr2=0x7fb5640cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 0x7fb5640cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 0x7f8e700dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e700eac80 0x7f8e700e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e77fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700e1c30 con 0x7f8e70005ec0 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e77fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70049d10 con 0x7f8e70006a50 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e77fff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700ea320 con 0x7f8e700eac80 2023-09-30T13:55:11.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e777fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e700eac80 0x7f8e700e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 -- 172.21.15.62:0/1692176846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009b30 con 0x7fb56406a290 2023-09-30T13:55:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e76ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 0x7f8e700e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e76ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 0x7f8e700e9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39518/0 (socket says 172.21.15.62:39518) 2023-09-30T13:55:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e76ffd640 1 -- 172.21.15.62:0/192647539 learned_addr learned my addr 172.21.15.62:0/192647539 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb56a6f7640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 0x7fb5640cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:11.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4040070 con 0x7f42e40c16c0 2023-09-30T13:55:11.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4003da0 con 0x7f42e40c16c0 2023-09-30T13:55:11.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f833dd9b640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f83400734e0 tx=0x7f8340072520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f17f7fff640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17f804f8b0 tx=0x7f17f80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f3764aba640 1 -- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37600cdb40 msgr2=0x7f37600c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f3764aba640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37600cdb40 0x7f37600c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f3764aba640 1 -- 172.21.15.62:0/149088427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376006bf00 msgr2=0x7f37600c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f3764aba640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376006bf00 0x7f37600c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f3764aba640 1 -- 172.21.15.62:0/149088427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754008550 con 0x7f376015bc80 2023-09-30T13:55:11.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7fb569ef6640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b410 tx=0x7fb55400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f8e767fc640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 0x7f8e700dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.096+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4005250 con 0x7f42e40c16c0 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf32541640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39466/0 (socket says 172.21.15.62:39466) 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf33543640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf2c160c20 0x7faf2c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf33543640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf33543640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0c3c50 con 0x7faf2c0c1560 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf33543640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0c2fd0 con 0x7faf2c160c20 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf33543640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0c32b0 con 0x7faf2c161000 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf32d42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf32d42640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38442/0 (socket says 172.21.15.62:38442) 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.094+0000 7faf32d42640 1 -- 172.21.15.62:0/783404829 learned_addr learned my addr 172.21.15.62:0/783404829 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7faf32d42640 1 -- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf2c160c20 msgr2=0x7faf2c06c7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7faf32d42640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf2c160c20 0x7faf2c06c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.095+0000 7faf32d42640 1 -- 172.21.15.62:0/783404829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 msgr2=0x7faf2c15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7faf32d42640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7faf32d42640 1 -- 172.21.15.62:0/783404829 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094d0 con 0x7faf2c161000 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7faf32541640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011830 con 0x7fb56406a290 2023-09-30T13:55:11.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b6910 con 0x7f17f0053010 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f8e767fc640 1 -- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e700eac80 msgr2=0x7f8e700e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f8e767fc640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e700eac80 0x7f8e700e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f8e767fc640 1 -- 172.21.15.62:0/192647539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 msgr2=0x7f8e700e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f8e767fc640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 0x7f8e700e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f8e767fc640 1 -- 172.21.15.62:0/192647539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700e0680 con 0x7f8e70006a50 2023-09-30T13:55:11.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400728e0 con 0x7f8338006a50 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83380e2cc0 con 0x7f8338006a50 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83380e3a30 con 0x7f8338006a50 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834007c070 con 0x7f8338006a50 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5640beaf0 con 0x7fb56406a290 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640be7c0 con 0x7fb56406a290 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554011990 con 0x7fb56406a290 2023-09-30T13:55:11.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011d40 con 0x7fb56406a290 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80b6a70 con 0x7f17f0053010 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80b6e20 con 0x7f17f0053010 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f00e6f40 con 0x7f17f0053010 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.097+0000 7f17fe4a9640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f00d64e0 con 0x7f17f0053010 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340072c80 con 0x7f8338006a50 2023-09-30T13:55:11.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8324005250 con 0x7f8338006a50 2023-09-30T13:55:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f42d4047480 con 0x7f42e40c16c0 2023-09-30T13:55:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7f8e767fc640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 0x7f8e700dfb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00b3e0 tx=0x7f8e6c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7faf32d42640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c7b0 tx=0x7faf1c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004b60 con 0x7faf2c161000 2023-09-30T13:55:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.098+0000 7f3764aba640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3754008960 tx=0x7f3754004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c004cc0 con 0x7faf2c161000 2023-09-30T13:55:11.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7f42e0ff9640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 0x7f42d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f00054c0 con 0x7f17f0053010 2023-09-30T13:55:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7f42e37fe640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 0x7f42d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42d4042070 con 0x7f42e40c16c0 2023-09-30T13:55:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb55401a400 con 0x7fb56406a290 2023-09-30T13:55:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c005250 con 0x7fb56406a290 2023-09-30T13:55:11.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c0c3590 con 0x7faf2c161000 2023-09-30T13:55:11.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c15a780 con 0x7faf2c161000 2023-09-30T13:55:11.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.099+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004b60 con 0x7faf2c161000 2023-09-30T13:55:11.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.100+0000 7fb55a7fc640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 0x7fb54806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.100+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb554089570 con 0x7fb56406a290 2023-09-30T13:55:11.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.100+0000 7fb5696f5640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 0x7fb54806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.100+0000 7f42e37fe640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 0x7f42d006cff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42e406c360 tx=0x7f42dc001660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.100+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0c3d90 con 0x7faf2c161000 2023-09-30T13:55:11.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.101+0000 7fb5696f5640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 0x7fb54806d0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb55c035000 tx=0x7fb55c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.101+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f17f80c03f0 con 0x7f17f0053010 2023-09-30T13:55:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.101+0000 7f17f4ff9640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 0x7f17dc06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.101+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17f8125310 con 0x7f17f0053010 2023-09-30T13:55:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.101+0000 7f17f77fe640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 0x7f17dc06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.102+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8340072de0 con 0x7f8338006a50 2023-09-30T13:55:11.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.102+0000 7f17f77fe640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 0x7f17dc06d040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f17f00e72d0 tx=0x7f17e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.102+0000 7f832effd640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 0x7f832006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.102+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83401136e0 con 0x7f8338006a50 2023-09-30T13:55:11.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.102+0000 7f833e59c640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 0x7f832006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.103+0000 7f833e59c640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 0x7f832006d070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8334035000 tx=0x7f8334008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.105+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f17f80f0490 con 0x7f17f0053010 2023-09-30T13:55:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.107+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400b420 con 0x7f376015bc80 2023-09-30T13:55:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400b580 con 0x7f376015bc80 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c004020 con 0x7f8e70006a50 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c004180 con 0x7f8e70006a50 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c011630 con 0x7f8e70006a50 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f42d4077010 con 0x7f42e40c16c0 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700e0960 con 0x7f8e70006a50 2023-09-30T13:55:11.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.108+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e700e0c40 con 0x7f8e70006a50 2023-09-30T13:55:11.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.109+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400b8f0 con 0x7f376015bc80 2023-09-30T13:55:11.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.109+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3760202f70 con 0x7f376015bc80 2023-09-30T13:55:11.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.109+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37600b1530 con 0x7f376015bc80 2023-09-30T13:55:11.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.109+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb5540544f0 con 0x7fb56406a290 2023-09-30T13:55:11.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.111+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70049ec0 con 0x7f8e70006a50 2023-09-30T13:55:11.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.110+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7faf1c006b50 con 0x7faf2c161000 2023-09-30T13:55:11.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.111+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760073e70 con 0x7f376015bc80 2023-09-30T13:55:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.111+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8e6c011790 con 0x7f8e70006a50 2023-09-30T13:55:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.111+0000 7faf2affd640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 0x7faf1806d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7faf32541640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 0x7faf1806d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f8e5ffff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3754038400 con 0x7f376015bc80 2023-09-30T13:55:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f83400de760 con 0x7f8338006a50 2023-09-30T13:55:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e6c089020 con 0x7f8e70006a50 2023-09-30T13:55:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf1c089e10 con 0x7faf2c161000 2023-09-30T13:55:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f375cff9640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.112+0000 7f8e76ffd640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.113+0000 7faf32541640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 0x7faf1806d050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf24047000 tx=0x7faf24041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.113+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37540aac70 con 0x7f376015bc80 2023-09-30T13:55:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.113+0000 7f375ffff640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.113+0000 7f8e76ffd640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 0x7f8e6406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e78078d30 tx=0x7f8e780ab000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.113+0000 7f375ffff640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 0x7f374c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3750006fd0 tx=0x7f3750008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.117+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7faf1c054d70 con 0x7faf2c161000 2023-09-30T13:55:11.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.119+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8e6c0bbad0 con 0x7f8e70006a50 2023-09-30T13:55:11.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.126+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3754075c60 con 0x7f376015bc80 2023-09-30T13:55:11.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.450+0000 7f4518ca9640 1 -- 172.21.15.62:0/1378522418 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45140b2910 con 0x7f45140cb340 2023-09-30T13:55:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.451+0000 7f4502ffd640 1 -- 172.21.15.62:0/1378522418 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45140b2910 con 0x7f45140cb340 2023-09-30T13:55:11.460 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.454+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 msgr2=0x7f44f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.454+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 0x7f44f406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4504009ed0 tx=0x7f4504009190 comp rx=0 tx=0).stop 2023-09-30T13:55:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 msgr2=0x7f4514070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 0x7f4514070040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f450c00cb10 tx=0x7f450c00a060 comp rx=0 tx=0).stop 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 shutdown_connections 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f44f406ac00 0x7f44f406d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4514165510 0x7f45140b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45140cb340 0x7f4514070040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 --2- 172.21.15.62:0/1378522418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45140c16c0 0x7f4514147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 >> 172.21.15.62:0/1378522418 conn(0x7f45140afec0 msgr2=0x7f4514071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 shutdown_connections 2023-09-30T13:55:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.455+0000 7f4500ff9640 1 -- 172.21.15.62:0/1378522418 wait complete. 2023-09-30T13:55:11.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-09-30T13:55:11.472 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.490+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f42c4005500 con 0x7f42e40c16c0 2023-09-30T13:55:11.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.490+0000 7f42e0ff9640 1 -- 172.21.15.62:0/667011307 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42d4006e10 con 0x7f42e40c16c0 2023-09-30T13:55:11.491 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 msgr2=0x7f42d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 0x7f42d006cff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42e406c360 tx=0x7f42dc001660 comp rx=0 tx=0).stop 2023-09-30T13:55:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 msgr2=0x7f42e41fa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42d4000c00 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 shutdown_connections 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f42d006ab30 0x7f42d006cff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42e4165510 0x7f42e40708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42e40cb340 0x7f42e4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 --2- 172.21.15.62:0/667011307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42e40c16c0 0x7f42e41fa520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.492+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 >> 172.21.15.62:0/667011307 conn(0x7f42e40afec0 msgr2=0x7f42e4071780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.494+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 shutdown_connections 2023-09-30T13:55:11.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.494+0000 7f42ea2ec640 1 -- 172.21.15.62:0/667011307 wait complete. 2023-09-30T13:55:11.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-09-30T13:55:11.505 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.517+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17f003a710 con 0x7f17f0053010 2023-09-30T13:55:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.517+0000 7f17f4ff9640 1 -- 172.21.15.62:0/3337293419 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17f80f3ab0 con 0x7f17f0053010 2023-09-30T13:55:11.518 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.518+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83240057d0 con 0x7f8338006a50 2023-09-30T13:55:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.519+0000 7f832effd640 1 -- 172.21.15.62:0/908161963 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8340087020 con 0x7f8338006a50 2023-09-30T13:55:11.519 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 msgr2=0x7f17dc06d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 0x7f17dc06d040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f17f00e72d0 tx=0x7f17e4008040 comp rx=0 tx=0).stop 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 msgr2=0x7f17f00e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17f804f8b0 tx=0x7f17f80a7000 comp rx=0 tx=0).stop 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 shutdown_connections 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f17dc06ab80 0x7f17dc06d040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17f00eb2f0 0x7f17f00d5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17f00e78e0 0x7f17f00e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 --2- 172.21.15.62:0/3337293419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0053010 0x7f17f00e60b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 >> 172.21.15.62:0/3337293419 conn(0x7f17f0054c40 msgr2=0x7f17f0053d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 shutdown_connections 2023-09-30T13:55:11.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.520+0000 7f17e27fc640 1 -- 172.21.15.62:0/3337293419 wait complete. 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 msgr2=0x7f832006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 0x7f832006d070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8334035000 tx=0x7f8334008030 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 msgr2=0x7f83380e1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f83400734e0 tx=0x7f8340072520 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 shutdown_connections 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f832006abb0 0x7f832006d070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83380eac80 0x7f833804a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8338006a50 0x7f83380e1520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 --2- 172.21.15.62:0/908161963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8338005ec0 0x7f83380d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 >> 172.21.15.62:0/908161963 conn(0x7f8338009fe0 msgr2=0x7f8338038610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 shutdown_connections 2023-09-30T13:55:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7f833f59e640 1 -- 172.21.15.62:0/908161963 wait complete. 2023-09-30T13:55:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faf2c04e920 con 0x7faf2c161000 2023-09-30T13:55:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.522+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb54c005500 con 0x7fb56406a290 2023-09-30T13:55:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.523+0000 7faf2affd640 1 -- 172.21.15.62:0/783404829 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf1c058390 con 0x7faf2c161000 2023-09-30T13:55:11.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.523+0000 7fb55a7fc640 1 -- 172.21.15.62:0/1692176846 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb554057b10 con 0x7fb56406a290 2023-09-30T13:55:11.525 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.525 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 msgr2=0x7faf1806d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 0x7faf1806d050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf24047000 tx=0x7faf24041000 comp rx=0 tx=0).stop 2023-09-30T13:55:11.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 msgr2=0x7faf2c15b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c7b0 tx=0x7faf1c00cc70 comp rx=0 tx=0).stop 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 shutdown_connections 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faf1806ab90 0x7faf1806d050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf2c161000 0x7faf2c15b410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf2c160c20 0x7faf2c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 --2- 172.21.15.62:0/783404829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf2c0c1560 0x7faf2c15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 >> 172.21.15.62:0/783404829 conn(0x7faf2c0714c0 msgr2=0x7faf2c15ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 shutdown_connections 2023-09-30T13:55:11.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.525+0000 7faf33543640 1 -- 172.21.15.62:0/783404829 wait complete. 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.526+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 msgr2=0x7fb54806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.526+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 0x7fb54806d0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb55c035000 tx=0x7fb55c030000 comp rx=0 tx=0).stop 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.526+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 msgr2=0x7fb56414a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.526+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b410 tx=0x7fb55400b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 shutdown_connections 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb54806ac30 0x7fb54806d0f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb564165310 0x7fb5640cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5640c98a0 0x7fb5640b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 --2- 172.21.15.62:0/1692176846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb56406a290 0x7fb56414a120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 >> 172.21.15.62:0/1692176846 conn(0x7fb5640b06c0 msgr2=0x7fb564163d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 shutdown_connections 2023-09-30T13:55:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.527+0000 7fb56c15a640 1 -- 172.21.15.62:0/1692176846 wait complete. 2023-09-30T13:55:11.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.532+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8e70005330 con 0x7f8e70006a50 2023-09-30T13:55:11.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.533+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37600b4310 con 0x7f376015bc80 2023-09-30T13:55:11.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.533+0000 7f8e5ffff640 1 -- 172.21.15.62:0/192647539 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e6c015020 con 0x7f8e70006a50 2023-09-30T13:55:11.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.533+0000 7f375cff9640 1 -- 172.21.15.62:0/149088427 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3754079280 con 0x7f376015bc80 2023-09-30T13:55:11.534 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.534 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-09-30T13:55:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 msgr2=0x7f374c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 0x7f374c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3750006fd0 tx=0x7f3750008040 comp rx=0 tx=0).stop 2023-09-30T13:55:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 msgr2=0x7f37600b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3754008960 tx=0x7f3754004730 comp rx=0 tx=0).stop 2023-09-30T13:55:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 shutdown_connections 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f376015bc80 0x7f37600b1d30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37600cdb40 0x7f37600c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 --2- 172.21.15.62:0/149088427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376006bf00 0x7f37600c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.535+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 >> 172.21.15.62:0/149088427 conn(0x7f37600ce390 msgr2=0x7f37600af510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 shutdown_connections 2023-09-30T13:55:11.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f376651d640 1 -- 172.21.15.62:0/149088427 wait complete. 2023-09-30T13:55:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 msgr2=0x7f8e6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 0x7f8e6406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e78078d30 tx=0x7f8e780ab000 comp rx=0 tx=0).stop 2023-09-30T13:55:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 msgr2=0x7f8e700dfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.536+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 0x7f8e700dfb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00b3e0 tx=0x7f8e6c00b8a0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 shutdown_connections 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e700eac80 0x7f8e700e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e70006a50 0x7f8e700dfb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 --2- 172.21.15.62:0/192647539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e70005ec0 0x7f8e700e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 >> 172.21.15.62:0/192647539 conn(0x7f8e70009fe0 msgr2=0x7f8e70006ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 shutdown_connections 2023-09-30T13:55:11.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.537+0000 7f8e77fff640 1 -- 172.21.15.62:0/192647539 wait complete. 2023-09-30T13:55:11.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-09-30T13:55:11.540 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-09-30T13:55:11.541 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-09-30T13:55:11.542 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-09-30T13:55:11.546 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-09-30T13:55:11.550 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-09-30T13:55:11.551 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:11.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T13:55:11.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:55:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.696+0000 7f67732a2640 1 Processor -- start 2023-09-30T13:55:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.696+0000 7f67732a2640 1 -- start start 2023-09-30T13:55:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f67732a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c15cbe0 0x7f676c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f67732a2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f676c06c660 0x7f676c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f67732a2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c0d16a0 con 0x7f676c0d0d00 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f67732a2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676c0cfcf0 con 0x7f676c06c660 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f67732a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0cf450 con 0x7f676c15cbe0 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f677183f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f676c06c660 0x7f676c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f677083d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f676c0d0d00 0x7f676c0cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46000/0 (socket says 172.21.15.62:46000) 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.697+0000 7f677083d640 1 -- 172.21.15.62:0/1548305056 learned_addr learned my addr 172.21.15.62:0/1548305056 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677103e640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c15cbe0 0x7f676c0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677183f640 1 -- 172.21.15.62:0/1548305056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c15cbe0 msgr2=0x7f676c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677183f640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c15cbe0 0x7f676c0d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677183f640 1 -- 172.21.15.62:0/1548305056 >> v1:172.21.15.62:6789/0 conn(0x7f676c0d0d00 legacy=0x7f676c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677183f640 1 -- 172.21.15.62:0/1548305056 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0cf730 con 0x7f676c06c660 2023-09-30T13:55:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f6763fff640 1 -- 172.21.15.62:0/1548305056 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574933219 0 0) 0x7f676c0d16a0 con 0x7f676c0d0d00 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.698+0000 7f677183f640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c06c660 0x7f676c0d1160 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f676802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af12027dd27df331 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f6763fff640 1 -- 172.21.15.62:0/1548305056 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676802cce0 con 0x7f676c06c660 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f6763fff640 1 -- 172.21.15.62:0/1548305056 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676802ce40 con 0x7f676c06c660 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f6763fff640 1 -- 172.21.15.62:0/1548305056 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768034660 con 0x7f676c06c660 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 -- 172.21.15.62:0/1548305056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c06c660 msgr2=0x7f676c0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c06c660 0x7f676c0d1160 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f676802bf30 comp rx=0 tx=0).stop 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 -- 172.21.15.62:0/1548305056 shutdown_connections 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c06c660 0x7f676c0d1160 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 --2- 172.21.15.62:0/1548305056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c15cbe0 0x7f676c0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 -- 172.21.15.62:0/1548305056 >> 172.21.15.62:0/1548305056 conn(0x7f676c089fe0 msgr2=0x7f676c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 -- 172.21.15.62:0/1548305056 shutdown_connections 2023-09-30T13:55:11.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.699+0000 7f67732a2640 1 -- 172.21.15.62:0/1548305056 wait complete. 2023-09-30T13:55:11.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.700+0000 7f67732a2640 1 Processor -- start 2023-09-30T13:55:11.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.700+0000 7f67732a2640 1 -- start start 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 0x7f676c0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 0x7f676c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0b39c0 con 0x7f676c15cbe0 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0cc0d0 con 0x7f676c06c660 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f67732a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0b3090 con 0x7f676c0d0d00 2023-09-30T13:55:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677183f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677183f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39554/0 (socket says 172.21.15.62:39554) 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677183f640 1 -- 172.21.15.62:0/2017504285 learned_addr learned my addr 172.21.15.62:0/2017504285 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677083d640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 0x7f676c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677103e640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 0x7f676c0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.701+0000 7f677183f640 1 -- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 msgr2=0x7f676c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677183f640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 0x7f676c0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677183f640 1 -- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 msgr2=0x7f676c0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677183f640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 0x7f676c0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677183f640 1 -- 172.21.15.62:0/2017504285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009a70 con 0x7f676c15cbe0 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677083d640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 0x7f676c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677103e640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 0x7f676c0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f677183f640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f6768004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676803d600 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676803d780 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c0b3370 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676803db30 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.702+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c0b3e50 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.703+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c0b3b30 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.704+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f676803b040 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.704+0000 7f6761ffb640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 0x7f675006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.704+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f67680abb60 con 0x7f676c15cbe0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.704+0000 7f677103e640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 0x7f675006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.705+0000 7f677103e640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 0x7f675006d020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f676400a970 tx=0x7f6764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.708+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6768076ac0 con 0x7f676c15cbe0 2023-09-30T13:55:11.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.879+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f676c0b3fe0 con 0x7f675006ab60 2023-09-30T13:55:11.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.889+0000 7f6761ffb640 1 -- 172.21.15.62:0/2017504285 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345296 (secure 0 0 0) 0x7f676400c050 con 0x7f675006ab60 2023-09-30T13:55:11.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:11.894 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 msgr2=0x7f675006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 0x7f675006d020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f676400a970 tx=0x7f6764008040 comp rx=0 tx=0).stop 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 msgr2=0x7f676c0af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f6768004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 shutdown_connections 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f675006ab60 0x7f675006d020 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f676c15cbe0 0x7f676c0af440 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f676c0d0d00 0x7f676c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 --2- 172.21.15.62:0/2017504285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f676c06c660 0x7f676c0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 >> 172.21.15.62:0/2017504285 conn(0x7f676c089fe0 msgr2=0x7f676c15bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 shutdown_connections 2023-09-30T13:55:11.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:11.892+0000 7f67732a2640 1 -- 172.21.15.62:0/2017504285 wait complete. 2023-09-30T13:55:11.903 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-09-30T13:55:11.678019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003755"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454383+0000","last_change":"2023-09-30T13:54:49.420957+0000","last_active":"2023-09-30T13:54:54.454383+0000","last_peered":"2023-09-30T13:54:54.454383+0000","last_clean":"2023-09-30T13:54:54.454383+0000","last_became_active":"2023-09-30T13:54:49.420645+0000","last_became_peered":"2023-09-30T13:54:49.420645+0000","last_unstale":"2023-09-30T13:54:54.454383+0000","last_undegraded":"2023-09-30T13:54:54.454383+0000","last_fullsized":"2023-09-30T13:54:54.454383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440525+0000","last_change":"2023-09-30T13:54:50.403409+0000","last_active":"2023-09-30T13:54:54.440525+0000","last_peered":"2023-09-30T13:54:54.440525+0000","last_clean":"2023-09-30T13:54:54.440525+0000","last_became_active":"2023-09-30T13:54:50.403080+0000","last_became_peered":"2023-09-30T13:54:50.403080+0000","last_unstale":"2023-09-30T13:54:54.440525+0000","last_undegraded":"2023-09-30T13:54:54.440525+0000","last_fullsized":"2023-09-30T13:54:54.440525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394904+0000","last_change":"2023-09-30T13:54:54.461252+0000","last_active":"2023-09-30T13:54:55.394904+0000","last_peered":"2023-09-30T13:54:55.394904+0000","last_clean":"2023-09-30T13:54:55.394904+0000","last_became_active":"2023-09-30T13:54:54.460732+0000","last_became_peered":"2023-09-30T13:54:54.460732+0000","last_unstale":"2023-09-30T13:54:55.394904+0000","last_undegraded":"2023-09-30T13:54:55.394904+0000","last_fullsized":"2023-09-30T13:54:55.394904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440632+0000","last_change":"2023-09-30T13:54:49.417394+0000","last_active":"2023-09-30T13:54:54.440632+0000","last_peered":"2023-09-30T13:54:54.440632+0000","last_clean":"2023-09-30T13:54:54.440632+0000","last_became_active":"2023-09-30T13:54:49.417129+0000","last_became_peered":"2023-09-30T13:54:49.417129+0000","last_unstale":"2023-09-30T13:54:54.440632+0000","last_undegraded":"2023-09-30T13:54:54.440632+0000","last_fullsized":"2023-09-30T13:54:54.440632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454087+0000","last_change":"2023-09-30T13:54:50.412921+0000","last_active":"2023-09-30T13:54:54.454087+0000","last_peered":"2023-09-30T13:54:54.454087+0000","last_clean":"2023-09-30T13:54:54.454087+0000","last_became_active":"2023-09-30T13:54:50.412639+0000","last_became_peered":"2023-09-30T13:54:50.412639+0000","last_unstale":"2023-09-30T13:54:54.454087+0000","last_undegraded":"2023-09-30T13:54:54.454087+0000","last_fullsized":"2023-09-30T13:54:54.454087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395450+0000","last_change":"2023-09-30T13:54:54.451254+0000","last_active":"2023-09-30T13:54:55.395450+0000","last_peered":"2023-09-30T13:54:55.395450+0000","last_clean":"2023-09-30T13:54:55.395450+0000","last_became_active":"2023-09-30T13:54:54.450838+0000","last_became_peered":"2023-09-30T13:54:54.450838+0000","last_unstale":"2023-09-30T13:54:55.395450+0000","last_undegraded":"2023-09-30T13:54:55.395450+0000","last_fullsized":"2023-09-30T13:54:55.395450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:29.042314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458680+0000","last_change":"2023-09-30T13:54:49.419160+0000","last_active":"2023-09-30T13:54:54.458680+0000","last_peered":"2023-09-30T13:54:54.458680+0000","last_clean":"2023-09-30T13:54:54.458680+0000","last_became_active":"2023-09-30T13:54:49.418836+0000","last_became_peered":"2023-09-30T13:54:49.418836+0000","last_unstale":"2023-09-30T13:54:54.458680+0000","last_undegraded":"2023-09-30T13:54:54.458680+0000","last_fullsized":"2023-09-30T13:54:54.458680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450093+0000","last_change":"2023-09-30T13:54:50.412155+0000","last_active":"2023-09-30T13:54:54.450093+0000","last_peered":"2023-09-30T13:54:54.450093+0000","last_clean":"2023-09-30T13:54:54.450093+0000","last_became_active":"2023-09-30T13:54:50.411864+0000","last_became_peered":"2023-09-30T13:54:50.411864+0000","last_unstale":"2023-09-30T13:54:54.450093+0000","last_undegraded":"2023-09-30T13:54:54.450093+0000","last_fullsized":"2023-09-30T13:54:54.450093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395306+0000","last_change":"2023-09-30T13:54:54.462010+0000","last_active":"2023-09-30T13:54:55.395306+0000","last_peered":"2023-09-30T13:54:55.395306+0000","last_clean":"2023-09-30T13:54:55.395306+0000","last_became_active":"2023-09-30T13:54:54.461058+0000","last_became_peered":"2023-09-30T13:54:54.461058+0000","last_unstale":"2023-09-30T13:54:55.395306+0000","last_undegraded":"2023-09-30T13:54:55.395306+0000","last_fullsized":"2023-09-30T13:54:55.395306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:25.190712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458145+0000","last_change":"2023-09-30T13:54:49.427182+0000","last_active":"2023-09-30T13:54:54.458145+0000","last_peered":"2023-09-30T13:54:54.458145+0000","last_clean":"2023-09-30T13:54:54.458145+0000","last_became_active":"2023-09-30T13:54:49.426903+0000","last_became_peered":"2023-09-30T13:54:49.426903+0000","last_unstale":"2023-09-30T13:54:54.458145+0000","last_undegraded":"2023-09-30T13:54:54.458145+0000","last_fullsized":"2023-09-30T13:54:54.458145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:03.302440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450403+0000","last_change":"2023-09-30T13:54:50.417073+0000","last_active":"2023-09-30T13:54:54.450403+0000","last_peered":"2023-09-30T13:54:54.450403+0000","last_clean":"2023-09-30T13:54:54.450403+0000","last_became_active":"2023-09-30T13:54:50.416801+0000","last_became_peered":"2023-09-30T13:54:50.416801+0000","last_unstale":"2023-09-30T13:54:54.450403+0000","last_undegraded":"2023-09-30T13:54:54.450403+0000","last_fullsized":"2023-09-30T13:54:54.450403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395323+0000","last_change":"2023-09-30T13:54:54.458847+0000","last_active":"2023-09-30T13:54:55.395323+0000","last_peered":"2023-09-30T13:54:55.395323+0000","last_clean":"2023-09-30T13:54:55.395323+0000","last_became_active":"2023-09-30T13:54:54.457421+0000","last_became_peered":"2023-09-30T13:54:54.457421+0000","last_unstale":"2023-09-30T13:54:55.395323+0000","last_undegraded":"2023-09-30T13:54:55.395323+0000","last_fullsized":"2023-09-30T13:54:55.395323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:58.531700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445534+0000","last_change":"2023-09-30T13:54:50.421056+0000","last_active":"2023-09-30T13:54:54.445534+0000","last_peered":"2023-09-30T13:54:54.445534+0000","last_clean":"2023-09-30T13:54:54.445534+0000","last_became_active":"2023-09-30T13:54:50.420770+0000","last_became_peered":"2023-09-30T13:54:50.420770+0000","last_unstale":"2023-09-30T13:54:54.445534+0000","last_undegraded":"2023-09-30T13:54:54.445534+0000","last_fullsized":"2023-09-30T13:54:54.445534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458473+0000","last_change":"2023-09-30T13:54:49.422297+0000","last_active":"2023-09-30T13:54:54.458473+0000","last_peered":"2023-09-30T13:54:54.458473+0000","last_clean":"2023-09-30T13:54:54.458473+0000","last_became_active":"2023-09-30T13:54:49.422032+0000","last_became_peered":"2023-09-30T13:54:49.422032+0000","last_unstale":"2023-09-30T13:54:54.458473+0000","last_undegraded":"2023-09-30T13:54:54.458473+0000","last_fullsized":"2023-09-30T13:54:54.458473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395905+0000","last_change":"2023-09-30T13:54:54.456854+0000","last_active":"2023-09-30T13:54:55.395905+0000","last_peered":"2023-09-30T13:54:55.395905+0000","last_clean":"2023-09-30T13:54:55.395905+0000","last_became_active":"2023-09-30T13:54:54.456476+0000","last_became_peered":"2023-09-30T13:54:54.456476+0000","last_unstale":"2023-09-30T13:54:55.395905+0000","last_undegraded":"2023-09-30T13:54:55.395905+0000","last_fullsized":"2023-09-30T13:54:55.395905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:28.802733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440683+0000","last_change":"2023-09-30T13:54:50.410713+0000","last_active":"2023-09-30T13:54:54.440683+0000","last_peered":"2023-09-30T13:54:54.440683+0000","last_clean":"2023-09-30T13:54:54.440683+0000","last_became_active":"2023-09-30T13:54:50.410454+0000","last_became_peered":"2023-09-30T13:54:50.410454+0000","last_unstale":"2023-09-30T13:54:54.440683+0000","last_undegraded":"2023-09-30T13:54:54.440683+0000","last_fullsized":"2023-09-30T13:54:54.440683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442060+0000","last_change":"2023-09-30T13:54:49.415626+0000","last_active":"2023-09-30T13:54:54.442060+0000","last_peered":"2023-09-30T13:54:54.442060+0000","last_clean":"2023-09-30T13:54:54.442060+0000","last_became_active":"2023-09-30T13:54:49.415378+0000","last_became_peered":"2023-09-30T13:54:49.415378+0000","last_unstale":"2023-09-30T13:54:54.442060+0000","last_undegraded":"2023-09-30T13:54:54.442060+0000","last_fullsized":"2023-09-30T13:54:54.442060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395657+0000","last_change":"2023-09-30T13:54:54.454291+0000","last_active":"2023-09-30T13:54:55.395657+0000","last_peered":"2023-09-30T13:54:55.395657+0000","last_clean":"2023-09-30T13:54:55.395657+0000","last_became_active":"2023-09-30T13:54:54.453505+0000","last_became_peered":"2023-09-30T13:54:54.453505+0000","last_unstale":"2023-09-30T13:54:55.395657+0000","last_undegraded":"2023-09-30T13:54:55.395657+0000","last_fullsized":"2023-09-30T13:54:55.395657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:56.027992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443495+0000","last_change":"2023-09-30T13:54:50.410244+0000","last_active":"2023-09-30T13:54:54.443495+0000","last_peered":"2023-09-30T13:54:54.443495+0000","last_clean":"2023-09-30T13:54:54.443495+0000","last_became_active":"2023-09-30T13:54:50.409602+0000","last_became_peered":"2023-09-30T13:54:50.409602+0000","last_unstale":"2023-09-30T13:54:54.443495+0000","last_undegraded":"2023-09-30T13:54:54.443495+0000","last_fullsized":"2023-09-30T13:54:54.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439311+0000","last_change":"2023-09-30T13:54:49.418424+0000","last_active":"2023-09-30T13:54:54.439311+0000","last_peered":"2023-09-30T13:54:54.439311+0000","last_clean":"2023-09-30T13:54:54.439311+0000","last_became_active":"2023-09-30T13:54:49.417956+0000","last_became_peered":"2023-09-30T13:54:49.417956+0000","last_unstale":"2023-09-30T13:54:54.439311+0000","last_undegraded":"2023-09-30T13:54:54.439311+0000","last_fullsized":"2023-09-30T13:54:54.439311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556417+0000","last_change":"2023-09-30T13:54:54.462623+0000","last_active":"2023-09-30T13:54:55.556417+0000","last_peered":"2023-09-30T13:54:55.556417+0000","last_clean":"2023-09-30T13:54:55.556417+0000","last_became_active":"2023-09-30T13:54:54.462207+0000","last_became_peered":"2023-09-30T13:54:54.462207+0000","last_unstale":"2023-09-30T13:54:55.556417+0000","last_undegraded":"2023-09-30T13:54:55.556417+0000","last_fullsized":"2023-09-30T13:54:55.556417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443009+0000","last_change":"2023-09-30T13:54:50.413527+0000","last_active":"2023-09-30T13:54:54.443009+0000","last_peered":"2023-09-30T13:54:54.443009+0000","last_clean":"2023-09-30T13:54:54.443009+0000","last_became_active":"2023-09-30T13:54:50.413227+0000","last_became_peered":"2023-09-30T13:54:50.413227+0000","last_unstale":"2023-09-30T13:54:54.443009+0000","last_undegraded":"2023-09-30T13:54:54.443009+0000","last_fullsized":"2023-09-30T13:54:54.443009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:53.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457857+0000","last_change":"2023-09-30T13:54:49.425834+0000","last_active":"2023-09-30T13:54:54.457857+0000","last_peered":"2023-09-30T13:54:54.457857+0000","last_clean":"2023-09-30T13:54:54.457857+0000","last_became_active":"2023-09-30T13:54:49.424534+0000","last_became_peered":"2023-09-30T13:54:49.424534+0000","last_unstale":"2023-09-30T13:54:54.457857+0000","last_undegraded":"2023-09-30T13:54:54.457857+0000","last_fullsized":"2023-09-30T13:54:54.457857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:38.360726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395974+0000","last_change":"2023-09-30T13:54:54.461499+0000","last_active":"2023-09-30T13:54:55.395974+0000","last_peered":"2023-09-30T13:54:55.395974+0000","last_clean":"2023-09-30T13:54:55.395974+0000","last_became_active":"2023-09-30T13:54:54.461112+0000","last_became_peered":"2023-09-30T13:54:54.461112+0000","last_unstale":"2023-09-30T13:54:55.395974+0000","last_undegraded":"2023-09-30T13:54:55.395974+0000","last_fullsized":"2023-09-30T13:54:55.395974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454330+0000","last_change":"2023-09-30T13:54:50.410914+0000","last_active":"2023-09-30T13:54:54.454330+0000","last_peered":"2023-09-30T13:54:54.454330+0000","last_clean":"2023-09-30T13:54:54.454330+0000","last_became_active":"2023-09-30T13:54:50.410418+0000","last_became_peered":"2023-09-30T13:54:50.410418+0000","last_unstale":"2023-09-30T13:54:54.454330+0000","last_undegraded":"2023-09-30T13:54:54.454330+0000","last_fullsized":"2023-09-30T13:54:54.454330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447170+0000","last_change":"2023-09-30T13:54:49.422040+0000","last_active":"2023-09-30T13:54:54.447170+0000","last_peered":"2023-09-30T13:54:54.447170+0000","last_clean":"2023-09-30T13:54:54.447170+0000","last_became_active":"2023-09-30T13:54:49.421750+0000","last_became_peered":"2023-09-30T13:54:49.421750+0000","last_unstale":"2023-09-30T13:54:54.447170+0000","last_undegraded":"2023-09-30T13:54:54.447170+0000","last_fullsized":"2023-09-30T13:54:54.447170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395403+0000","last_change":"2023-09-30T13:54:54.461309+0000","last_active":"2023-09-30T13:54:55.395403+0000","last_peered":"2023-09-30T13:54:55.395403+0000","last_clean":"2023-09-30T13:54:55.395403+0000","last_became_active":"2023-09-30T13:54:54.460864+0000","last_became_peered":"2023-09-30T13:54:54.460864+0000","last_unstale":"2023-09-30T13:54:55.395403+0000","last_undegraded":"2023-09-30T13:54:55.395403+0000","last_fullsized":"2023-09-30T13:54:55.395403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:02.815628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441932+0000","last_change":"2023-09-30T13:54:50.412240+0000","last_active":"2023-09-30T13:54:54.441932+0000","last_peered":"2023-09-30T13:54:54.441932+0000","last_clean":"2023-09-30T13:54:54.441932+0000","last_became_active":"2023-09-30T13:54:50.411943+0000","last_became_peered":"2023-09-30T13:54:50.411943+0000","last_unstale":"2023-09-30T13:54:54.441932+0000","last_undegraded":"2023-09-30T13:54:54.441932+0000","last_fullsized":"2023-09-30T13:54:54.441932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439918+0000","last_change":"2023-09-30T13:54:49.416854+0000","last_active":"2023-09-30T13:54:54.439918+0000","last_peered":"2023-09-30T13:54:54.439918+0000","last_clean":"2023-09-30T13:54:54.439918+0000","last_became_active":"2023-09-30T13:54:49.416581+0000","last_became_peered":"2023-09-30T13:54:49.416581+0000","last_unstale":"2023-09-30T13:54:54.439918+0000","last_undegraded":"2023-09-30T13:54:54.439918+0000","last_fullsized":"2023-09-30T13:54:54.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394833+0000","last_change":"2023-09-30T13:54:54.462965+0000","last_active":"2023-09-30T13:54:55.394833+0000","last_peered":"2023-09-30T13:54:55.394833+0000","last_clean":"2023-09-30T13:54:55.394833+0000","last_became_active":"2023-09-30T13:54:54.462601+0000","last_became_peered":"2023-09-30T13:54:54.462601+0000","last_unstale":"2023-09-30T13:54:55.394833+0000","last_undegraded":"2023-09-30T13:54:55.394833+0000","last_fullsized":"2023-09-30T13:54:55.394833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:43:37.820526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439588+0000","last_change":"2023-09-30T13:54:50.408191+0000","last_active":"2023-09-30T13:54:54.439588+0000","last_peered":"2023-09-30T13:54:54.439588+0000","last_clean":"2023-09-30T13:54:54.439588+0000","last_became_active":"2023-09-30T13:54:50.407941+0000","last_became_peered":"2023-09-30T13:54:50.407941+0000","last_unstale":"2023-09-30T13:54:54.439588+0000","last_undegraded":"2023-09-30T13:54:54.439588+0000","last_fullsized":"2023-09-30T13:54:54.439588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458784+0000","last_change":"2023-09-30T13:54:49.425042+0000","last_active":"2023-09-30T13:54:54.458784+0000","last_peered":"2023-09-30T13:54:54.458784+0000","last_clean":"2023-09-30T13:54:54.458784+0000","last_became_active":"2023-09-30T13:54:49.424790+0000","last_became_peered":"2023-09-30T13:54:49.424790+0000","last_unstale":"2023-09-30T13:54:54.458784+0000","last_undegraded":"2023-09-30T13:54:54.458784+0000","last_fullsized":"2023-09-30T13:54:54.458784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555303+0000","last_change":"2023-09-30T13:54:54.466551+0000","last_active":"2023-09-30T13:54:55.555303+0000","last_peered":"2023-09-30T13:54:55.555303+0000","last_clean":"2023-09-30T13:54:55.555303+0000","last_became_active":"2023-09-30T13:54:54.464011+0000","last_became_peered":"2023-09-30T13:54:54.464011+0000","last_unstale":"2023-09-30T13:54:55.555303+0000","last_undegraded":"2023-09-30T13:54:55.555303+0000","last_fullsized":"2023-09-30T13:54:55.555303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450488+0000","last_change":"2023-09-30T13:54:50.415029+0000","last_active":"2023-09-30T13:54:54.450488+0000","last_peered":"2023-09-30T13:54:54.450488+0000","last_clean":"2023-09-30T13:54:54.450488+0000","last_became_active":"2023-09-30T13:54:50.414756+0000","last_became_peered":"2023-09-30T13:54:50.414756+0000","last_unstale":"2023-09-30T13:54:54.450488+0000","last_undegraded":"2023-09-30T13:54:54.450488+0000","last_fullsized":"2023-09-30T13:54:54.450488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439678+0000","last_change":"2023-09-30T13:54:49.421098+0000","last_active":"2023-09-30T13:54:54.439678+0000","last_peered":"2023-09-30T13:54:54.439678+0000","last_clean":"2023-09-30T13:54:54.439678+0000","last_became_active":"2023-09-30T13:54:49.420826+0000","last_became_peered":"2023-09-30T13:54:49.420826+0000","last_unstale":"2023-09-30T13:54:54.439678+0000","last_undegraded":"2023-09-30T13:54:54.439678+0000","last_fullsized":"2023-09-30T13:54:54.439678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555580+0000","last_change":"2023-09-30T13:54:54.460534+0000","last_active":"2023-09-30T13:54:55.555580+0000","last_peered":"2023-09-30T13:54:55.555580+0000","last_clean":"2023-09-30T13:54:55.555580+0000","last_became_active":"2023-09-30T13:54:54.459808+0000","last_became_peered":"2023-09-30T13:54:54.459808+0000","last_unstale":"2023-09-30T13:54:55.555580+0000","last_undegraded":"2023-09-30T13:54:55.555580+0000","last_fullsized":"2023-09-30T13:54:55.555580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443004+0000","last_change":"2023-09-30T13:54:50.409280+0000","last_active":"2023-09-30T13:54:54.443004+0000","last_peered":"2023-09-30T13:54:54.443004+0000","last_clean":"2023-09-30T13:54:54.443004+0000","last_became_active":"2023-09-30T13:54:50.408982+0000","last_became_peered":"2023-09-30T13:54:50.408982+0000","last_unstale":"2023-09-30T13:54:54.443004+0000","last_undegraded":"2023-09-30T13:54:54.443004+0000","last_fullsized":"2023-09-30T13:54:54.443004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:04.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449516+0000","last_change":"2023-09-30T13:54:49.426134+0000","last_active":"2023-09-30T13:54:54.449516+0000","last_peered":"2023-09-30T13:54:54.449516+0000","last_clean":"2023-09-30T13:54:54.449516+0000","last_became_active":"2023-09-30T13:54:49.425836+0000","last_became_peered":"2023-09-30T13:54:49.425836+0000","last_unstale":"2023-09-30T13:54:54.449516+0000","last_undegraded":"2023-09-30T13:54:54.449516+0000","last_fullsized":"2023-09-30T13:54:54.449516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:09.783758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556338+0000","last_change":"2023-09-30T13:54:54.455762+0000","last_active":"2023-09-30T13:54:55.556338+0000","last_peered":"2023-09-30T13:54:55.556338+0000","last_clean":"2023-09-30T13:54:55.556338+0000","last_became_active":"2023-09-30T13:54:54.455325+0000","last_became_peered":"2023-09-30T13:54:54.455325+0000","last_unstale":"2023-09-30T13:54:55.556338+0000","last_undegraded":"2023-09-30T13:54:55.556338+0000","last_fullsized":"2023-09-30T13:54:55.556338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439147+0000","last_change":"2023-09-30T13:54:50.408742+0000","last_active":"2023-09-30T13:54:54.439147+0000","last_peered":"2023-09-30T13:54:54.439147+0000","last_clean":"2023-09-30T13:54:54.439147+0000","last_became_active":"2023-09-30T13:54:50.408453+0000","last_became_peered":"2023-09-30T13:54:50.408453+0000","last_unstale":"2023-09-30T13:54:54.439147+0000","last_undegraded":"2023-09-30T13:54:54.439147+0000","last_fullsized":"2023-09-30T13:54:54.439147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448390+0000","last_change":"2023-09-30T13:54:49.421234+0000","last_active":"2023-09-30T13:54:54.448390+0000","last_peered":"2023-09-30T13:54:54.448390+0000","last_clean":"2023-09-30T13:54:54.448390+0000","last_became_active":"2023-09-30T13:54:49.420950+0000","last_became_peered":"2023-09-30T13:54:49.420950+0000","last_unstale":"2023-09-30T13:54:54.448390+0000","last_undegraded":"2023-09-30T13:54:54.448390+0000","last_fullsized":"2023-09-30T13:54:54.448390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556539+0000","last_change":"2023-09-30T13:54:54.462900+0000","last_active":"2023-09-30T13:54:55.556539+0000","last_peered":"2023-09-30T13:54:55.556539+0000","last_clean":"2023-09-30T13:54:55.556539+0000","last_became_active":"2023-09-30T13:54:54.459241+0000","last_became_peered":"2023-09-30T13:54:54.459241+0000","last_unstale":"2023-09-30T13:54:55.556539+0000","last_undegraded":"2023-09-30T13:54:55.556539+0000","last_fullsized":"2023-09-30T13:54:55.556539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453782+0000","last_change":"2023-09-30T13:54:50.405590+0000","last_active":"2023-09-30T13:54:54.453782+0000","last_peered":"2023-09-30T13:54:54.453782+0000","last_clean":"2023-09-30T13:54:54.453782+0000","last_became_active":"2023-09-30T13:54:50.405266+0000","last_became_peered":"2023-09-30T13:54:50.405266+0000","last_unstale":"2023-09-30T13:54:54.453782+0000","last_undegraded":"2023-09-30T13:54:54.453782+0000","last_fullsized":"2023-09-30T13:54:54.453782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457949+0000","last_change":"2023-09-30T13:54:49.424227+0000","last_active":"2023-09-30T13:54:54.457949+0000","last_peered":"2023-09-30T13:54:54.457949+0000","last_clean":"2023-09-30T13:54:54.457949+0000","last_became_active":"2023-09-30T13:54:49.423939+0000","last_became_peered":"2023-09-30T13:54:49.423939+0000","last_unstale":"2023-09-30T13:54:54.457949+0000","last_undegraded":"2023-09-30T13:54:54.457949+0000","last_fullsized":"2023-09-30T13:54:54.457949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:20.159794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555733+0000","last_change":"2023-09-30T13:54:54.463551+0000","last_active":"2023-09-30T13:54:55.555733+0000","last_peered":"2023-09-30T13:54:55.555733+0000","last_clean":"2023-09-30T13:54:55.555733+0000","last_became_active":"2023-09-30T13:54:54.463125+0000","last_became_peered":"2023-09-30T13:54:54.463125+0000","last_unstale":"2023-09-30T13:54:55.555733+0000","last_undegraded":"2023-09-30T13:54:55.555733+0000","last_fullsized":"2023-09-30T13:54:55.555733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440199+0000","last_change":"2023-09-30T13:54:50.410239+0000","last_active":"2023-09-30T13:54:54.440199+0000","last_peered":"2023-09-30T13:54:54.440199+0000","last_clean":"2023-09-30T13:54:54.440199+0000","last_became_active":"2023-09-30T13:54:50.409936+0000","last_became_peered":"2023-09-30T13:54:50.409936+0000","last_unstale":"2023-09-30T13:54:54.440199+0000","last_undegraded":"2023-09-30T13:54:54.440199+0000","last_fullsized":"2023-09-30T13:54:54.440199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448279+0000","last_change":"2023-09-30T13:54:49.419889+0000","last_active":"2023-09-30T13:54:54.448279+0000","last_peered":"2023-09-30T13:54:54.448279+0000","last_clean":"2023-09-30T13:54:54.448279+0000","last_became_active":"2023-09-30T13:54:49.419588+0000","last_became_peered":"2023-09-30T13:54:49.419588+0000","last_unstale":"2023-09-30T13:54:54.448279+0000","last_undegraded":"2023-09-30T13:54:54.448279+0000","last_fullsized":"2023-09-30T13:54:54.448279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:38.191440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458057+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:54:54.458057+0000","last_peered":"2023-09-30T13:54:54.458057+0000","last_clean":"2023-09-30T13:54:54.458057+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:54:54.458057+0000","last_undegraded":"2023-09-30T13:54:54.458057+0000","last_fullsized":"2023-09-30T13:54:54.458057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420181+0000","last_change":"2023-09-30T13:54:54.461747+0000","last_active":"2023-09-30T13:54:55.420181+0000","last_peered":"2023-09-30T13:54:55.420181+0000","last_clean":"2023-09-30T13:54:55.420181+0000","last_became_active":"2023-09-30T13:54:54.461313+0000","last_became_peered":"2023-09-30T13:54:54.461313+0000","last_unstale":"2023-09-30T13:54:55.420181+0000","last_undegraded":"2023-09-30T13:54:55.420181+0000","last_fullsized":"2023-09-30T13:54:55.420181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458578+0000","last_change":"2023-09-30T13:54:50.416311+0000","last_active":"2023-09-30T13:54:54.458578+0000","last_peered":"2023-09-30T13:54:54.458578+0000","last_clean":"2023-09-30T13:54:54.458578+0000","last_became_active":"2023-09-30T13:54:50.415316+0000","last_became_peered":"2023-09-30T13:54:50.415316+0000","last_unstale":"2023-09-30T13:54:54.458578+0000","last_undegraded":"2023-09-30T13:54:54.458578+0000","last_fullsized":"2023-09-30T13:54:54.458578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449816+0000","last_change":"2023-09-30T13:54:49.423309+0000","last_active":"2023-09-30T13:54:54.449816+0000","last_peered":"2023-09-30T13:54:54.449816+0000","last_clean":"2023-09-30T13:54:54.449816+0000","last_became_active":"2023-09-30T13:54:49.423038+0000","last_became_peered":"2023-09-30T13:54:49.423038+0000","last_unstale":"2023-09-30T13:54:54.449816+0000","last_undegraded":"2023-09-30T13:54:54.449816+0000","last_fullsized":"2023-09-30T13:54:54.449816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.419816+0000","last_change":"2023-09-30T13:54:54.461245+0000","last_active":"2023-09-30T13:54:55.419816+0000","last_peered":"2023-09-30T13:54:55.419816+0000","last_clean":"2023-09-30T13:54:55.419816+0000","last_became_active":"2023-09-30T13:54:54.460850+0000","last_became_peered":"2023-09-30T13:54:54.460850+0000","last_unstale":"2023-09-30T13:54:55.419816+0000","last_undegraded":"2023-09-30T13:54:55.419816+0000","last_fullsized":"2023-09-30T13:54:55.419816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450189+0000","last_change":"2023-09-30T13:54:50.415242+0000","last_active":"2023-09-30T13:54:54.450189+0000","last_peered":"2023-09-30T13:54:54.450189+0000","last_clean":"2023-09-30T13:54:54.450189+0000","last_became_active":"2023-09-30T13:54:50.414966+0000","last_became_peered":"2023-09-30T13:54:50.414966+0000","last_unstale":"2023-09-30T13:54:54.450189+0000","last_undegraded":"2023-09-30T13:54:54.450189+0000","last_fullsized":"2023-09-30T13:54:54.450189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439617+0000","last_change":"2023-09-30T13:54:49.419341+0000","last_active":"2023-09-30T13:54:54.439617+0000","last_peered":"2023-09-30T13:54:54.439617+0000","last_clean":"2023-09-30T13:54:54.439617+0000","last_became_active":"2023-09-30T13:54:49.419064+0000","last_became_peered":"2023-09-30T13:54:49.419064+0000","last_unstale":"2023-09-30T13:54:54.439617+0000","last_undegraded":"2023-09-30T13:54:54.439617+0000","last_fullsized":"2023-09-30T13:54:54.439617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555529+0000","last_change":"2023-09-30T13:54:54.470669+0000","last_active":"2023-09-30T13:54:55.555529+0000","last_peered":"2023-09-30T13:54:55.555529+0000","last_clean":"2023-09-30T13:54:55.555529+0000","last_became_active":"2023-09-30T13:54:54.470079+0000","last_became_peered":"2023-09-30T13:54:54.470079+0000","last_unstale":"2023-09-30T13:54:55.555529+0000","last_undegraded":"2023-09-30T13:54:55.555529+0000","last_fullsized":"2023-09-30T13:54:55.555529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458977+0000","last_change":"2023-09-30T13:54:50.415862+0000","last_active":"2023-09-30T13:54:54.458977+0000","last_peered":"2023-09-30T13:54:54.458977+0000","last_clean":"2023-09-30T13:54:54.458977+0000","last_became_active":"2023-09-30T13:54:50.415304+0000","last_became_peered":"2023-09-30T13:54:50.415304+0000","last_unstale":"2023-09-30T13:54:54.458977+0000","last_undegraded":"2023-09-30T13:54:54.458977+0000","last_fullsized":"2023-09-30T13:54:54.458977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:43.639609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447671+0000","last_change":"2023-09-30T13:54:49.415340+0000","last_active":"2023-09-30T13:54:54.447671+0000","last_peered":"2023-09-30T13:54:54.447671+0000","last_clean":"2023-09-30T13:54:54.447671+0000","last_became_active":"2023-09-30T13:54:49.415072+0000","last_became_peered":"2023-09-30T13:54:49.415072+0000","last_unstale":"2023-09-30T13:54:54.447671+0000","last_undegraded":"2023-09-30T13:54:54.447671+0000","last_fullsized":"2023-09-30T13:54:54.447671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:14:27.574930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555106+0000","last_change":"2023-09-30T13:54:54.458742+0000","last_active":"2023-09-30T13:54:55.555106+0000","last_peered":"2023-09-30T13:54:55.555106+0000","last_clean":"2023-09-30T13:54:55.555106+0000","last_became_active":"2023-09-30T13:54:54.458302+0000","last_became_peered":"2023-09-30T13:54:54.458302+0000","last_unstale":"2023-09-30T13:54:55.555106+0000","last_undegraded":"2023-09-30T13:54:55.555106+0000","last_fullsized":"2023-09-30T13:54:55.555106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.459145+0000","last_change":"2023-09-30T13:54:50.415857+0000","last_active":"2023-09-30T13:54:54.459145+0000","last_peered":"2023-09-30T13:54:54.459145+0000","last_clean":"2023-09-30T13:54:54.459145+0000","last_became_active":"2023-09-30T13:54:50.415551+0000","last_became_peered":"2023-09-30T13:54:50.415551+0000","last_unstale":"2023-09-30T13:54:54.459145+0000","last_undegraded":"2023-09-30T13:54:54.459145+0000","last_fullsized":"2023-09-30T13:54:54.459145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442277+0000","last_change":"2023-09-30T13:54:49.417788+0000","last_active":"2023-09-30T13:54:54.442277+0000","last_peered":"2023-09-30T13:54:54.442277+0000","last_clean":"2023-09-30T13:54:54.442277+0000","last_became_active":"2023-09-30T13:54:49.417494+0000","last_became_peered":"2023-09-30T13:54:49.417494+0000","last_unstale":"2023-09-30T13:54:54.442277+0000","last_undegraded":"2023-09-30T13:54:54.442277+0000","last_fullsized":"2023-09-30T13:54:54.442277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395085+0000","last_change":"2023-09-30T13:54:54.462891+0000","last_active":"2023-09-30T13:54:55.395085+0000","last_peered":"2023-09-30T13:54:55.395085+0000","last_clean":"2023-09-30T13:54:55.395085+0000","last_became_active":"2023-09-30T13:54:54.461379+0000","last_became_peered":"2023-09-30T13:54:54.461379+0000","last_unstale":"2023-09-30T13:54:55.395085+0000","last_undegraded":"2023-09-30T13:54:55.395085+0000","last_fullsized":"2023-09-30T13:54:55.395085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:43.391644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458032+0000","last_change":"2023-09-30T13:54:50.417980+0000","last_active":"2023-09-30T13:54:54.458032+0000","last_peered":"2023-09-30T13:54:54.458032+0000","last_clean":"2023-09-30T13:54:54.458032+0000","last_became_active":"2023-09-30T13:54:50.417570+0000","last_became_peered":"2023-09-30T13:54:50.417570+0000","last_unstale":"2023-09-30T13:54:54.458032+0000","last_undegraded":"2023-09-30T13:54:54.458032+0000","last_fullsized":"2023-09-30T13:54:54.458032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446933+0000","last_change":"2023-09-30T13:54:49.419847+0000","last_active":"2023-09-30T13:54:54.446933+0000","last_peered":"2023-09-30T13:54:54.446933+0000","last_clean":"2023-09-30T13:54:54.446933+0000","last_became_active":"2023-09-30T13:54:49.419547+0000","last_became_peered":"2023-09-30T13:54:49.419547+0000","last_unstale":"2023-09-30T13:54:54.446933+0000","last_undegraded":"2023-09-30T13:54:54.446933+0000","last_fullsized":"2023-09-30T13:54:54.446933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:59:22.340711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555588+0000","last_change":"2023-09-30T13:54:54.458941+0000","last_active":"2023-09-30T13:54:55.555588+0000","last_peered":"2023-09-30T13:54:55.555588+0000","last_clean":"2023-09-30T13:54:55.555588+0000","last_became_active":"2023-09-30T13:54:54.458230+0000","last_became_peered":"2023-09-30T13:54:54.458230+0000","last_unstale":"2023-09-30T13:54:55.555588+0000","last_undegraded":"2023-09-30T13:54:55.555588+0000","last_fullsized":"2023-09-30T13:54:55.555588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447803+0000","last_change":"2023-09-30T13:54:50.411632+0000","last_active":"2023-09-30T13:54:54.447803+0000","last_peered":"2023-09-30T13:54:54.447803+0000","last_clean":"2023-09-30T13:54:54.447803+0000","last_became_active":"2023-09-30T13:54:50.411281+0000","last_became_peered":"2023-09-30T13:54:50.411281+0000","last_unstale":"2023-09-30T13:54:54.447803+0000","last_undegraded":"2023-09-30T13:54:54.447803+0000","last_fullsized":"2023-09-30T13:54:54.447803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448857+0000","last_change":"2023-09-30T13:54:49.417961+0000","last_active":"2023-09-30T13:54:54.448857+0000","last_peered":"2023-09-30T13:54:54.448857+0000","last_clean":"2023-09-30T13:54:54.448857+0000","last_became_active":"2023-09-30T13:54:49.417131+0000","last_became_peered":"2023-09-30T13:54:49.417131+0000","last_unstale":"2023-09-30T13:54:54.448857+0000","last_undegraded":"2023-09-30T13:54:54.448857+0000","last_fullsized":"2023-09-30T13:54:54.448857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:02.854268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.396016+0000","last_change":"2023-09-30T13:54:54.461774+0000","last_active":"2023-09-30T13:54:55.396016+0000","last_peered":"2023-09-30T13:54:55.396016+0000","last_clean":"2023-09-30T13:54:55.396016+0000","last_became_active":"2023-09-30T13:54:54.461333+0000","last_became_peered":"2023-09-30T13:54:54.461333+0000","last_unstale":"2023-09-30T13:54:55.396016+0000","last_undegraded":"2023-09-30T13:54:55.396016+0000","last_fullsized":"2023-09-30T13:54:55.396016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:07.190629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458382+0000","last_change":"2023-09-30T13:54:50.418751+0000","last_active":"2023-09-30T13:54:54.458382+0000","last_peered":"2023-09-30T13:54:54.458382+0000","last_clean":"2023-09-30T13:54:54.458382+0000","last_became_active":"2023-09-30T13:54:50.418290+0000","last_became_peered":"2023-09-30T13:54:50.418290+0000","last_unstale":"2023-09-30T13:54:54.458382+0000","last_undegraded":"2023-09-30T13:54:54.458382+0000","last_fullsized":"2023-09-30T13:54:54.458382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449427+0000","last_change":"2023-09-30T13:54:49.425647+0000","last_active":"2023-09-30T13:54:54.449427+0000","last_peered":"2023-09-30T13:54:54.449427+0000","last_clean":"2023-09-30T13:54:54.449427+0000","last_became_active":"2023-09-30T13:54:49.425388+0000","last_became_peered":"2023-09-30T13:54:49.425388+0000","last_unstale":"2023-09-30T13:54:54.449427+0000","last_undegraded":"2023-09-30T13:54:54.449427+0000","last_fullsized":"2023-09-30T13:54:54.449427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395641+0000","last_change":"2023-09-30T13:54:54.461862+0000","last_active":"2023-09-30T13:54:55.395641+0000","last_peered":"2023-09-30T13:54:55.395641+0000","last_clean":"2023-09-30T13:54:55.395641+0000","last_became_active":"2023-09-30T13:54:54.461454+0000","last_became_peered":"2023-09-30T13:54:54.461454+0000","last_unstale":"2023-09-30T13:54:55.395641+0000","last_undegraded":"2023-09-30T13:54:55.395641+0000","last_fullsized":"2023-09-30T13:54:55.395641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:41:47.042221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453950+0000","last_change":"2023-09-30T13:54:50.410049+0000","last_active":"2023-09-30T13:54:54.453950+0000","last_peered":"2023-09-30T13:54:54.453950+0000","last_clean":"2023-09-30T13:54:54.453950+0000","last_became_active":"2023-09-30T13:54:50.409797+0000","last_became_peered":"2023-09-30T13:54:50.409797+0000","last_unstale":"2023-09-30T13:54:54.453950+0000","last_undegraded":"2023-09-30T13:54:54.453950+0000","last_fullsized":"2023-09-30T13:54:54.453950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:31.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.455043+0000","last_change":"2023-09-30T13:54:49.419144+0000","last_active":"2023-09-30T13:54:54.455043+0000","last_peered":"2023-09-30T13:54:54.455043+0000","last_clean":"2023-09-30T13:54:54.455043+0000","last_became_active":"2023-09-30T13:54:49.418861+0000","last_became_peered":"2023-09-30T13:54:49.418861+0000","last_unstale":"2023-09-30T13:54:54.455043+0000","last_undegraded":"2023-09-30T13:54:54.455043+0000","last_fullsized":"2023-09-30T13:54:54.455043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555756+0000","last_change":"2023-09-30T13:54:54.461392+0000","last_active":"2023-09-30T13:54:55.555756+0000","last_peered":"2023-09-30T13:54:55.555756+0000","last_clean":"2023-09-30T13:54:55.555756+0000","last_became_active":"2023-09-30T13:54:54.460929+0000","last_became_peered":"2023-09-30T13:54:54.460929+0000","last_unstale":"2023-09-30T13:54:55.555756+0000","last_undegraded":"2023-09-30T13:54:55.555756+0000","last_fullsized":"2023-09-30T13:54:55.555756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458494+0000","last_change":"2023-09-30T13:54:50.416496+0000","last_active":"2023-09-30T13:54:54.458494+0000","last_peered":"2023-09-30T13:54:54.458494+0000","last_clean":"2023-09-30T13:54:54.458494+0000","last_became_active":"2023-09-30T13:54:50.416041+0000","last_became_peered":"2023-09-30T13:54:50.416041+0000","last_unstale":"2023-09-30T13:54:54.458494+0000","last_undegraded":"2023-09-30T13:54:54.458494+0000","last_fullsized":"2023-09-30T13:54:54.458494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:59.971696+0000","last_change":"2023-09-30T13:54:49.424285+0000","last_active":"2023-09-30T13:54:59.971696+0000","last_peered":"2023-09-30T13:54:59.971696+0000","last_clean":"2023-09-30T13:54:59.971696+0000","last_became_active":"2023-09-30T13:54:49.424016+0000","last_became_peered":"2023-09-30T13:54:49.424016+0000","last_unstale":"2023-09-30T13:54:59.971696+0000","last_undegraded":"2023-09-30T13:54:59.971696+0000","last_fullsized":"2023-09-30T13:54:59.971696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555828+0000","last_change":"2023-09-30T13:54:54.460160+0000","last_active":"2023-09-30T13:54:55.555828+0000","last_peered":"2023-09-30T13:54:55.555828+0000","last_clean":"2023-09-30T13:54:55.555828+0000","last_became_active":"2023-09-30T13:54:54.459029+0000","last_became_peered":"2023-09-30T13:54:54.459029+0000","last_unstale":"2023-09-30T13:54:55.555828+0000","last_undegraded":"2023-09-30T13:54:55.555828+0000","last_fullsized":"2023-09-30T13:54:55.555828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443040+0000","last_change":"2023-09-30T13:54:50.415939+0000","last_active":"2023-09-30T13:54:54.443040+0000","last_peered":"2023-09-30T13:54:54.443040+0000","last_clean":"2023-09-30T13:54:54.443040+0000","last_became_active":"2023-09-30T13:54:50.415711+0000","last_became_peered":"2023-09-30T13:54:50.415711+0000","last_unstale":"2023-09-30T13:54:54.443040+0000","last_undegraded":"2023-09-30T13:54:54.443040+0000","last_fullsized":"2023-09-30T13:54:54.443040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439502+0000","last_change":"2023-09-30T13:54:49.421474+0000","last_active":"2023-09-30T13:54:54.439502+0000","last_peered":"2023-09-30T13:54:54.439502+0000","last_clean":"2023-09-30T13:54:54.439502+0000","last_became_active":"2023-09-30T13:54:49.421229+0000","last_became_peered":"2023-09-30T13:54:49.421229+0000","last_unstale":"2023-09-30T13:54:54.439502+0000","last_undegraded":"2023-09-30T13:54:54.439502+0000","last_fullsized":"2023-09-30T13:54:54.439502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395499+0000","last_change":"2023-09-30T13:54:54.462295+0000","last_active":"2023-09-30T13:54:55.395499+0000","last_peered":"2023-09-30T13:54:55.395499+0000","last_clean":"2023-09-30T13:54:55.395499+0000","last_became_active":"2023-09-30T13:54:54.461617+0000","last_became_peered":"2023-09-30T13:54:54.461617+0000","last_unstale":"2023-09-30T13:54:55.395499+0000","last_undegraded":"2023-09-30T13:54:55.395499+0000","last_fullsized":"2023-09-30T13:54:55.395499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:35.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454208+0000","last_change":"2023-09-30T13:54:50.409156+0000","last_active":"2023-09-30T13:54:54.454208+0000","last_peered":"2023-09-30T13:54:54.454208+0000","last_clean":"2023-09-30T13:54:54.454208+0000","last_became_active":"2023-09-30T13:54:50.408875+0000","last_became_peered":"2023-09-30T13:54:50.408875+0000","last_unstale":"2023-09-30T13:54:54.454208+0000","last_undegraded":"2023-09-30T13:54:54.454208+0000","last_fullsized":"2023-09-30T13:54:54.454208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450123+0000","last_change":"2023-09-30T13:54:49.421494+0000","last_active":"2023-09-30T13:54:54.450123+0000","last_peered":"2023-09-30T13:54:54.450123+0000","last_clean":"2023-09-30T13:54:54.450123+0000","last_became_active":"2023-09-30T13:54:49.420772+0000","last_became_peered":"2023-09-30T13:54:49.420772+0000","last_unstale":"2023-09-30T13:54:54.450123+0000","last_undegraded":"2023-09-30T13:54:54.450123+0000","last_fullsized":"2023-09-30T13:54:54.450123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:44.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395038+0000","last_change":"2023-09-30T13:54:54.450703+0000","last_active":"2023-09-30T13:54:55.395038+0000","last_peered":"2023-09-30T13:54:55.395038+0000","last_clean":"2023-09-30T13:54:55.395038+0000","last_became_active":"2023-09-30T13:54:54.450294+0000","last_became_peered":"2023-09-30T13:54:54.450294+0000","last_unstale":"2023-09-30T13:54:55.395038+0000","last_undegraded":"2023-09-30T13:54:55.395038+0000","last_fullsized":"2023-09-30T13:54:55.395038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:04:52.729643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450019+0000","last_change":"2023-09-30T13:54:50.422345+0000","last_active":"2023-09-30T13:54:54.450019+0000","last_peered":"2023-09-30T13:54:54.450019+0000","last_clean":"2023-09-30T13:54:54.450019+0000","last_became_active":"2023-09-30T13:54:50.422097+0000","last_became_peered":"2023-09-30T13:54:50.422097+0000","last_unstale":"2023-09-30T13:54:54.450019+0000","last_undegraded":"2023-09-30T13:54:54.450019+0000","last_fullsized":"2023-09-30T13:54:54.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447068+0000","last_change":"2023-09-30T13:54:49.421580+0000","last_active":"2023-09-30T13:54:54.447068+0000","last_peered":"2023-09-30T13:54:54.447068+0000","last_clean":"2023-09-30T13:54:54.447068+0000","last_became_active":"2023-09-30T13:54:49.421309+0000","last_became_peered":"2023-09-30T13:54:49.421309+0000","last_unstale":"2023-09-30T13:54:54.447068+0000","last_undegraded":"2023-09-30T13:54:54.447068+0000","last_fullsized":"2023-09-30T13:54:54.447068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:17.392031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394992+0000","last_change":"2023-09-30T13:54:54.461962+0000","last_active":"2023-09-30T13:54:55.394992+0000","last_peered":"2023-09-30T13:54:55.394992+0000","last_clean":"2023-09-30T13:54:55.394992+0000","last_became_active":"2023-09-30T13:54:54.461572+0000","last_became_peered":"2023-09-30T13:54:54.461572+0000","last_unstale":"2023-09-30T13:54:55.394992+0000","last_undegraded":"2023-09-30T13:54:55.394992+0000","last_fullsized":"2023-09-30T13:54:55.394992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556083+0000","last_change":"2023-09-30T13:54:54.465345+0000","last_active":"2023-09-30T13:54:55.556083+0000","last_peered":"2023-09-30T13:54:55.556083+0000","last_clean":"2023-09-30T13:54:55.556083+0000","last_became_active":"2023-09-30T13:54:54.464944+0000","last_became_peered":"2023-09-30T13:54:54.464944+0000","last_unstale":"2023-09-30T13:54:55.556083+0000","last_undegraded":"2023-09-30T13:54:55.556083+0000","last_fullsized":"2023-09-30T13:54:55.556083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:22:46.203262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439196+0000","last_change":"2023-09-30T13:54:50.415261+0000","last_active":"2023-09-30T13:54:54.439196+0000","last_peered":"2023-09-30T13:54:54.439196+0000","last_clean":"2023-09-30T13:54:54.439196+0000","last_became_active":"2023-09-30T13:54:50.414934+0000","last_became_peered":"2023-09-30T13:54:50.414934+0000","last_unstale":"2023-09-30T13:54:54.439196+0000","last_undegraded":"2023-09-30T13:54:54.439196+0000","last_fullsized":"2023-09-30T13:54:54.439196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447216+0000","last_change":"2023-09-30T13:54:49.423480+0000","last_active":"2023-09-30T13:54:54.447216+0000","last_peered":"2023-09-30T13:54:54.447216+0000","last_clean":"2023-09-30T13:54:54.447216+0000","last_became_active":"2023-09-30T13:54:49.423220+0000","last_became_peered":"2023-09-30T13:54:49.423220+0000","last_unstale":"2023-09-30T13:54:54.447216+0000","last_undegraded":"2023-09-30T13:54:54.447216+0000","last_fullsized":"2023-09-30T13:54:54.447216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420301+0000","last_change":"2023-09-30T13:54:54.464246+0000","last_active":"2023-09-30T13:54:55.420301+0000","last_peered":"2023-09-30T13:54:55.420301+0000","last_clean":"2023-09-30T13:54:55.420301+0000","last_became_active":"2023-09-30T13:54:54.463379+0000","last_became_peered":"2023-09-30T13:54:54.463379+0000","last_unstale":"2023-09-30T13:54:55.420301+0000","last_undegraded":"2023-09-30T13:54:55.420301+0000","last_fullsized":"2023-09-30T13:54:55.420301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443406+0000","last_change":"2023-09-30T13:54:50.409576+0000","last_active":"2023-09-30T13:54:54.443406+0000","last_peered":"2023-09-30T13:54:54.443406+0000","last_clean":"2023-09-30T13:54:54.443406+0000","last_became_active":"2023-09-30T13:54:50.409205+0000","last_became_peered":"2023-09-30T13:54:50.409205+0000","last_unstale":"2023-09-30T13:54:54.443406+0000","last_undegraded":"2023-09-30T13:54:54.443406+0000","last_fullsized":"2023-09-30T13:54:54.443406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441966+0000","last_change":"2023-09-30T13:54:49.414072+0000","last_active":"2023-09-30T13:54:54.441966+0000","last_peered":"2023-09-30T13:54:54.441966+0000","last_clean":"2023-09-30T13:54:54.441966+0000","last_became_active":"2023-09-30T13:54:49.413795+0000","last_became_peered":"2023-09-30T13:54:49.413795+0000","last_unstale":"2023-09-30T13:54:54.441966+0000","last_undegraded":"2023-09-30T13:54:54.441966+0000","last_fullsized":"2023-09-30T13:54:54.441966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445628+0000","last_change":"2023-09-30T13:54:49.418852+0000","last_active":"2023-09-30T13:54:54.445628+0000","last_peered":"2023-09-30T13:54:54.445628+0000","last_clean":"2023-09-30T13:54:54.445628+0000","last_became_active":"2023-09-30T13:54:49.417214+0000","last_became_peered":"2023-09-30T13:54:49.417214+0000","last_unstale":"2023-09-30T13:54:54.445628+0000","last_undegraded":"2023-09-30T13:54:54.445628+0000","last_fullsized":"2023-09-30T13:54:54.445628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454816+0000","last_change":"2023-09-30T13:54:50.408345+0000","last_active":"2023-09-30T13:54:54.454816+0000","last_peered":"2023-09-30T13:54:54.454816+0000","last_clean":"2023-09-30T13:54:54.454816+0000","last_became_active":"2023-09-30T13:54:50.408060+0000","last_became_peered":"2023-09-30T13:54:50.408060+0000","last_unstale":"2023-09-30T13:54:54.454816+0000","last_undegraded":"2023-09-30T13:54:54.454816+0000","last_fullsized":"2023-09-30T13:54:54.454816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394296+0000","last_change":"2023-09-30T13:54:54.460070+0000","last_active":"2023-09-30T13:54:55.394296+0000","last_peered":"2023-09-30T13:54:55.394296+0000","last_clean":"2023-09-30T13:54:55.394296+0000","last_became_active":"2023-09-30T13:54:54.459607+0000","last_became_peered":"2023-09-30T13:54:54.459607+0000","last_unstale":"2023-09-30T13:54:55.394296+0000","last_undegraded":"2023-09-30T13:54:55.394296+0000","last_fullsized":"2023-09-30T13:54:55.394296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:45.736051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440800+0000","last_change":"2023-09-30T13:54:49.418506+0000","last_active":"2023-09-30T13:54:54.440800+0000","last_peered":"2023-09-30T13:54:54.440800+0000","last_clean":"2023-09-30T13:54:54.440800+0000","last_became_active":"2023-09-30T13:54:49.418247+0000","last_became_peered":"2023-09-30T13:54:49.418247+0000","last_unstale":"2023-09-30T13:54:54.440800+0000","last_undegraded":"2023-09-30T13:54:54.440800+0000","last_fullsized":"2023-09-30T13:54:54.440800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442842+0000","last_change":"2023-09-30T13:54:50.414962+0000","last_active":"2023-09-30T13:54:54.442842+0000","last_peered":"2023-09-30T13:54:54.442842+0000","last_clean":"2023-09-30T13:54:54.442842+0000","last_became_active":"2023-09-30T13:54:50.414716+0000","last_became_peered":"2023-09-30T13:54:50.414716+0000","last_unstale":"2023-09-30T13:54:54.442842+0000","last_undegraded":"2023-09-30T13:54:54.442842+0000","last_fullsized":"2023-09-30T13:54:54.442842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:18.397281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395779+0000","last_change":"2023-09-30T13:54:54.453610+0000","last_active":"2023-09-30T13:54:55.395779+0000","last_peered":"2023-09-30T13:54:55.395779+0000","last_clean":"2023-09-30T13:54:55.395779+0000","last_became_active":"2023-09-30T13:54:54.453208+0000","last_became_peered":"2023-09-30T13:54:54.453208+0000","last_unstale":"2023-09-30T13:54:55.395779+0000","last_undegraded":"2023-09-30T13:54:55.395779+0000","last_fullsized":"2023-09-30T13:54:55.395779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:16:46.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447707+0000","last_change":"2023-09-30T13:54:50.413789+0000","last_active":"2023-09-30T13:54:54.447707+0000","last_peered":"2023-09-30T13:54:54.447707+0000","last_clean":"2023-09-30T13:54:54.447707+0000","last_became_active":"2023-09-30T13:54:50.413515+0000","last_became_peered":"2023-09-30T13:54:50.413515+0000","last_unstale":"2023-09-30T13:54:54.447707+0000","last_undegraded":"2023-09-30T13:54:54.447707+0000","last_fullsized":"2023-09-30T13:54:54.447707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446862+0000","last_change":"2023-09-30T13:54:50.407643+0000","last_active":"2023-09-30T13:54:54.446862+0000","last_peered":"2023-09-30T13:54:54.446862+0000","last_clean":"2023-09-30T13:54:54.446862+0000","last_became_active":"2023-09-30T13:54:50.407392+0000","last_became_peered":"2023-09-30T13:54:50.407392+0000","last_unstale":"2023-09-30T13:54:54.446862+0000","last_undegraded":"2023-09-30T13:54:54.446862+0000","last_fullsized":"2023-09-30T13:54:54.446862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449338+0000","last_change":"2023-09-30T13:54:50.417249+0000","last_active":"2023-09-30T13:54:54.449338+0000","last_peered":"2023-09-30T13:54:54.449338+0000","last_clean":"2023-09-30T13:54:54.449338+0000","last_became_active":"2023-09-30T13:54:50.416968+0000","last_became_peered":"2023-09-30T13:54:50.416968+0000","last_unstale":"2023-09-30T13:54:54.449338+0000","last_undegraded":"2023-09-30T13:54:54.449338+0000","last_fullsized":"2023-09-30T13:54:54.449338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454724+0000","last_change":"2023-09-30T13:54:50.414645+0000","last_active":"2023-09-30T13:54:54.454724+0000","last_peered":"2023-09-30T13:54:54.454724+0000","last_clean":"2023-09-30T13:54:54.454724+0000","last_became_active":"2023-09-30T13:54:50.414355+0000","last_became_peered":"2023-09-30T13:54:50.414355+0000","last_unstale":"2023-09-30T13:54:54.454724+0000","last_undegraded":"2023-09-30T13:54:54.454724+0000","last_fullsized":"2023-09-30T13:54:54.454724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442101+0000","last_change":"2023-09-30T13:54:50.400252+0000","last_active":"2023-09-30T13:54:54.442101+0000","last_peered":"2023-09-30T13:54:54.442101+0000","last_clean":"2023-09-30T13:54:54.442101+0000","last_became_active":"2023-09-30T13:54:50.399917+0000","last_became_peered":"2023-09-30T13:54:50.399917+0000","last_unstale":"2023-09-30T13:54:54.442101+0000","last_undegraded":"2023-09-30T13:54:54.442101+0000","last_fullsized":"2023-09-30T13:54:54.442101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439388+0000","last_change":"2023-09-30T13:54:50.414491+0000","last_active":"2023-09-30T13:54:54.439388+0000","last_peered":"2023-09-30T13:54:54.439388+0000","last_clean":"2023-09-30T13:54:54.439388+0000","last_became_active":"2023-09-30T13:54:50.414221+0000","last_became_peered":"2023-09-30T13:54:50.414221+0000","last_unstale":"2023-09-30T13:54:54.439388+0000","last_undegraded":"2023-09-30T13:54:54.439388+0000","last_fullsized":"2023-09-30T13:54:54.439388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446932+0000","last_change":"2023-09-30T13:54:50.413491+0000","last_active":"2023-09-30T13:54:54.446932+0000","last_peered":"2023-09-30T13:54:54.446932+0000","last_clean":"2023-09-30T13:54:54.446932+0000","last_became_active":"2023-09-30T13:54:50.413226+0000","last_became_peered":"2023-09-30T13:54:50.413226+0000","last_unstale":"2023-09-30T13:54:54.446932+0000","last_undegraded":"2023-09-30T13:54:54.446932+0000","last_fullsized":"2023-09-30T13:54:54.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441831+0000","last_change":"2023-09-30T13:54:50.399450+0000","last_active":"2023-09-30T13:54:54.441831+0000","last_peered":"2023-09-30T13:54:54.441831+0000","last_clean":"2023-09-30T13:54:54.441831+0000","last_became_active":"2023-09-30T13:54:50.399129+0000","last_became_peered":"2023-09-30T13:54:50.399129+0000","last_unstale":"2023-09-30T13:54:54.441831+0000","last_undegraded":"2023-09-30T13:54:54.441831+0000","last_fullsized":"2023-09-30T13:54:54.441831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447123+0000","last_change":"2023-09-30T13:54:50.416017+0000","last_active":"2023-09-30T13:54:54.447123+0000","last_peered":"2023-09-30T13:54:54.447123+0000","last_clean":"2023-09-30T13:54:54.447123+0000","last_became_active":"2023-09-30T13:54:50.415769+0000","last_became_peered":"2023-09-30T13:54:50.415769+0000","last_unstale":"2023-09-30T13:54:54.447123+0000","last_undegraded":"2023-09-30T13:54:54.447123+0000","last_fullsized":"2023-09-30T13:54:54.447123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441869+0000","last_change":"2023-09-30T13:54:50.401717+0000","last_active":"2023-09-30T13:54:54.441869+0000","last_peered":"2023-09-30T13:54:54.441869+0000","last_clean":"2023-09-30T13:54:54.441869+0000","last_became_active":"2023-09-30T13:54:50.401384+0000","last_became_peered":"2023-09-30T13:54:50.401384+0000","last_unstale":"2023-09-30T13:54:54.441869+0000","last_undegraded":"2023-09-30T13:54:54.441869+0000","last_fullsized":"2023-09-30T13:54:54.441869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449251+0000","last_change":"2023-09-30T13:54:50.423066+0000","last_active":"2023-09-30T13:54:54.449251+0000","last_peered":"2023-09-30T13:54:54.449251+0000","last_clean":"2023-09-30T13:54:54.449251+0000","last_became_active":"2023-09-30T13:54:50.422797+0000","last_became_peered":"2023-09-30T13:54:50.422797+0000","last_unstale":"2023-09-30T13:54:54.449251+0000","last_undegraded":"2023-09-30T13:54:54.449251+0000","last_fullsized":"2023-09-30T13:54:54.449251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454616+0000","last_change":"2023-09-30T13:54:50.412413+0000","last_active":"2023-09-30T13:54:54.454616+0000","last_peered":"2023-09-30T13:54:54.454616+0000","last_clean":"2023-09-30T13:54:54.454616+0000","last_became_active":"2023-09-30T13:54:50.412107+0000","last_became_peered":"2023-09-30T13:54:50.412107+0000","last_unstale":"2023-09-30T13:54:54.454616+0000","last_undegraded":"2023-09-30T13:54:54.454616+0000","last_fullsized":"2023-09-30T13:54:54.454616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446754+0000","last_change":"2023-09-30T13:54:50.417833+0000","last_active":"2023-09-30T13:54:54.446754+0000","last_peered":"2023-09-30T13:54:54.446754+0000","last_clean":"2023-09-30T13:54:54.446754+0000","last_became_active":"2023-09-30T13:54:50.417525+0000","last_became_peered":"2023-09-30T13:54:50.417525+0000","last_unstale":"2023-09-30T13:54:54.446754+0000","last_undegraded":"2023-09-30T13:54:54.446754+0000","last_fullsized":"2023-09-30T13:54:54.446754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458795+0000","last_change":"2023-09-30T13:54:50.412766+0000","last_active":"2023-09-30T13:54:54.458795+0000","last_peered":"2023-09-30T13:54:54.458795+0000","last_clean":"2023-09-30T13:54:54.458795+0000","last_became_active":"2023-09-30T13:54:50.412502+0000","last_became_peered":"2023-09-30T13:54:50.412502+0000","last_unstale":"2023-09-30T13:54:54.458795+0000","last_undegraded":"2023-09-30T13:54:54.458795+0000","last_fullsized":"2023-09-30T13:54:54.458795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447122+0000","last_change":"2023-09-30T13:54:50.408372+0000","last_active":"2023-09-30T13:54:54.447122+0000","last_peered":"2023-09-30T13:54:54.447122+0000","last_clean":"2023-09-30T13:54:54.447122+0000","last_became_active":"2023-09-30T13:54:50.408111+0000","last_became_peered":"2023-09-30T13:54:50.408111+0000","last_unstale":"2023-09-30T13:54:54.447122+0000","last_undegraded":"2023-09-30T13:54:54.447122+0000","last_fullsized":"2023-09-30T13:54:54.447122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450494+0000","last_change":"2023-09-30T13:54:50.418485+0000","last_active":"2023-09-30T13:54:54.450494+0000","last_peered":"2023-09-30T13:54:54.450494+0000","last_clean":"2023-09-30T13:54:54.450494+0000","last_became_active":"2023-09-30T13:54:50.417771+0000","last_became_peered":"2023-09-30T13:54:50.417771+0000","last_unstale":"2023-09-30T13:54:54.450494+0000","last_undegraded":"2023-09-30T13:54:54.450494+0000","last_fullsized":"2023-09-30T13:54:54.450494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446955+0000","last_change":"2023-09-30T13:54:50.410885+0000","last_active":"2023-09-30T13:54:54.446955+0000","last_peered":"2023-09-30T13:54:54.446955+0000","last_clean":"2023-09-30T13:54:54.446955+0000","last_became_active":"2023-09-30T13:54:50.410590+0000","last_became_peered":"2023-09-30T13:54:50.410590+0000","last_unstale":"2023-09-30T13:54:54.446955+0000","last_undegraded":"2023-09-30T13:54:54.446955+0000","last_fullsized":"2023-09-30T13:54:54.446955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439246+0000","last_change":"2023-09-30T13:54:50.415957+0000","last_active":"2023-09-30T13:54:54.439246+0000","last_peered":"2023-09-30T13:54:54.439246+0000","last_clean":"2023-09-30T13:54:54.439246+0000","last_became_active":"2023-09-30T13:54:50.415634+0000","last_became_peered":"2023-09-30T13:54:50.415634+0000","last_unstale":"2023-09-30T13:54:54.439246+0000","last_undegraded":"2023-09-30T13:54:54.439246+0000","last_fullsized":"2023-09-30T13:54:54.439246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453850+0000","last_change":"2023-09-30T13:54:50.411326+0000","last_active":"2023-09-30T13:54:54.453850+0000","last_peered":"2023-09-30T13:54:54.453850+0000","last_clean":"2023-09-30T13:54:54.453850+0000","last_became_active":"2023-09-30T13:54:50.410982+0000","last_became_peered":"2023-09-30T13:54:50.410982+0000","last_unstale":"2023-09-30T13:54:54.453850+0000","last_undegraded":"2023-09-30T13:54:54.453850+0000","last_fullsized":"2023-09-30T13:54:54.453850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:41.710382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444714+0000","last_change":"2023-09-30T13:54:50.410846+0000","last_active":"2023-09-30T13:54:54.444714+0000","last_peered":"2023-09-30T13:54:54.444714+0000","last_clean":"2023-09-30T13:54:54.444714+0000","last_became_active":"2023-09-30T13:54:50.410552+0000","last_became_peered":"2023-09-30T13:54:50.410552+0000","last_unstale":"2023-09-30T13:54:54.444714+0000","last_undegraded":"2023-09-30T13:54:54.444714+0000","last_fullsized":"2023-09-30T13:54:54.444714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442982+0000","last_change":"2023-09-30T13:54:50.414413+0000","last_active":"2023-09-30T13:54:54.442982+0000","last_peered":"2023-09-30T13:54:54.442982+0000","last_clean":"2023-09-30T13:54:54.442982+0000","last_became_active":"2023-09-30T13:54:50.413675+0000","last_became_peered":"2023-09-30T13:54:50.413675+0000","last_unstale":"2023-09-30T13:54:54.442982+0000","last_undegraded":"2023-09-30T13:54:54.442982+0000","last_fullsized":"2023-09-30T13:54:54.442982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447232+0000","last_change":"2023-09-30T13:54:50.413676+0000","last_active":"2023-09-30T13:54:54.447232+0000","last_peered":"2023-09-30T13:54:54.447232+0000","last_clean":"2023-09-30T13:54:54.447232+0000","last_became_active":"2023-09-30T13:54:50.412614+0000","last_became_peered":"2023-09-30T13:54:50.412614+0000","last_unstale":"2023-09-30T13:54:54.447232+0000","last_undegraded":"2023-09-30T13:54:54.447232+0000","last_fullsized":"2023-09-30T13:54:54.447232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446834+0000","last_change":"2023-09-30T13:54:50.412729+0000","last_active":"2023-09-30T13:54:54.446834+0000","last_peered":"2023-09-30T13:54:54.446834+0000","last_clean":"2023-09-30T13:54:54.446834+0000","last_became_active":"2023-09-30T13:54:50.412478+0000","last_became_peered":"2023-09-30T13:54:50.412478+0000","last_unstale":"2023-09-30T13:54:54.446834+0000","last_undegraded":"2023-09-30T13:54:54.446834+0000","last_fullsized":"2023-09-30T13:54:54.446834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458895+0000","last_change":"2023-09-30T13:54:50.416012+0000","last_active":"2023-09-30T13:54:54.458895+0000","last_peered":"2023-09-30T13:54:54.458895+0000","last_clean":"2023-09-30T13:54:54.458895+0000","last_became_active":"2023-09-30T13:54:50.414957+0000","last_became_peered":"2023-09-30T13:54:50.414957+0000","last_unstale":"2023-09-30T13:54:54.458895+0000","last_undegraded":"2023-09-30T13:54:54.458895+0000","last_fullsized":"2023-09-30T13:54:54.458895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:54.613251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444109+0000","last_change":"2023-09-30T13:54:50.405513+0000","last_active":"2023-09-30T13:54:54.444109+0000","last_peered":"2023-09-30T13:54:54.444109+0000","last_clean":"2023-09-30T13:54:54.444109+0000","last_became_active":"2023-09-30T13:54:50.404703+0000","last_became_peered":"2023-09-30T13:54:50.404703+0000","last_unstale":"2023-09-30T13:54:54.444109+0000","last_undegraded":"2023-09-30T13:54:54.444109+0000","last_fullsized":"2023-09-30T13:54:54.444109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458099+0000","last_change":"2023-09-30T13:54:50.418187+0000","last_active":"2023-09-30T13:54:54.458099+0000","last_peered":"2023-09-30T13:54:54.458099+0000","last_clean":"2023-09-30T13:54:54.458099+0000","last_became_active":"2023-09-30T13:54:50.417894+0000","last_became_peered":"2023-09-30T13:54:50.417894+0000","last_unstale":"2023-09-30T13:54:54.458099+0000","last_undegraded":"2023-09-30T13:54:54.458099+0000","last_fullsized":"2023-09-30T13:54:54.458099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449166+0000","last_change":"2023-09-30T13:54:50.410069+0000","last_active":"2023-09-30T13:54:54.449166+0000","last_peered":"2023-09-30T13:54:54.449166+0000","last_clean":"2023-09-30T13:54:54.449166+0000","last_became_active":"2023-09-30T13:54:50.409788+0000","last_became_peered":"2023-09-30T13:54:50.409788+0000","last_unstale":"2023-09-30T13:54:54.449166+0000","last_undegraded":"2023-09-30T13:54:54.449166+0000","last_fullsized":"2023-09-30T13:54:54.449166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458341+0000","last_change":"2023-09-30T13:54:50.411521+0000","last_active":"2023-09-30T13:54:54.458341+0000","last_peered":"2023-09-30T13:54:54.458341+0000","last_clean":"2023-09-30T13:54:54.458341+0000","last_became_active":"2023-09-30T13:54:50.411249+0000","last_became_peered":"2023-09-30T13:54:50.411249+0000","last_unstale":"2023-09-30T13:54:54.458341+0000","last_undegraded":"2023-09-30T13:54:54.458341+0000","last_fullsized":"2023-09-30T13:54:54.458341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448866+0000","last_change":"2023-09-30T13:54:50.416620+0000","last_active":"2023-09-30T13:54:54.448866+0000","last_peered":"2023-09-30T13:54:54.448866+0000","last_clean":"2023-09-30T13:54:54.448866+0000","last_became_active":"2023-09-30T13:54:50.416353+0000","last_became_peered":"2023-09-30T13:54:50.416353+0000","last_unstale":"2023-09-30T13:54:54.448866+0000","last_undegraded":"2023-09-30T13:54:54.448866+0000","last_fullsized":"2023-09-30T13:54:54.448866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454120+0000","last_change":"2023-09-30T13:54:50.408896+0000","last_active":"2023-09-30T13:54:54.454120+0000","last_peered":"2023-09-30T13:54:54.454120+0000","last_clean":"2023-09-30T13:54:54.454120+0000","last_became_active":"2023-09-30T13:54:50.407306+0000","last_became_peered":"2023-09-30T13:54:50.407306+0000","last_unstale":"2023-09-30T13:54:54.454120+0000","last_undegraded":"2023-09-30T13:54:54.454120+0000","last_fullsized":"2023-09-30T13:54:54.454120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439826+0000","last_change":"2023-09-30T13:54:50.409514+0000","last_active":"2023-09-30T13:54:54.439826+0000","last_peered":"2023-09-30T13:54:54.439826+0000","last_clean":"2023-09-30T13:54:54.439826+0000","last_became_active":"2023-09-30T13:54:50.409220+0000","last_became_peered":"2023-09-30T13:54:50.409220+0000","last_unstale":"2023-09-30T13:54:54.439826+0000","last_undegraded":"2023-09-30T13:54:54.439826+0000","last_fullsized":"2023-09-30T13:54:54.439826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458792+0000","last_change":"2023-09-30T13:54:50.415599+0000","last_active":"2023-09-30T13:54:54.458792+0000","last_peered":"2023-09-30T13:54:54.458792+0000","last_clean":"2023-09-30T13:54:54.458792+0000","last_became_active":"2023-09-30T13:54:50.414604+0000","last_became_peered":"2023-09-30T13:54:50.414604+0000","last_unstale":"2023-09-30T13:54:54.458792+0000","last_undegraded":"2023-09-30T13:54:54.458792+0000","last_fullsized":"2023-09-30T13:54:54.458792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:55:11.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:55:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.049+0000 7fdb81f0f640 1 Processor -- start 2023-09-30T13:55:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.049+0000 7fdb81f0f640 1 -- start start 2023-09-30T13:55:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb81f0f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdb7c0cdc20 0x7fdb7c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb81f0f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb7c0b2940 0x7fdb7c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb81f0f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0b2e50 con 0x7fdb7c0cef70 2023-09-30T13:55:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb81f0f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0cf400 con 0x7fdb7c0b2940 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb81f0f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0ac2d0 con 0x7fdb7c0cdc20 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb7c0b2940 0x7fdb7c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdb7c0cef70 0x7fdb7c0ab250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46010/0 (socket says 172.21.15.62:46010) 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7bfff640 1 -- 172.21.15.62:0/877870635 learned_addr learned my addr 172.21.15.62:0/877870635 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7b7fe640 1 --2- 172.21.15.62:0/877870635 >> v2:172.21.15.135:3300/0 conn(0x7fdb7c0cdc20 0x7fdb7c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7affd640 1 -- 172.21.15.62:0/877870635 >> v2:172.21.15.135:3300/0 conn(0x7fdb7c0cdc20 msgr2=0x7fdb7c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7affd640 1 --2- 172.21.15.62:0/877870635 >> v2:172.21.15.135:3300/0 conn(0x7fdb7c0cdc20 0x7fdb7c0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7affd640 1 -- 172.21.15.62:0/877870635 >> v1:172.21.15.62:6789/0 conn(0x7fdb7c0cef70 legacy=0x7fdb7c0ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.050+0000 7fdb7a7fc640 1 -- 172.21.15.62:0/877870635 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581890737 0 0) 0x7fdb7c0b2e50 con 0x7fdb7c0cef70 2023-09-30T13:55:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.051+0000 7fdb7affd640 1 -- 172.21.15.62:0/877870635 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0cc340 con 0x7fdb7c0b2940 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.051+0000 7fdb7affd640 1 --2- 172.21.15.62:0/877870635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c0cea30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c06e030 tx=0x7fdb7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a49ce23ddd3659e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.051+0000 7fdb7a7fc640 1 -- 172.21.15.62:0/877870635 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7002e070 con 0x7fdb7c0b2940 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.051+0000 7fdb7a7fc640 1 -- 172.21.15.62:0/877870635 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700315a0 con 0x7fdb7c0b2940 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.051+0000 7fdb7a7fc640 1 -- 172.21.15.62:0/877870635 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70031930 con 0x7fdb7c0b2940 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 -- 172.21.15.62:0/877870635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 msgr2=0x7fdb7c0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/877870635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c0cea30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c06e030 tx=0x7fdb7002b840 comp rx=0 tx=0).stop 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 -- 172.21.15.62:0/877870635 shutdown_connections 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/877870635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c0cea30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/877870635 >> v2:172.21.15.135:3300/0 conn(0x7fdb7c0cdc20 0x7fdb7c0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 -- 172.21.15.62:0/877870635 >> 172.21.15.62:0/877870635 conn(0x7fdb7c06a170 msgr2=0x7fdb7c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 -- 172.21.15.62:0/877870635 shutdown_connections 2023-09-30T13:55:12.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.052+0000 7fdb81f0f640 1 -- 172.21.15.62:0/877870635 wait complete. 2023-09-30T13:55:12.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.053+0000 7fdb81f0f640 1 Processor -- start 2023-09-30T13:55:12.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.053+0000 7fdb81f0f640 1 -- start start 2023-09-30T13:55:12.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 0x7fdb7c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb7c0cef70 0x7fdb7c1f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1f3310 con 0x7fdb7c0b2940 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c6660 con 0x7fdb7c0cdc20 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb81f0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1f2790 con 0x7fdb7c0cef70 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39566/0 (socket says 172.21.15.62:39566) 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7b7fe640 1 -- 172.21.15.62:0/534998511 learned_addr learned my addr 172.21.15.62:0/534998511 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7affd640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 0x7fdb7c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7b7fe640 1 -- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb7c0cef70 msgr2=0x7fdb7c1f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.054+0000 7fdb7bfff640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb7c0cef70 0x7fdb7c1f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7b7fe640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb7c0cef70 0x7fdb7c1f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7b7fe640 1 -- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 msgr2=0x7fdb7c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7b7fe640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 0x7fdb7c0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7b7fe640 1 -- 172.21.15.62:0/534998511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009400 con 0x7fdb7c0b2940 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7affd640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 0x7fdb7c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb7b7fe640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e900 tx=0x7fdb6c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c009660 con 0x7fdb7c0b2940 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00ca00 con 0x7fdb7c0b2940 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c1f2a70 con 0x7fdb7c0b2940 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00cd70 con 0x7fdb7c0b2940 2023-09-30T13:55:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.055+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c1f3030 con 0x7fdb7c0b2940 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.056+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c04e0d0 con 0x7fdb7c0b2940 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.056+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdb6c013470 con 0x7fdb7c0b2940 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.057+0000 7fdb63fff640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 0x7fdb6806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.057+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb6c089b10 con 0x7fdb7c0b2940 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.057+0000 7fdb7affd640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 0x7fdb6806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.058+0000 7fdb7affd640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 0x7fdb6806cff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb7003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.061+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fdb6c054a70 con 0x7fdb7c0b2940 2023-09-30T13:55:12.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.236+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb7c0cc900 con 0x7fdb6806ab30 2023-09-30T13:55:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.245+0000 7fdb63fff640 1 -- 172.21.15.62:0/534998511 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345296 (secure 0 0 0) 0x7fdb70031ae0 con 0x7fdb6806ab30 2023-09-30T13:55:12.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:12.251 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:55:12.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 msgr2=0x7fdb6806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 0x7fdb6806cff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb7003d040 comp rx=0 tx=0).stop 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 msgr2=0x7fdb7c09bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e900 tx=0x7fdb6c00edc0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 shutdown_connections 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb6806ab30 0x7fdb6806cff0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb7c0cef70 0x7fdb7c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb7c0cdc20 0x7fdb7c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 --2- 172.21.15.62:0/534998511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7c0b2940 0x7fdb7c09bd80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 >> 172.21.15.62:0/534998511 conn(0x7fdb7c06a170 msgr2=0x7fdb7c06a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 shutdown_connections 2023-09-30T13:55:12.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.249+0000 7fdb81f0f640 1 -- 172.21.15.62:0/534998511 wait complete. 2023-09-30T13:55:12.260 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-09-30T13:55:11.678019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003755"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454383+0000","last_change":"2023-09-30T13:54:49.420957+0000","last_active":"2023-09-30T13:54:54.454383+0000","last_peered":"2023-09-30T13:54:54.454383+0000","last_clean":"2023-09-30T13:54:54.454383+0000","last_became_active":"2023-09-30T13:54:49.420645+0000","last_became_peered":"2023-09-30T13:54:49.420645+0000","last_unstale":"2023-09-30T13:54:54.454383+0000","last_undegraded":"2023-09-30T13:54:54.454383+0000","last_fullsized":"2023-09-30T13:54:54.454383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440525+0000","last_change":"2023-09-30T13:54:50.403409+0000","last_active":"2023-09-30T13:54:54.440525+0000","last_peered":"2023-09-30T13:54:54.440525+0000","last_clean":"2023-09-30T13:54:54.440525+0000","last_became_active":"2023-09-30T13:54:50.403080+0000","last_became_peered":"2023-09-30T13:54:50.403080+0000","last_unstale":"2023-09-30T13:54:54.440525+0000","last_undegraded":"2023-09-30T13:54:54.440525+0000","last_fullsized":"2023-09-30T13:54:54.440525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394904+0000","last_change":"2023-09-30T13:54:54.461252+0000","last_active":"2023-09-30T13:54:55.394904+0000","last_peered":"2023-09-30T13:54:55.394904+0000","last_clean":"2023-09-30T13:54:55.394904+0000","last_became_active":"2023-09-30T13:54:54.460732+0000","last_became_peered":"2023-09-30T13:54:54.460732+0000","last_unstale":"2023-09-30T13:54:55.394904+0000","last_undegraded":"2023-09-30T13:54:55.394904+0000","last_fullsized":"2023-09-30T13:54:55.394904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440632+0000","last_change":"2023-09-30T13:54:49.417394+0000","last_active":"2023-09-30T13:54:54.440632+0000","last_peered":"2023-09-30T13:54:54.440632+0000","last_clean":"2023-09-30T13:54:54.440632+0000","last_became_active":"2023-09-30T13:54:49.417129+0000","last_became_peered":"2023-09-30T13:54:49.417129+0000","last_unstale":"2023-09-30T13:54:54.440632+0000","last_undegraded":"2023-09-30T13:54:54.440632+0000","last_fullsized":"2023-09-30T13:54:54.440632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454087+0000","last_change":"2023-09-30T13:54:50.412921+0000","last_active":"2023-09-30T13:54:54.454087+0000","last_peered":"2023-09-30T13:54:54.454087+0000","last_clean":"2023-09-30T13:54:54.454087+0000","last_became_active":"2023-09-30T13:54:50.412639+0000","last_became_peered":"2023-09-30T13:54:50.412639+0000","last_unstale":"2023-09-30T13:54:54.454087+0000","last_undegraded":"2023-09-30T13:54:54.454087+0000","last_fullsized":"2023-09-30T13:54:54.454087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395450+0000","last_change":"2023-09-30T13:54:54.451254+0000","last_active":"2023-09-30T13:54:55.395450+0000","last_peered":"2023-09-30T13:54:55.395450+0000","last_clean":"2023-09-30T13:54:55.395450+0000","last_became_active":"2023-09-30T13:54:54.450838+0000","last_became_peered":"2023-09-30T13:54:54.450838+0000","last_unstale":"2023-09-30T13:54:55.395450+0000","last_undegraded":"2023-09-30T13:54:55.395450+0000","last_fullsized":"2023-09-30T13:54:55.395450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:29.042314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458680+0000","last_change":"2023-09-30T13:54:49.419160+0000","last_active":"2023-09-30T13:54:54.458680+0000","last_peered":"2023-09-30T13:54:54.458680+0000","last_clean":"2023-09-30T13:54:54.458680+0000","last_became_active":"2023-09-30T13:54:49.418836+0000","last_became_peered":"2023-09-30T13:54:49.418836+0000","last_unstale":"2023-09-30T13:54:54.458680+0000","last_undegraded":"2023-09-30T13:54:54.458680+0000","last_fullsized":"2023-09-30T13:54:54.458680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450093+0000","last_change":"2023-09-30T13:54:50.412155+0000","last_active":"2023-09-30T13:54:54.450093+0000","last_peered":"2023-09-30T13:54:54.450093+0000","last_clean":"2023-09-30T13:54:54.450093+0000","last_became_active":"2023-09-30T13:54:50.411864+0000","last_became_peered":"2023-09-30T13:54:50.411864+0000","last_unstale":"2023-09-30T13:54:54.450093+0000","last_undegraded":"2023-09-30T13:54:54.450093+0000","last_fullsized":"2023-09-30T13:54:54.450093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395306+0000","last_change":"2023-09-30T13:54:54.462010+0000","last_active":"2023-09-30T13:54:55.395306+0000","last_peered":"2023-09-30T13:54:55.395306+0000","last_clean":"2023-09-30T13:54:55.395306+0000","last_became_active":"2023-09-30T13:54:54.461058+0000","last_became_peered":"2023-09-30T13:54:54.461058+0000","last_unstale":"2023-09-30T13:54:55.395306+0000","last_undegraded":"2023-09-30T13:54:55.395306+0000","last_fullsized":"2023-09-30T13:54:55.395306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:25.190712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458145+0000","last_change":"2023-09-30T13:54:49.427182+0000","last_active":"2023-09-30T13:54:54.458145+0000","last_peered":"2023-09-30T13:54:54.458145+0000","last_clean":"2023-09-30T13:54:54.458145+0000","last_became_active":"2023-09-30T13:54:49.426903+0000","last_became_peered":"2023-09-30T13:54:49.426903+0000","last_unstale":"2023-09-30T13:54:54.458145+0000","last_undegraded":"2023-09-30T13:54:54.458145+0000","last_fullsized":"2023-09-30T13:54:54.458145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:03.302440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450403+0000","last_change":"2023-09-30T13:54:50.417073+0000","last_active":"2023-09-30T13:54:54.450403+0000","last_peered":"2023-09-30T13:54:54.450403+0000","last_clean":"2023-09-30T13:54:54.450403+0000","last_became_active":"2023-09-30T13:54:50.416801+0000","last_became_peered":"2023-09-30T13:54:50.416801+0000","last_unstale":"2023-09-30T13:54:54.450403+0000","last_undegraded":"2023-09-30T13:54:54.450403+0000","last_fullsized":"2023-09-30T13:54:54.450403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395323+0000","last_change":"2023-09-30T13:54:54.458847+0000","last_active":"2023-09-30T13:54:55.395323+0000","last_peered":"2023-09-30T13:54:55.395323+0000","last_clean":"2023-09-30T13:54:55.395323+0000","last_became_active":"2023-09-30T13:54:54.457421+0000","last_became_peered":"2023-09-30T13:54:54.457421+0000","last_unstale":"2023-09-30T13:54:55.395323+0000","last_undegraded":"2023-09-30T13:54:55.395323+0000","last_fullsized":"2023-09-30T13:54:55.395323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:58.531700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445534+0000","last_change":"2023-09-30T13:54:50.421056+0000","last_active":"2023-09-30T13:54:54.445534+0000","last_peered":"2023-09-30T13:54:54.445534+0000","last_clean":"2023-09-30T13:54:54.445534+0000","last_became_active":"2023-09-30T13:54:50.420770+0000","last_became_peered":"2023-09-30T13:54:50.420770+0000","last_unstale":"2023-09-30T13:54:54.445534+0000","last_undegraded":"2023-09-30T13:54:54.445534+0000","last_fullsized":"2023-09-30T13:54:54.445534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458473+0000","last_change":"2023-09-30T13:54:49.422297+0000","last_active":"2023-09-30T13:54:54.458473+0000","last_peered":"2023-09-30T13:54:54.458473+0000","last_clean":"2023-09-30T13:54:54.458473+0000","last_became_active":"2023-09-30T13:54:49.422032+0000","last_became_peered":"2023-09-30T13:54:49.422032+0000","last_unstale":"2023-09-30T13:54:54.458473+0000","last_undegraded":"2023-09-30T13:54:54.458473+0000","last_fullsized":"2023-09-30T13:54:54.458473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395905+0000","last_change":"2023-09-30T13:54:54.456854+0000","last_active":"2023-09-30T13:54:55.395905+0000","last_peered":"2023-09-30T13:54:55.395905+0000","last_clean":"2023-09-30T13:54:55.395905+0000","last_became_active":"2023-09-30T13:54:54.456476+0000","last_became_peered":"2023-09-30T13:54:54.456476+0000","last_unstale":"2023-09-30T13:54:55.395905+0000","last_undegraded":"2023-09-30T13:54:55.395905+0000","last_fullsized":"2023-09-30T13:54:55.395905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:28.802733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440683+0000","last_change":"2023-09-30T13:54:50.410713+0000","last_active":"2023-09-30T13:54:54.440683+0000","last_peered":"2023-09-30T13:54:54.440683+0000","last_clean":"2023-09-30T13:54:54.440683+0000","last_became_active":"2023-09-30T13:54:50.410454+0000","last_became_peered":"2023-09-30T13:54:50.410454+0000","last_unstale":"2023-09-30T13:54:54.440683+0000","last_undegraded":"2023-09-30T13:54:54.440683+0000","last_fullsized":"2023-09-30T13:54:54.440683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442060+0000","last_change":"2023-09-30T13:54:49.415626+0000","last_active":"2023-09-30T13:54:54.442060+0000","last_peered":"2023-09-30T13:54:54.442060+0000","last_clean":"2023-09-30T13:54:54.442060+0000","last_became_active":"2023-09-30T13:54:49.415378+0000","last_became_peered":"2023-09-30T13:54:49.415378+0000","last_unstale":"2023-09-30T13:54:54.442060+0000","last_undegraded":"2023-09-30T13:54:54.442060+0000","last_fullsized":"2023-09-30T13:54:54.442060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395657+0000","last_change":"2023-09-30T13:54:54.454291+0000","last_active":"2023-09-30T13:54:55.395657+0000","last_peered":"2023-09-30T13:54:55.395657+0000","last_clean":"2023-09-30T13:54:55.395657+0000","last_became_active":"2023-09-30T13:54:54.453505+0000","last_became_peered":"2023-09-30T13:54:54.453505+0000","last_unstale":"2023-09-30T13:54:55.395657+0000","last_undegraded":"2023-09-30T13:54:55.395657+0000","last_fullsized":"2023-09-30T13:54:55.395657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:56.027992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443495+0000","last_change":"2023-09-30T13:54:50.410244+0000","last_active":"2023-09-30T13:54:54.443495+0000","last_peered":"2023-09-30T13:54:54.443495+0000","last_clean":"2023-09-30T13:54:54.443495+0000","last_became_active":"2023-09-30T13:54:50.409602+0000","last_became_peered":"2023-09-30T13:54:50.409602+0000","last_unstale":"2023-09-30T13:54:54.443495+0000","last_undegraded":"2023-09-30T13:54:54.443495+0000","last_fullsized":"2023-09-30T13:54:54.443495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439311+0000","last_change":"2023-09-30T13:54:49.418424+0000","last_active":"2023-09-30T13:54:54.439311+0000","last_peered":"2023-09-30T13:54:54.439311+0000","last_clean":"2023-09-30T13:54:54.439311+0000","last_became_active":"2023-09-30T13:54:49.417956+0000","last_became_peered":"2023-09-30T13:54:49.417956+0000","last_unstale":"2023-09-30T13:54:54.439311+0000","last_undegraded":"2023-09-30T13:54:54.439311+0000","last_fullsized":"2023-09-30T13:54:54.439311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556417+0000","last_change":"2023-09-30T13:54:54.462623+0000","last_active":"2023-09-30T13:54:55.556417+0000","last_peered":"2023-09-30T13:54:55.556417+0000","last_clean":"2023-09-30T13:54:55.556417+0000","last_became_active":"2023-09-30T13:54:54.462207+0000","last_became_peered":"2023-09-30T13:54:54.462207+0000","last_unstale":"2023-09-30T13:54:55.556417+0000","last_undegraded":"2023-09-30T13:54:55.556417+0000","last_fullsized":"2023-09-30T13:54:55.556417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443009+0000","last_change":"2023-09-30T13:54:50.413527+0000","last_active":"2023-09-30T13:54:54.443009+0000","last_peered":"2023-09-30T13:54:54.443009+0000","last_clean":"2023-09-30T13:54:54.443009+0000","last_became_active":"2023-09-30T13:54:50.413227+0000","last_became_peered":"2023-09-30T13:54:50.413227+0000","last_unstale":"2023-09-30T13:54:54.443009+0000","last_undegraded":"2023-09-30T13:54:54.443009+0000","last_fullsized":"2023-09-30T13:54:54.443009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:53.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457857+0000","last_change":"2023-09-30T13:54:49.425834+0000","last_active":"2023-09-30T13:54:54.457857+0000","last_peered":"2023-09-30T13:54:54.457857+0000","last_clean":"2023-09-30T13:54:54.457857+0000","last_became_active":"2023-09-30T13:54:49.424534+0000","last_became_peered":"2023-09-30T13:54:49.424534+0000","last_unstale":"2023-09-30T13:54:54.457857+0000","last_undegraded":"2023-09-30T13:54:54.457857+0000","last_fullsized":"2023-09-30T13:54:54.457857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:38.360726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395974+0000","last_change":"2023-09-30T13:54:54.461499+0000","last_active":"2023-09-30T13:54:55.395974+0000","last_peered":"2023-09-30T13:54:55.395974+0000","last_clean":"2023-09-30T13:54:55.395974+0000","last_became_active":"2023-09-30T13:54:54.461112+0000","last_became_peered":"2023-09-30T13:54:54.461112+0000","last_unstale":"2023-09-30T13:54:55.395974+0000","last_undegraded":"2023-09-30T13:54:55.395974+0000","last_fullsized":"2023-09-30T13:54:55.395974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454330+0000","last_change":"2023-09-30T13:54:50.410914+0000","last_active":"2023-09-30T13:54:54.454330+0000","last_peered":"2023-09-30T13:54:54.454330+0000","last_clean":"2023-09-30T13:54:54.454330+0000","last_became_active":"2023-09-30T13:54:50.410418+0000","last_became_peered":"2023-09-30T13:54:50.410418+0000","last_unstale":"2023-09-30T13:54:54.454330+0000","last_undegraded":"2023-09-30T13:54:54.454330+0000","last_fullsized":"2023-09-30T13:54:54.454330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447170+0000","last_change":"2023-09-30T13:54:49.422040+0000","last_active":"2023-09-30T13:54:54.447170+0000","last_peered":"2023-09-30T13:54:54.447170+0000","last_clean":"2023-09-30T13:54:54.447170+0000","last_became_active":"2023-09-30T13:54:49.421750+0000","last_became_peered":"2023-09-30T13:54:49.421750+0000","last_unstale":"2023-09-30T13:54:54.447170+0000","last_undegraded":"2023-09-30T13:54:54.447170+0000","last_fullsized":"2023-09-30T13:54:54.447170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395403+0000","last_change":"2023-09-30T13:54:54.461309+0000","last_active":"2023-09-30T13:54:55.395403+0000","last_peered":"2023-09-30T13:54:55.395403+0000","last_clean":"2023-09-30T13:54:55.395403+0000","last_became_active":"2023-09-30T13:54:54.460864+0000","last_became_peered":"2023-09-30T13:54:54.460864+0000","last_unstale":"2023-09-30T13:54:55.395403+0000","last_undegraded":"2023-09-30T13:54:55.395403+0000","last_fullsized":"2023-09-30T13:54:55.395403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:02.815628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441932+0000","last_change":"2023-09-30T13:54:50.412240+0000","last_active":"2023-09-30T13:54:54.441932+0000","last_peered":"2023-09-30T13:54:54.441932+0000","last_clean":"2023-09-30T13:54:54.441932+0000","last_became_active":"2023-09-30T13:54:50.411943+0000","last_became_peered":"2023-09-30T13:54:50.411943+0000","last_unstale":"2023-09-30T13:54:54.441932+0000","last_undegraded":"2023-09-30T13:54:54.441932+0000","last_fullsized":"2023-09-30T13:54:54.441932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439918+0000","last_change":"2023-09-30T13:54:49.416854+0000","last_active":"2023-09-30T13:54:54.439918+0000","last_peered":"2023-09-30T13:54:54.439918+0000","last_clean":"2023-09-30T13:54:54.439918+0000","last_became_active":"2023-09-30T13:54:49.416581+0000","last_became_peered":"2023-09-30T13:54:49.416581+0000","last_unstale":"2023-09-30T13:54:54.439918+0000","last_undegraded":"2023-09-30T13:54:54.439918+0000","last_fullsized":"2023-09-30T13:54:54.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394833+0000","last_change":"2023-09-30T13:54:54.462965+0000","last_active":"2023-09-30T13:54:55.394833+0000","last_peered":"2023-09-30T13:54:55.394833+0000","last_clean":"2023-09-30T13:54:55.394833+0000","last_became_active":"2023-09-30T13:54:54.462601+0000","last_became_peered":"2023-09-30T13:54:54.462601+0000","last_unstale":"2023-09-30T13:54:55.394833+0000","last_undegraded":"2023-09-30T13:54:55.394833+0000","last_fullsized":"2023-09-30T13:54:55.394833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:43:37.820526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439588+0000","last_change":"2023-09-30T13:54:50.408191+0000","last_active":"2023-09-30T13:54:54.439588+0000","last_peered":"2023-09-30T13:54:54.439588+0000","last_clean":"2023-09-30T13:54:54.439588+0000","last_became_active":"2023-09-30T13:54:50.407941+0000","last_became_peered":"2023-09-30T13:54:50.407941+0000","last_unstale":"2023-09-30T13:54:54.439588+0000","last_undegraded":"2023-09-30T13:54:54.439588+0000","last_fullsized":"2023-09-30T13:54:54.439588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458784+0000","last_change":"2023-09-30T13:54:49.425042+0000","last_active":"2023-09-30T13:54:54.458784+0000","last_peered":"2023-09-30T13:54:54.458784+0000","last_clean":"2023-09-30T13:54:54.458784+0000","last_became_active":"2023-09-30T13:54:49.424790+0000","last_became_peered":"2023-09-30T13:54:49.424790+0000","last_unstale":"2023-09-30T13:54:54.458784+0000","last_undegraded":"2023-09-30T13:54:54.458784+0000","last_fullsized":"2023-09-30T13:54:54.458784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555303+0000","last_change":"2023-09-30T13:54:54.466551+0000","last_active":"2023-09-30T13:54:55.555303+0000","last_peered":"2023-09-30T13:54:55.555303+0000","last_clean":"2023-09-30T13:54:55.555303+0000","last_became_active":"2023-09-30T13:54:54.464011+0000","last_became_peered":"2023-09-30T13:54:54.464011+0000","last_unstale":"2023-09-30T13:54:55.555303+0000","last_undegraded":"2023-09-30T13:54:55.555303+0000","last_fullsized":"2023-09-30T13:54:55.555303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450488+0000","last_change":"2023-09-30T13:54:50.415029+0000","last_active":"2023-09-30T13:54:54.450488+0000","last_peered":"2023-09-30T13:54:54.450488+0000","last_clean":"2023-09-30T13:54:54.450488+0000","last_became_active":"2023-09-30T13:54:50.414756+0000","last_became_peered":"2023-09-30T13:54:50.414756+0000","last_unstale":"2023-09-30T13:54:54.450488+0000","last_undegraded":"2023-09-30T13:54:54.450488+0000","last_fullsized":"2023-09-30T13:54:54.450488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439678+0000","last_change":"2023-09-30T13:54:49.421098+0000","last_active":"2023-09-30T13:54:54.439678+0000","last_peered":"2023-09-30T13:54:54.439678+0000","last_clean":"2023-09-30T13:54:54.439678+0000","last_became_active":"2023-09-30T13:54:49.420826+0000","last_became_peered":"2023-09-30T13:54:49.420826+0000","last_unstale":"2023-09-30T13:54:54.439678+0000","last_undegraded":"2023-09-30T13:54:54.439678+0000","last_fullsized":"2023-09-30T13:54:54.439678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555580+0000","last_change":"2023-09-30T13:54:54.460534+0000","last_active":"2023-09-30T13:54:55.555580+0000","last_peered":"2023-09-30T13:54:55.555580+0000","last_clean":"2023-09-30T13:54:55.555580+0000","last_became_active":"2023-09-30T13:54:54.459808+0000","last_became_peered":"2023-09-30T13:54:54.459808+0000","last_unstale":"2023-09-30T13:54:55.555580+0000","last_undegraded":"2023-09-30T13:54:55.555580+0000","last_fullsized":"2023-09-30T13:54:55.555580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:24.691512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443004+0000","last_change":"2023-09-30T13:54:50.409280+0000","last_active":"2023-09-30T13:54:54.443004+0000","last_peered":"2023-09-30T13:54:54.443004+0000","last_clean":"2023-09-30T13:54:54.443004+0000","last_became_active":"2023-09-30T13:54:50.408982+0000","last_became_peered":"2023-09-30T13:54:50.408982+0000","last_unstale":"2023-09-30T13:54:54.443004+0000","last_undegraded":"2023-09-30T13:54:54.443004+0000","last_fullsized":"2023-09-30T13:54:54.443004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:16:04.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449516+0000","last_change":"2023-09-30T13:54:49.426134+0000","last_active":"2023-09-30T13:54:54.449516+0000","last_peered":"2023-09-30T13:54:54.449516+0000","last_clean":"2023-09-30T13:54:54.449516+0000","last_became_active":"2023-09-30T13:54:49.425836+0000","last_became_peered":"2023-09-30T13:54:49.425836+0000","last_unstale":"2023-09-30T13:54:54.449516+0000","last_undegraded":"2023-09-30T13:54:54.449516+0000","last_fullsized":"2023-09-30T13:54:54.449516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:09.783758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556338+0000","last_change":"2023-09-30T13:54:54.455762+0000","last_active":"2023-09-30T13:54:55.556338+0000","last_peered":"2023-09-30T13:54:55.556338+0000","last_clean":"2023-09-30T13:54:55.556338+0000","last_became_active":"2023-09-30T13:54:54.455325+0000","last_became_peered":"2023-09-30T13:54:54.455325+0000","last_unstale":"2023-09-30T13:54:55.556338+0000","last_undegraded":"2023-09-30T13:54:55.556338+0000","last_fullsized":"2023-09-30T13:54:55.556338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439147+0000","last_change":"2023-09-30T13:54:50.408742+0000","last_active":"2023-09-30T13:54:54.439147+0000","last_peered":"2023-09-30T13:54:54.439147+0000","last_clean":"2023-09-30T13:54:54.439147+0000","last_became_active":"2023-09-30T13:54:50.408453+0000","last_became_peered":"2023-09-30T13:54:50.408453+0000","last_unstale":"2023-09-30T13:54:54.439147+0000","last_undegraded":"2023-09-30T13:54:54.439147+0000","last_fullsized":"2023-09-30T13:54:54.439147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448390+0000","last_change":"2023-09-30T13:54:49.421234+0000","last_active":"2023-09-30T13:54:54.448390+0000","last_peered":"2023-09-30T13:54:54.448390+0000","last_clean":"2023-09-30T13:54:54.448390+0000","last_became_active":"2023-09-30T13:54:49.420950+0000","last_became_peered":"2023-09-30T13:54:49.420950+0000","last_unstale":"2023-09-30T13:54:54.448390+0000","last_undegraded":"2023-09-30T13:54:54.448390+0000","last_fullsized":"2023-09-30T13:54:54.448390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556539+0000","last_change":"2023-09-30T13:54:54.462900+0000","last_active":"2023-09-30T13:54:55.556539+0000","last_peered":"2023-09-30T13:54:55.556539+0000","last_clean":"2023-09-30T13:54:55.556539+0000","last_became_active":"2023-09-30T13:54:54.459241+0000","last_became_peered":"2023-09-30T13:54:54.459241+0000","last_unstale":"2023-09-30T13:54:55.556539+0000","last_undegraded":"2023-09-30T13:54:55.556539+0000","last_fullsized":"2023-09-30T13:54:55.556539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453782+0000","last_change":"2023-09-30T13:54:50.405590+0000","last_active":"2023-09-30T13:54:54.453782+0000","last_peered":"2023-09-30T13:54:54.453782+0000","last_clean":"2023-09-30T13:54:54.453782+0000","last_became_active":"2023-09-30T13:54:50.405266+0000","last_became_peered":"2023-09-30T13:54:50.405266+0000","last_unstale":"2023-09-30T13:54:54.453782+0000","last_undegraded":"2023-09-30T13:54:54.453782+0000","last_fullsized":"2023-09-30T13:54:54.453782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.457949+0000","last_change":"2023-09-30T13:54:49.424227+0000","last_active":"2023-09-30T13:54:54.457949+0000","last_peered":"2023-09-30T13:54:54.457949+0000","last_clean":"2023-09-30T13:54:54.457949+0000","last_became_active":"2023-09-30T13:54:49.423939+0000","last_became_peered":"2023-09-30T13:54:49.423939+0000","last_unstale":"2023-09-30T13:54:54.457949+0000","last_undegraded":"2023-09-30T13:54:54.457949+0000","last_fullsized":"2023-09-30T13:54:54.457949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:20.159794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555733+0000","last_change":"2023-09-30T13:54:54.463551+0000","last_active":"2023-09-30T13:54:55.555733+0000","last_peered":"2023-09-30T13:54:55.555733+0000","last_clean":"2023-09-30T13:54:55.555733+0000","last_became_active":"2023-09-30T13:54:54.463125+0000","last_became_peered":"2023-09-30T13:54:54.463125+0000","last_unstale":"2023-09-30T13:54:55.555733+0000","last_undegraded":"2023-09-30T13:54:55.555733+0000","last_fullsized":"2023-09-30T13:54:55.555733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:47.665278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440199+0000","last_change":"2023-09-30T13:54:50.410239+0000","last_active":"2023-09-30T13:54:54.440199+0000","last_peered":"2023-09-30T13:54:54.440199+0000","last_clean":"2023-09-30T13:54:54.440199+0000","last_became_active":"2023-09-30T13:54:50.409936+0000","last_became_peered":"2023-09-30T13:54:50.409936+0000","last_unstale":"2023-09-30T13:54:54.440199+0000","last_undegraded":"2023-09-30T13:54:54.440199+0000","last_fullsized":"2023-09-30T13:54:54.440199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448279+0000","last_change":"2023-09-30T13:54:49.419889+0000","last_active":"2023-09-30T13:54:54.448279+0000","last_peered":"2023-09-30T13:54:54.448279+0000","last_clean":"2023-09-30T13:54:54.448279+0000","last_became_active":"2023-09-30T13:54:49.419588+0000","last_became_peered":"2023-09-30T13:54:49.419588+0000","last_unstale":"2023-09-30T13:54:54.448279+0000","last_undegraded":"2023-09-30T13:54:54.448279+0000","last_fullsized":"2023-09-30T13:54:54.448279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:38.191440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458057+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:54:54.458057+0000","last_peered":"2023-09-30T13:54:54.458057+0000","last_clean":"2023-09-30T13:54:54.458057+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:54:54.458057+0000","last_undegraded":"2023-09-30T13:54:54.458057+0000","last_fullsized":"2023-09-30T13:54:54.458057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420181+0000","last_change":"2023-09-30T13:54:54.461747+0000","last_active":"2023-09-30T13:54:55.420181+0000","last_peered":"2023-09-30T13:54:55.420181+0000","last_clean":"2023-09-30T13:54:55.420181+0000","last_became_active":"2023-09-30T13:54:54.461313+0000","last_became_peered":"2023-09-30T13:54:54.461313+0000","last_unstale":"2023-09-30T13:54:55.420181+0000","last_undegraded":"2023-09-30T13:54:55.420181+0000","last_fullsized":"2023-09-30T13:54:55.420181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458578+0000","last_change":"2023-09-30T13:54:50.416311+0000","last_active":"2023-09-30T13:54:54.458578+0000","last_peered":"2023-09-30T13:54:54.458578+0000","last_clean":"2023-09-30T13:54:54.458578+0000","last_became_active":"2023-09-30T13:54:50.415316+0000","last_became_peered":"2023-09-30T13:54:50.415316+0000","last_unstale":"2023-09-30T13:54:54.458578+0000","last_undegraded":"2023-09-30T13:54:54.458578+0000","last_fullsized":"2023-09-30T13:54:54.458578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:12:58.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449816+0000","last_change":"2023-09-30T13:54:49.423309+0000","last_active":"2023-09-30T13:54:54.449816+0000","last_peered":"2023-09-30T13:54:54.449816+0000","last_clean":"2023-09-30T13:54:54.449816+0000","last_became_active":"2023-09-30T13:54:49.423038+0000","last_became_peered":"2023-09-30T13:54:49.423038+0000","last_unstale":"2023-09-30T13:54:54.449816+0000","last_undegraded":"2023-09-30T13:54:54.449816+0000","last_fullsized":"2023-09-30T13:54:54.449816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.419816+0000","last_change":"2023-09-30T13:54:54.461245+0000","last_active":"2023-09-30T13:54:55.419816+0000","last_peered":"2023-09-30T13:54:55.419816+0000","last_clean":"2023-09-30T13:54:55.419816+0000","last_became_active":"2023-09-30T13:54:54.460850+0000","last_became_peered":"2023-09-30T13:54:54.460850+0000","last_unstale":"2023-09-30T13:54:55.419816+0000","last_undegraded":"2023-09-30T13:54:55.419816+0000","last_fullsized":"2023-09-30T13:54:55.419816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450189+0000","last_change":"2023-09-30T13:54:50.415242+0000","last_active":"2023-09-30T13:54:54.450189+0000","last_peered":"2023-09-30T13:54:54.450189+0000","last_clean":"2023-09-30T13:54:54.450189+0000","last_became_active":"2023-09-30T13:54:50.414966+0000","last_became_peered":"2023-09-30T13:54:50.414966+0000","last_unstale":"2023-09-30T13:54:54.450189+0000","last_undegraded":"2023-09-30T13:54:54.450189+0000","last_fullsized":"2023-09-30T13:54:54.450189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439617+0000","last_change":"2023-09-30T13:54:49.419341+0000","last_active":"2023-09-30T13:54:54.439617+0000","last_peered":"2023-09-30T13:54:54.439617+0000","last_clean":"2023-09-30T13:54:54.439617+0000","last_became_active":"2023-09-30T13:54:49.419064+0000","last_became_peered":"2023-09-30T13:54:49.419064+0000","last_unstale":"2023-09-30T13:54:54.439617+0000","last_undegraded":"2023-09-30T13:54:54.439617+0000","last_fullsized":"2023-09-30T13:54:54.439617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555529+0000","last_change":"2023-09-30T13:54:54.470669+0000","last_active":"2023-09-30T13:54:55.555529+0000","last_peered":"2023-09-30T13:54:55.555529+0000","last_clean":"2023-09-30T13:54:55.555529+0000","last_became_active":"2023-09-30T13:54:54.470079+0000","last_became_peered":"2023-09-30T13:54:54.470079+0000","last_unstale":"2023-09-30T13:54:55.555529+0000","last_undegraded":"2023-09-30T13:54:55.555529+0000","last_fullsized":"2023-09-30T13:54:55.555529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:10.302799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458977+0000","last_change":"2023-09-30T13:54:50.415862+0000","last_active":"2023-09-30T13:54:54.458977+0000","last_peered":"2023-09-30T13:54:54.458977+0000","last_clean":"2023-09-30T13:54:54.458977+0000","last_became_active":"2023-09-30T13:54:50.415304+0000","last_became_peered":"2023-09-30T13:54:50.415304+0000","last_unstale":"2023-09-30T13:54:54.458977+0000","last_undegraded":"2023-09-30T13:54:54.458977+0000","last_fullsized":"2023-09-30T13:54:54.458977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:34:43.639609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447671+0000","last_change":"2023-09-30T13:54:49.415340+0000","last_active":"2023-09-30T13:54:54.447671+0000","last_peered":"2023-09-30T13:54:54.447671+0000","last_clean":"2023-09-30T13:54:54.447671+0000","last_became_active":"2023-09-30T13:54:49.415072+0000","last_became_peered":"2023-09-30T13:54:49.415072+0000","last_unstale":"2023-09-30T13:54:54.447671+0000","last_undegraded":"2023-09-30T13:54:54.447671+0000","last_fullsized":"2023-09-30T13:54:54.447671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:14:27.574930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555106+0000","last_change":"2023-09-30T13:54:54.458742+0000","last_active":"2023-09-30T13:54:55.555106+0000","last_peered":"2023-09-30T13:54:55.555106+0000","last_clean":"2023-09-30T13:54:55.555106+0000","last_became_active":"2023-09-30T13:54:54.458302+0000","last_became_peered":"2023-09-30T13:54:54.458302+0000","last_unstale":"2023-09-30T13:54:55.555106+0000","last_undegraded":"2023-09-30T13:54:55.555106+0000","last_fullsized":"2023-09-30T13:54:55.555106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:59:16.664006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.459145+0000","last_change":"2023-09-30T13:54:50.415857+0000","last_active":"2023-09-30T13:54:54.459145+0000","last_peered":"2023-09-30T13:54:54.459145+0000","last_clean":"2023-09-30T13:54:54.459145+0000","last_became_active":"2023-09-30T13:54:50.415551+0000","last_became_peered":"2023-09-30T13:54:50.415551+0000","last_unstale":"2023-09-30T13:54:54.459145+0000","last_undegraded":"2023-09-30T13:54:54.459145+0000","last_fullsized":"2023-09-30T13:54:54.459145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:19:20.665843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442277+0000","last_change":"2023-09-30T13:54:49.417788+0000","last_active":"2023-09-30T13:54:54.442277+0000","last_peered":"2023-09-30T13:54:54.442277+0000","last_clean":"2023-09-30T13:54:54.442277+0000","last_became_active":"2023-09-30T13:54:49.417494+0000","last_became_peered":"2023-09-30T13:54:49.417494+0000","last_unstale":"2023-09-30T13:54:54.442277+0000","last_undegraded":"2023-09-30T13:54:54.442277+0000","last_fullsized":"2023-09-30T13:54:54.442277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:29.236552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395085+0000","last_change":"2023-09-30T13:54:54.462891+0000","last_active":"2023-09-30T13:54:55.395085+0000","last_peered":"2023-09-30T13:54:55.395085+0000","last_clean":"2023-09-30T13:54:55.395085+0000","last_became_active":"2023-09-30T13:54:54.461379+0000","last_became_peered":"2023-09-30T13:54:54.461379+0000","last_unstale":"2023-09-30T13:54:55.395085+0000","last_undegraded":"2023-09-30T13:54:55.395085+0000","last_fullsized":"2023-09-30T13:54:55.395085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:43.391644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458032+0000","last_change":"2023-09-30T13:54:50.417980+0000","last_active":"2023-09-30T13:54:54.458032+0000","last_peered":"2023-09-30T13:54:54.458032+0000","last_clean":"2023-09-30T13:54:54.458032+0000","last_became_active":"2023-09-30T13:54:50.417570+0000","last_became_peered":"2023-09-30T13:54:50.417570+0000","last_unstale":"2023-09-30T13:54:54.458032+0000","last_undegraded":"2023-09-30T13:54:54.458032+0000","last_fullsized":"2023-09-30T13:54:54.458032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446933+0000","last_change":"2023-09-30T13:54:49.419847+0000","last_active":"2023-09-30T13:54:54.446933+0000","last_peered":"2023-09-30T13:54:54.446933+0000","last_clean":"2023-09-30T13:54:54.446933+0000","last_became_active":"2023-09-30T13:54:49.419547+0000","last_became_peered":"2023-09-30T13:54:49.419547+0000","last_unstale":"2023-09-30T13:54:54.446933+0000","last_undegraded":"2023-09-30T13:54:54.446933+0000","last_fullsized":"2023-09-30T13:54:54.446933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:59:22.340711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555588+0000","last_change":"2023-09-30T13:54:54.458941+0000","last_active":"2023-09-30T13:54:55.555588+0000","last_peered":"2023-09-30T13:54:55.555588+0000","last_clean":"2023-09-30T13:54:55.555588+0000","last_became_active":"2023-09-30T13:54:54.458230+0000","last_became_peered":"2023-09-30T13:54:54.458230+0000","last_unstale":"2023-09-30T13:54:55.555588+0000","last_undegraded":"2023-09-30T13:54:55.555588+0000","last_fullsized":"2023-09-30T13:54:55.555588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447803+0000","last_change":"2023-09-30T13:54:50.411632+0000","last_active":"2023-09-30T13:54:54.447803+0000","last_peered":"2023-09-30T13:54:54.447803+0000","last_clean":"2023-09-30T13:54:54.447803+0000","last_became_active":"2023-09-30T13:54:50.411281+0000","last_became_peered":"2023-09-30T13:54:50.411281+0000","last_unstale":"2023-09-30T13:54:54.447803+0000","last_undegraded":"2023-09-30T13:54:54.447803+0000","last_fullsized":"2023-09-30T13:54:54.447803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448857+0000","last_change":"2023-09-30T13:54:49.417961+0000","last_active":"2023-09-30T13:54:54.448857+0000","last_peered":"2023-09-30T13:54:54.448857+0000","last_clean":"2023-09-30T13:54:54.448857+0000","last_became_active":"2023-09-30T13:54:49.417131+0000","last_became_peered":"2023-09-30T13:54:49.417131+0000","last_unstale":"2023-09-30T13:54:54.448857+0000","last_undegraded":"2023-09-30T13:54:54.448857+0000","last_fullsized":"2023-09-30T13:54:54.448857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:02.854268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.396016+0000","last_change":"2023-09-30T13:54:54.461774+0000","last_active":"2023-09-30T13:54:55.396016+0000","last_peered":"2023-09-30T13:54:55.396016+0000","last_clean":"2023-09-30T13:54:55.396016+0000","last_became_active":"2023-09-30T13:54:54.461333+0000","last_became_peered":"2023-09-30T13:54:54.461333+0000","last_unstale":"2023-09-30T13:54:55.396016+0000","last_undegraded":"2023-09-30T13:54:55.396016+0000","last_fullsized":"2023-09-30T13:54:55.396016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:07.190629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458382+0000","last_change":"2023-09-30T13:54:50.418751+0000","last_active":"2023-09-30T13:54:54.458382+0000","last_peered":"2023-09-30T13:54:54.458382+0000","last_clean":"2023-09-30T13:54:54.458382+0000","last_became_active":"2023-09-30T13:54:50.418290+0000","last_became_peered":"2023-09-30T13:54:50.418290+0000","last_unstale":"2023-09-30T13:54:54.458382+0000","last_undegraded":"2023-09-30T13:54:54.458382+0000","last_fullsized":"2023-09-30T13:54:54.458382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449427+0000","last_change":"2023-09-30T13:54:49.425647+0000","last_active":"2023-09-30T13:54:54.449427+0000","last_peered":"2023-09-30T13:54:54.449427+0000","last_clean":"2023-09-30T13:54:54.449427+0000","last_became_active":"2023-09-30T13:54:49.425388+0000","last_became_peered":"2023-09-30T13:54:49.425388+0000","last_unstale":"2023-09-30T13:54:54.449427+0000","last_undegraded":"2023-09-30T13:54:54.449427+0000","last_fullsized":"2023-09-30T13:54:54.449427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:13.693686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395641+0000","last_change":"2023-09-30T13:54:54.461862+0000","last_active":"2023-09-30T13:54:55.395641+0000","last_peered":"2023-09-30T13:54:55.395641+0000","last_clean":"2023-09-30T13:54:55.395641+0000","last_became_active":"2023-09-30T13:54:54.461454+0000","last_became_peered":"2023-09-30T13:54:54.461454+0000","last_unstale":"2023-09-30T13:54:55.395641+0000","last_undegraded":"2023-09-30T13:54:55.395641+0000","last_fullsized":"2023-09-30T13:54:55.395641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:41:47.042221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453950+0000","last_change":"2023-09-30T13:54:50.410049+0000","last_active":"2023-09-30T13:54:54.453950+0000","last_peered":"2023-09-30T13:54:54.453950+0000","last_clean":"2023-09-30T13:54:54.453950+0000","last_became_active":"2023-09-30T13:54:50.409797+0000","last_became_peered":"2023-09-30T13:54:50.409797+0000","last_unstale":"2023-09-30T13:54:54.453950+0000","last_undegraded":"2023-09-30T13:54:54.453950+0000","last_fullsized":"2023-09-30T13:54:54.453950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:31.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.455043+0000","last_change":"2023-09-30T13:54:49.419144+0000","last_active":"2023-09-30T13:54:54.455043+0000","last_peered":"2023-09-30T13:54:54.455043+0000","last_clean":"2023-09-30T13:54:54.455043+0000","last_became_active":"2023-09-30T13:54:49.418861+0000","last_became_peered":"2023-09-30T13:54:49.418861+0000","last_unstale":"2023-09-30T13:54:54.455043+0000","last_undegraded":"2023-09-30T13:54:54.455043+0000","last_fullsized":"2023-09-30T13:54:54.455043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:46:00.445751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555756+0000","last_change":"2023-09-30T13:54:54.461392+0000","last_active":"2023-09-30T13:54:55.555756+0000","last_peered":"2023-09-30T13:54:55.555756+0000","last_clean":"2023-09-30T13:54:55.555756+0000","last_became_active":"2023-09-30T13:54:54.460929+0000","last_became_peered":"2023-09-30T13:54:54.460929+0000","last_unstale":"2023-09-30T13:54:55.555756+0000","last_undegraded":"2023-09-30T13:54:55.555756+0000","last_fullsized":"2023-09-30T13:54:55.555756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458494+0000","last_change":"2023-09-30T13:54:50.416496+0000","last_active":"2023-09-30T13:54:54.458494+0000","last_peered":"2023-09-30T13:54:54.458494+0000","last_clean":"2023-09-30T13:54:54.458494+0000","last_became_active":"2023-09-30T13:54:50.416041+0000","last_became_peered":"2023-09-30T13:54:50.416041+0000","last_unstale":"2023-09-30T13:54:54.458494+0000","last_undegraded":"2023-09-30T13:54:54.458494+0000","last_fullsized":"2023-09-30T13:54:54.458494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:59.971696+0000","last_change":"2023-09-30T13:54:49.424285+0000","last_active":"2023-09-30T13:54:59.971696+0000","last_peered":"2023-09-30T13:54:59.971696+0000","last_clean":"2023-09-30T13:54:59.971696+0000","last_became_active":"2023-09-30T13:54:49.424016+0000","last_became_peered":"2023-09-30T13:54:49.424016+0000","last_unstale":"2023-09-30T13:54:59.971696+0000","last_undegraded":"2023-09-30T13:54:59.971696+0000","last_fullsized":"2023-09-30T13:54:59.971696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:06.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.555828+0000","last_change":"2023-09-30T13:54:54.460160+0000","last_active":"2023-09-30T13:54:55.555828+0000","last_peered":"2023-09-30T13:54:55.555828+0000","last_clean":"2023-09-30T13:54:55.555828+0000","last_became_active":"2023-09-30T13:54:54.459029+0000","last_became_peered":"2023-09-30T13:54:54.459029+0000","last_unstale":"2023-09-30T13:54:55.555828+0000","last_undegraded":"2023-09-30T13:54:55.555828+0000","last_fullsized":"2023-09-30T13:54:55.555828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:06.822029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443040+0000","last_change":"2023-09-30T13:54:50.415939+0000","last_active":"2023-09-30T13:54:54.443040+0000","last_peered":"2023-09-30T13:54:54.443040+0000","last_clean":"2023-09-30T13:54:54.443040+0000","last_became_active":"2023-09-30T13:54:50.415711+0000","last_became_peered":"2023-09-30T13:54:50.415711+0000","last_unstale":"2023-09-30T13:54:54.443040+0000","last_undegraded":"2023-09-30T13:54:54.443040+0000","last_fullsized":"2023-09-30T13:54:54.443040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439502+0000","last_change":"2023-09-30T13:54:49.421474+0000","last_active":"2023-09-30T13:54:54.439502+0000","last_peered":"2023-09-30T13:54:54.439502+0000","last_clean":"2023-09-30T13:54:54.439502+0000","last_became_active":"2023-09-30T13:54:49.421229+0000","last_became_peered":"2023-09-30T13:54:49.421229+0000","last_unstale":"2023-09-30T13:54:54.439502+0000","last_undegraded":"2023-09-30T13:54:54.439502+0000","last_fullsized":"2023-09-30T13:54:54.439502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395499+0000","last_change":"2023-09-30T13:54:54.462295+0000","last_active":"2023-09-30T13:54:55.395499+0000","last_peered":"2023-09-30T13:54:55.395499+0000","last_clean":"2023-09-30T13:54:55.395499+0000","last_became_active":"2023-09-30T13:54:54.461617+0000","last_became_peered":"2023-09-30T13:54:54.461617+0000","last_unstale":"2023-09-30T13:54:55.395499+0000","last_undegraded":"2023-09-30T13:54:55.395499+0000","last_fullsized":"2023-09-30T13:54:55.395499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:35.062866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454208+0000","last_change":"2023-09-30T13:54:50.409156+0000","last_active":"2023-09-30T13:54:54.454208+0000","last_peered":"2023-09-30T13:54:54.454208+0000","last_clean":"2023-09-30T13:54:54.454208+0000","last_became_active":"2023-09-30T13:54:50.408875+0000","last_became_peered":"2023-09-30T13:54:50.408875+0000","last_unstale":"2023-09-30T13:54:54.454208+0000","last_undegraded":"2023-09-30T13:54:54.454208+0000","last_fullsized":"2023-09-30T13:54:54.454208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450123+0000","last_change":"2023-09-30T13:54:49.421494+0000","last_active":"2023-09-30T13:54:54.450123+0000","last_peered":"2023-09-30T13:54:54.450123+0000","last_clean":"2023-09-30T13:54:54.450123+0000","last_became_active":"2023-09-30T13:54:49.420772+0000","last_became_peered":"2023-09-30T13:54:49.420772+0000","last_unstale":"2023-09-30T13:54:54.450123+0000","last_undegraded":"2023-09-30T13:54:54.450123+0000","last_fullsized":"2023-09-30T13:54:54.450123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:44.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395038+0000","last_change":"2023-09-30T13:54:54.450703+0000","last_active":"2023-09-30T13:54:55.395038+0000","last_peered":"2023-09-30T13:54:55.395038+0000","last_clean":"2023-09-30T13:54:55.395038+0000","last_became_active":"2023-09-30T13:54:54.450294+0000","last_became_peered":"2023-09-30T13:54:54.450294+0000","last_unstale":"2023-09-30T13:54:55.395038+0000","last_undegraded":"2023-09-30T13:54:55.395038+0000","last_fullsized":"2023-09-30T13:54:55.395038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:04:52.729643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450019+0000","last_change":"2023-09-30T13:54:50.422345+0000","last_active":"2023-09-30T13:54:54.450019+0000","last_peered":"2023-09-30T13:54:54.450019+0000","last_clean":"2023-09-30T13:54:54.450019+0000","last_became_active":"2023-09-30T13:54:50.422097+0000","last_became_peered":"2023-09-30T13:54:50.422097+0000","last_unstale":"2023-09-30T13:54:54.450019+0000","last_undegraded":"2023-09-30T13:54:54.450019+0000","last_fullsized":"2023-09-30T13:54:54.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:00:02.796360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447068+0000","last_change":"2023-09-30T13:54:49.421580+0000","last_active":"2023-09-30T13:54:54.447068+0000","last_peered":"2023-09-30T13:54:54.447068+0000","last_clean":"2023-09-30T13:54:54.447068+0000","last_became_active":"2023-09-30T13:54:49.421309+0000","last_became_peered":"2023-09-30T13:54:49.421309+0000","last_unstale":"2023-09-30T13:54:54.447068+0000","last_undegraded":"2023-09-30T13:54:54.447068+0000","last_fullsized":"2023-09-30T13:54:54.447068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:17.392031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394992+0000","last_change":"2023-09-30T13:54:54.461962+0000","last_active":"2023-09-30T13:54:55.394992+0000","last_peered":"2023-09-30T13:54:55.394992+0000","last_clean":"2023-09-30T13:54:55.394992+0000","last_became_active":"2023-09-30T13:54:54.461572+0000","last_became_peered":"2023-09-30T13:54:54.461572+0000","last_unstale":"2023-09-30T13:54:55.394992+0000","last_undegraded":"2023-09-30T13:54:55.394992+0000","last_fullsized":"2023-09-30T13:54:55.394992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:34:50.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.556083+0000","last_change":"2023-09-30T13:54:54.465345+0000","last_active":"2023-09-30T13:54:55.556083+0000","last_peered":"2023-09-30T13:54:55.556083+0000","last_clean":"2023-09-30T13:54:55.556083+0000","last_became_active":"2023-09-30T13:54:54.464944+0000","last_became_peered":"2023-09-30T13:54:54.464944+0000","last_unstale":"2023-09-30T13:54:55.556083+0000","last_undegraded":"2023-09-30T13:54:55.556083+0000","last_fullsized":"2023-09-30T13:54:55.556083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:22:46.203262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439196+0000","last_change":"2023-09-30T13:54:50.415261+0000","last_active":"2023-09-30T13:54:54.439196+0000","last_peered":"2023-09-30T13:54:54.439196+0000","last_clean":"2023-09-30T13:54:54.439196+0000","last_became_active":"2023-09-30T13:54:50.414934+0000","last_became_peered":"2023-09-30T13:54:50.414934+0000","last_unstale":"2023-09-30T13:54:54.439196+0000","last_undegraded":"2023-09-30T13:54:54.439196+0000","last_fullsized":"2023-09-30T13:54:54.439196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447216+0000","last_change":"2023-09-30T13:54:49.423480+0000","last_active":"2023-09-30T13:54:54.447216+0000","last_peered":"2023-09-30T13:54:54.447216+0000","last_clean":"2023-09-30T13:54:54.447216+0000","last_became_active":"2023-09-30T13:54:49.423220+0000","last_became_peered":"2023-09-30T13:54:49.423220+0000","last_unstale":"2023-09-30T13:54:54.447216+0000","last_undegraded":"2023-09-30T13:54:54.447216+0000","last_fullsized":"2023-09-30T13:54:54.447216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:52.903677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.420301+0000","last_change":"2023-09-30T13:54:54.464246+0000","last_active":"2023-09-30T13:54:55.420301+0000","last_peered":"2023-09-30T13:54:55.420301+0000","last_clean":"2023-09-30T13:54:55.420301+0000","last_became_active":"2023-09-30T13:54:54.463379+0000","last_became_peered":"2023-09-30T13:54:54.463379+0000","last_unstale":"2023-09-30T13:54:55.420301+0000","last_undegraded":"2023-09-30T13:54:55.420301+0000","last_fullsized":"2023-09-30T13:54:55.420301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:58.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.443406+0000","last_change":"2023-09-30T13:54:50.409576+0000","last_active":"2023-09-30T13:54:54.443406+0000","last_peered":"2023-09-30T13:54:54.443406+0000","last_clean":"2023-09-30T13:54:54.443406+0000","last_became_active":"2023-09-30T13:54:50.409205+0000","last_became_peered":"2023-09-30T13:54:50.409205+0000","last_unstale":"2023-09-30T13:54:54.443406+0000","last_undegraded":"2023-09-30T13:54:54.443406+0000","last_fullsized":"2023-09-30T13:54:54.443406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441966+0000","last_change":"2023-09-30T13:54:49.414072+0000","last_active":"2023-09-30T13:54:54.441966+0000","last_peered":"2023-09-30T13:54:54.441966+0000","last_clean":"2023-09-30T13:54:54.441966+0000","last_became_active":"2023-09-30T13:54:49.413795+0000","last_became_peered":"2023-09-30T13:54:49.413795+0000","last_unstale":"2023-09-30T13:54:54.441966+0000","last_undegraded":"2023-09-30T13:54:54.441966+0000","last_fullsized":"2023-09-30T13:54:54.441966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:39.118177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.445628+0000","last_change":"2023-09-30T13:54:49.418852+0000","last_active":"2023-09-30T13:54:54.445628+0000","last_peered":"2023-09-30T13:54:54.445628+0000","last_clean":"2023-09-30T13:54:54.445628+0000","last_became_active":"2023-09-30T13:54:49.417214+0000","last_became_peered":"2023-09-30T13:54:49.417214+0000","last_unstale":"2023-09-30T13:54:54.445628+0000","last_undegraded":"2023-09-30T13:54:54.445628+0000","last_fullsized":"2023-09-30T13:54:54.445628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:30.877135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454816+0000","last_change":"2023-09-30T13:54:50.408345+0000","last_active":"2023-09-30T13:54:54.454816+0000","last_peered":"2023-09-30T13:54:54.454816+0000","last_clean":"2023-09-30T13:54:54.454816+0000","last_became_active":"2023-09-30T13:54:50.408060+0000","last_became_peered":"2023-09-30T13:54:50.408060+0000","last_unstale":"2023-09-30T13:54:54.454816+0000","last_undegraded":"2023-09-30T13:54:54.454816+0000","last_fullsized":"2023-09-30T13:54:54.454816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.394296+0000","last_change":"2023-09-30T13:54:54.460070+0000","last_active":"2023-09-30T13:54:55.394296+0000","last_peered":"2023-09-30T13:54:55.394296+0000","last_clean":"2023-09-30T13:54:55.394296+0000","last_became_active":"2023-09-30T13:54:54.459607+0000","last_became_peered":"2023-09-30T13:54:54.459607+0000","last_unstale":"2023-09-30T13:54:55.394296+0000","last_undegraded":"2023-09-30T13:54:55.394296+0000","last_fullsized":"2023-09-30T13:54:55.394296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:45.736051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.440800+0000","last_change":"2023-09-30T13:54:49.418506+0000","last_active":"2023-09-30T13:54:54.440800+0000","last_peered":"2023-09-30T13:54:54.440800+0000","last_clean":"2023-09-30T13:54:54.440800+0000","last_became_active":"2023-09-30T13:54:49.418247+0000","last_became_peered":"2023-09-30T13:54:49.418247+0000","last_unstale":"2023-09-30T13:54:54.440800+0000","last_undegraded":"2023-09-30T13:54:54.440800+0000","last_fullsized":"2023-09-30T13:54:54.440800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:48.393303+0000","last_clean_scrub_stamp":"2023-09-30T13:54:48.393303+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:40.705132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442842+0000","last_change":"2023-09-30T13:54:50.414962+0000","last_active":"2023-09-30T13:54:54.442842+0000","last_peered":"2023-09-30T13:54:54.442842+0000","last_clean":"2023-09-30T13:54:54.442842+0000","last_became_active":"2023-09-30T13:54:50.414716+0000","last_became_peered":"2023-09-30T13:54:50.414716+0000","last_unstale":"2023-09-30T13:54:54.442842+0000","last_undegraded":"2023-09-30T13:54:54.442842+0000","last_fullsized":"2023-09-30T13:54:54.442842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:19:18.397281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-30T13:54:55.395779+0000","last_change":"2023-09-30T13:54:54.453610+0000","last_active":"2023-09-30T13:54:55.395779+0000","last_peered":"2023-09-30T13:54:55.395779+0000","last_clean":"2023-09-30T13:54:55.395779+0000","last_became_active":"2023-09-30T13:54:54.453208+0000","last_became_peered":"2023-09-30T13:54:54.453208+0000","last_unstale":"2023-09-30T13:54:55.395779+0000","last_undegraded":"2023-09-30T13:54:55.395779+0000","last_fullsized":"2023-09-30T13:54:55.395779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:53.424222+0000","last_clean_scrub_stamp":"2023-09-30T13:54:53.424222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:16:46.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447707+0000","last_change":"2023-09-30T13:54:50.413789+0000","last_active":"2023-09-30T13:54:54.447707+0000","last_peered":"2023-09-30T13:54:54.447707+0000","last_clean":"2023-09-30T13:54:54.447707+0000","last_became_active":"2023-09-30T13:54:50.413515+0000","last_became_peered":"2023-09-30T13:54:50.413515+0000","last_unstale":"2023-09-30T13:54:54.447707+0000","last_undegraded":"2023-09-30T13:54:54.447707+0000","last_fullsized":"2023-09-30T13:54:54.447707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:59:10.789008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446862+0000","last_change":"2023-09-30T13:54:50.407643+0000","last_active":"2023-09-30T13:54:54.446862+0000","last_peered":"2023-09-30T13:54:54.446862+0000","last_clean":"2023-09-30T13:54:54.446862+0000","last_became_active":"2023-09-30T13:54:50.407392+0000","last_became_peered":"2023-09-30T13:54:50.407392+0000","last_unstale":"2023-09-30T13:54:54.446862+0000","last_undegraded":"2023-09-30T13:54:54.446862+0000","last_fullsized":"2023-09-30T13:54:54.446862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449338+0000","last_change":"2023-09-30T13:54:50.417249+0000","last_active":"2023-09-30T13:54:54.449338+0000","last_peered":"2023-09-30T13:54:54.449338+0000","last_clean":"2023-09-30T13:54:54.449338+0000","last_became_active":"2023-09-30T13:54:50.416968+0000","last_became_peered":"2023-09-30T13:54:50.416968+0000","last_unstale":"2023-09-30T13:54:54.449338+0000","last_undegraded":"2023-09-30T13:54:54.449338+0000","last_fullsized":"2023-09-30T13:54:54.449338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454724+0000","last_change":"2023-09-30T13:54:50.414645+0000","last_active":"2023-09-30T13:54:54.454724+0000","last_peered":"2023-09-30T13:54:54.454724+0000","last_clean":"2023-09-30T13:54:54.454724+0000","last_became_active":"2023-09-30T13:54:50.414355+0000","last_became_peered":"2023-09-30T13:54:50.414355+0000","last_unstale":"2023-09-30T13:54:54.454724+0000","last_undegraded":"2023-09-30T13:54:54.454724+0000","last_fullsized":"2023-09-30T13:54:54.454724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:14.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442101+0000","last_change":"2023-09-30T13:54:50.400252+0000","last_active":"2023-09-30T13:54:54.442101+0000","last_peered":"2023-09-30T13:54:54.442101+0000","last_clean":"2023-09-30T13:54:54.442101+0000","last_became_active":"2023-09-30T13:54:50.399917+0000","last_became_peered":"2023-09-30T13:54:50.399917+0000","last_unstale":"2023-09-30T13:54:54.442101+0000","last_undegraded":"2023-09-30T13:54:54.442101+0000","last_fullsized":"2023-09-30T13:54:54.442101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439388+0000","last_change":"2023-09-30T13:54:50.414491+0000","last_active":"2023-09-30T13:54:54.439388+0000","last_peered":"2023-09-30T13:54:54.439388+0000","last_clean":"2023-09-30T13:54:54.439388+0000","last_became_active":"2023-09-30T13:54:50.414221+0000","last_became_peered":"2023-09-30T13:54:50.414221+0000","last_unstale":"2023-09-30T13:54:54.439388+0000","last_undegraded":"2023-09-30T13:54:54.439388+0000","last_fullsized":"2023-09-30T13:54:54.439388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446932+0000","last_change":"2023-09-30T13:54:50.413491+0000","last_active":"2023-09-30T13:54:54.446932+0000","last_peered":"2023-09-30T13:54:54.446932+0000","last_clean":"2023-09-30T13:54:54.446932+0000","last_became_active":"2023-09-30T13:54:50.413226+0000","last_became_peered":"2023-09-30T13:54:50.413226+0000","last_unstale":"2023-09-30T13:54:54.446932+0000","last_undegraded":"2023-09-30T13:54:54.446932+0000","last_fullsized":"2023-09-30T13:54:54.446932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:07:54.506031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441831+0000","last_change":"2023-09-30T13:54:50.399450+0000","last_active":"2023-09-30T13:54:54.441831+0000","last_peered":"2023-09-30T13:54:54.441831+0000","last_clean":"2023-09-30T13:54:54.441831+0000","last_became_active":"2023-09-30T13:54:50.399129+0000","last_became_peered":"2023-09-30T13:54:50.399129+0000","last_unstale":"2023-09-30T13:54:54.441831+0000","last_undegraded":"2023-09-30T13:54:54.441831+0000","last_fullsized":"2023-09-30T13:54:54.441831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447123+0000","last_change":"2023-09-30T13:54:50.416017+0000","last_active":"2023-09-30T13:54:54.447123+0000","last_peered":"2023-09-30T13:54:54.447123+0000","last_clean":"2023-09-30T13:54:54.447123+0000","last_became_active":"2023-09-30T13:54:50.415769+0000","last_became_peered":"2023-09-30T13:54:50.415769+0000","last_unstale":"2023-09-30T13:54:54.447123+0000","last_undegraded":"2023-09-30T13:54:54.447123+0000","last_fullsized":"2023-09-30T13:54:54.447123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.441869+0000","last_change":"2023-09-30T13:54:50.401717+0000","last_active":"2023-09-30T13:54:54.441869+0000","last_peered":"2023-09-30T13:54:54.441869+0000","last_clean":"2023-09-30T13:54:54.441869+0000","last_became_active":"2023-09-30T13:54:50.401384+0000","last_became_peered":"2023-09-30T13:54:50.401384+0000","last_unstale":"2023-09-30T13:54:54.441869+0000","last_undegraded":"2023-09-30T13:54:54.441869+0000","last_fullsized":"2023-09-30T13:54:54.441869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449251+0000","last_change":"2023-09-30T13:54:50.423066+0000","last_active":"2023-09-30T13:54:54.449251+0000","last_peered":"2023-09-30T13:54:54.449251+0000","last_clean":"2023-09-30T13:54:54.449251+0000","last_became_active":"2023-09-30T13:54:50.422797+0000","last_became_peered":"2023-09-30T13:54:50.422797+0000","last_unstale":"2023-09-30T13:54:54.449251+0000","last_undegraded":"2023-09-30T13:54:54.449251+0000","last_fullsized":"2023-09-30T13:54:54.449251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454616+0000","last_change":"2023-09-30T13:54:50.412413+0000","last_active":"2023-09-30T13:54:54.454616+0000","last_peered":"2023-09-30T13:54:54.454616+0000","last_clean":"2023-09-30T13:54:54.454616+0000","last_became_active":"2023-09-30T13:54:50.412107+0000","last_became_peered":"2023-09-30T13:54:50.412107+0000","last_unstale":"2023-09-30T13:54:54.454616+0000","last_undegraded":"2023-09-30T13:54:54.454616+0000","last_fullsized":"2023-09-30T13:54:54.454616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446754+0000","last_change":"2023-09-30T13:54:50.417833+0000","last_active":"2023-09-30T13:54:54.446754+0000","last_peered":"2023-09-30T13:54:54.446754+0000","last_clean":"2023-09-30T13:54:54.446754+0000","last_became_active":"2023-09-30T13:54:50.417525+0000","last_became_peered":"2023-09-30T13:54:50.417525+0000","last_unstale":"2023-09-30T13:54:54.446754+0000","last_undegraded":"2023-09-30T13:54:54.446754+0000","last_fullsized":"2023-09-30T13:54:54.446754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:17:39.365975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458795+0000","last_change":"2023-09-30T13:54:50.412766+0000","last_active":"2023-09-30T13:54:54.458795+0000","last_peered":"2023-09-30T13:54:54.458795+0000","last_clean":"2023-09-30T13:54:54.458795+0000","last_became_active":"2023-09-30T13:54:50.412502+0000","last_became_peered":"2023-09-30T13:54:50.412502+0000","last_unstale":"2023-09-30T13:54:54.458795+0000","last_undegraded":"2023-09-30T13:54:54.458795+0000","last_fullsized":"2023-09-30T13:54:54.458795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:03:24.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447122+0000","last_change":"2023-09-30T13:54:50.408372+0000","last_active":"2023-09-30T13:54:54.447122+0000","last_peered":"2023-09-30T13:54:54.447122+0000","last_clean":"2023-09-30T13:54:54.447122+0000","last_became_active":"2023-09-30T13:54:50.408111+0000","last_became_peered":"2023-09-30T13:54:50.408111+0000","last_unstale":"2023-09-30T13:54:54.447122+0000","last_undegraded":"2023-09-30T13:54:54.447122+0000","last_fullsized":"2023-09-30T13:54:54.447122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:36:45.203731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.450494+0000","last_change":"2023-09-30T13:54:50.418485+0000","last_active":"2023-09-30T13:54:54.450494+0000","last_peered":"2023-09-30T13:54:54.450494+0000","last_clean":"2023-09-30T13:54:54.450494+0000","last_became_active":"2023-09-30T13:54:50.417771+0000","last_became_peered":"2023-09-30T13:54:50.417771+0000","last_unstale":"2023-09-30T13:54:54.450494+0000","last_undegraded":"2023-09-30T13:54:54.450494+0000","last_fullsized":"2023-09-30T13:54:54.450494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446955+0000","last_change":"2023-09-30T13:54:50.410885+0000","last_active":"2023-09-30T13:54:54.446955+0000","last_peered":"2023-09-30T13:54:54.446955+0000","last_clean":"2023-09-30T13:54:54.446955+0000","last_became_active":"2023-09-30T13:54:50.410590+0000","last_became_peered":"2023-09-30T13:54:50.410590+0000","last_unstale":"2023-09-30T13:54:54.446955+0000","last_undegraded":"2023-09-30T13:54:54.446955+0000","last_fullsized":"2023-09-30T13:54:54.446955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439246+0000","last_change":"2023-09-30T13:54:50.415957+0000","last_active":"2023-09-30T13:54:54.439246+0000","last_peered":"2023-09-30T13:54:54.439246+0000","last_clean":"2023-09-30T13:54:54.439246+0000","last_became_active":"2023-09-30T13:54:50.415634+0000","last_became_peered":"2023-09-30T13:54:50.415634+0000","last_unstale":"2023-09-30T13:54:54.439246+0000","last_undegraded":"2023-09-30T13:54:54.439246+0000","last_fullsized":"2023-09-30T13:54:54.439246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:52:28.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.453850+0000","last_change":"2023-09-30T13:54:50.411326+0000","last_active":"2023-09-30T13:54:54.453850+0000","last_peered":"2023-09-30T13:54:54.453850+0000","last_clean":"2023-09-30T13:54:54.453850+0000","last_became_active":"2023-09-30T13:54:50.410982+0000","last_became_peered":"2023-09-30T13:54:50.410982+0000","last_unstale":"2023-09-30T13:54:54.453850+0000","last_undegraded":"2023-09-30T13:54:54.453850+0000","last_fullsized":"2023-09-30T13:54:54.453850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:41.710382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444714+0000","last_change":"2023-09-30T13:54:50.410846+0000","last_active":"2023-09-30T13:54:54.444714+0000","last_peered":"2023-09-30T13:54:54.444714+0000","last_clean":"2023-09-30T13:54:54.444714+0000","last_became_active":"2023-09-30T13:54:50.410552+0000","last_became_peered":"2023-09-30T13:54:50.410552+0000","last_unstale":"2023-09-30T13:54:54.444714+0000","last_undegraded":"2023-09-30T13:54:54.444714+0000","last_fullsized":"2023-09-30T13:54:54.444714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.442982+0000","last_change":"2023-09-30T13:54:50.414413+0000","last_active":"2023-09-30T13:54:54.442982+0000","last_peered":"2023-09-30T13:54:54.442982+0000","last_clean":"2023-09-30T13:54:54.442982+0000","last_became_active":"2023-09-30T13:54:50.413675+0000","last_became_peered":"2023-09-30T13:54:50.413675+0000","last_unstale":"2023-09-30T13:54:54.442982+0000","last_undegraded":"2023-09-30T13:54:54.442982+0000","last_fullsized":"2023-09-30T13:54:54.442982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:19.776768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.447232+0000","last_change":"2023-09-30T13:54:50.413676+0000","last_active":"2023-09-30T13:54:54.447232+0000","last_peered":"2023-09-30T13:54:54.447232+0000","last_clean":"2023-09-30T13:54:54.447232+0000","last_became_active":"2023-09-30T13:54:50.412614+0000","last_became_peered":"2023-09-30T13:54:50.412614+0000","last_unstale":"2023-09-30T13:54:54.447232+0000","last_undegraded":"2023-09-30T13:54:54.447232+0000","last_fullsized":"2023-09-30T13:54:54.447232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:39:03.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.446834+0000","last_change":"2023-09-30T13:54:50.412729+0000","last_active":"2023-09-30T13:54:54.446834+0000","last_peered":"2023-09-30T13:54:54.446834+0000","last_clean":"2023-09-30T13:54:54.446834+0000","last_became_active":"2023-09-30T13:54:50.412478+0000","last_became_peered":"2023-09-30T13:54:50.412478+0000","last_unstale":"2023-09-30T13:54:54.446834+0000","last_undegraded":"2023-09-30T13:54:54.446834+0000","last_fullsized":"2023-09-30T13:54:54.446834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458895+0000","last_change":"2023-09-30T13:54:50.416012+0000","last_active":"2023-09-30T13:54:54.458895+0000","last_peered":"2023-09-30T13:54:54.458895+0000","last_clean":"2023-09-30T13:54:54.458895+0000","last_became_active":"2023-09-30T13:54:50.414957+0000","last_became_peered":"2023-09-30T13:54:50.414957+0000","last_unstale":"2023-09-30T13:54:54.458895+0000","last_undegraded":"2023-09-30T13:54:54.458895+0000","last_fullsized":"2023-09-30T13:54:54.458895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:23:54.613251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.444109+0000","last_change":"2023-09-30T13:54:50.405513+0000","last_active":"2023-09-30T13:54:54.444109+0000","last_peered":"2023-09-30T13:54:54.444109+0000","last_clean":"2023-09-30T13:54:54.444109+0000","last_became_active":"2023-09-30T13:54:50.404703+0000","last_became_peered":"2023-09-30T13:54:50.404703+0000","last_unstale":"2023-09-30T13:54:54.444109+0000","last_undegraded":"2023-09-30T13:54:54.444109+0000","last_fullsized":"2023-09-30T13:54:54.444109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:09:07.144285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458099+0000","last_change":"2023-09-30T13:54:50.418187+0000","last_active":"2023-09-30T13:54:54.458099+0000","last_peered":"2023-09-30T13:54:54.458099+0000","last_clean":"2023-09-30T13:54:54.458099+0000","last_became_active":"2023-09-30T13:54:50.417894+0000","last_became_peered":"2023-09-30T13:54:50.417894+0000","last_unstale":"2023-09-30T13:54:54.458099+0000","last_undegraded":"2023-09-30T13:54:54.458099+0000","last_fullsized":"2023-09-30T13:54:54.458099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:39:31.037197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.449166+0000","last_change":"2023-09-30T13:54:50.410069+0000","last_active":"2023-09-30T13:54:54.449166+0000","last_peered":"2023-09-30T13:54:54.449166+0000","last_clean":"2023-09-30T13:54:54.449166+0000","last_became_active":"2023-09-30T13:54:50.409788+0000","last_became_peered":"2023-09-30T13:54:50.409788+0000","last_unstale":"2023-09-30T13:54:54.449166+0000","last_undegraded":"2023-09-30T13:54:54.449166+0000","last_fullsized":"2023-09-30T13:54:54.449166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458341+0000","last_change":"2023-09-30T13:54:50.411521+0000","last_active":"2023-09-30T13:54:54.458341+0000","last_peered":"2023-09-30T13:54:54.458341+0000","last_clean":"2023-09-30T13:54:54.458341+0000","last_became_active":"2023-09-30T13:54:50.411249+0000","last_became_peered":"2023-09-30T13:54:50.411249+0000","last_unstale":"2023-09-30T13:54:54.458341+0000","last_undegraded":"2023-09-30T13:54:54.458341+0000","last_fullsized":"2023-09-30T13:54:54.458341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:25.016646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.448866+0000","last_change":"2023-09-30T13:54:50.416620+0000","last_active":"2023-09-30T13:54:54.448866+0000","last_peered":"2023-09-30T13:54:54.448866+0000","last_clean":"2023-09-30T13:54:54.448866+0000","last_became_active":"2023-09-30T13:54:50.416353+0000","last_became_peered":"2023-09-30T13:54:50.416353+0000","last_unstale":"2023-09-30T13:54:54.448866+0000","last_undegraded":"2023-09-30T13:54:54.448866+0000","last_fullsized":"2023-09-30T13:54:54.448866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:00:52.002323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.454120+0000","last_change":"2023-09-30T13:54:50.408896+0000","last_active":"2023-09-30T13:54:54.454120+0000","last_peered":"2023-09-30T13:54:54.454120+0000","last_clean":"2023-09-30T13:54:54.454120+0000","last_became_active":"2023-09-30T13:54:50.407306+0000","last_became_peered":"2023-09-30T13:54:50.407306+0000","last_unstale":"2023-09-30T13:54:54.454120+0000","last_undegraded":"2023-09-30T13:54:54.454120+0000","last_fullsized":"2023-09-30T13:54:54.454120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:08:39.196690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.439826+0000","last_change":"2023-09-30T13:54:50.409514+0000","last_active":"2023-09-30T13:54:54.439826+0000","last_peered":"2023-09-30T13:54:54.439826+0000","last_clean":"2023-09-30T13:54:54.439826+0000","last_became_active":"2023-09-30T13:54:50.409220+0000","last_became_peered":"2023-09-30T13:54:50.409220+0000","last_unstale":"2023-09-30T13:54:54.439826+0000","last_undegraded":"2023-09-30T13:54:54.439826+0000","last_fullsized":"2023-09-30T13:54:54.439826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:24:21.165043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T13:54:54.458792+0000","last_change":"2023-09-30T13:54:50.415599+0000","last_active":"2023-09-30T13:54:54.458792+0000","last_peered":"2023-09-30T13:54:54.458792+0000","last_clean":"2023-09-30T13:54:54.458792+0000","last_became_active":"2023-09-30T13:54:50.414604+0000","last_became_peered":"2023-09-30T13:54:50.414604+0000","last_unstale":"2023-09-30T13:54:54.458792+0000","last_undegraded":"2023-09-30T13:54:54.458792+0000","last_fullsized":"2023-09-30T13:54:54.458792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:49.398553+0000","last_clean_scrub_stamp":"2023-09-30T13:54:49.398553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:33:06.277130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:55:12.268 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T13:55:12.268 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T13:55:12.269 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T13:55:12.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T13:55:12.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.405+0000 7f13e16ec640 1 Processor -- start 2023-09-30T13:55:12.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.405+0000 7f13e16ec640 1 -- start start 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13e16ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc06b070 0x7f13dc06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13e16ec640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13dc0d1410 0x7f13dc0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13e16ec640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0cb810 con 0x7f13dc15cbb0 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13e16ec640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc06c230 con 0x7f13dc0d1410 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13e16ec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0cccb0 con 0x7f13dc06b070 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13dc0d1410 0x7f13dc0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f13dc0d1410 0x7f13dc0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39574/0 (socket says 172.21.15.62:39574) 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 -- 172.21.15.62:0/1633513162 learned_addr learned my addr 172.21.15.62:0/1633513162 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:12.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 -- 172.21.15.62:0/1633513162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc06b070 msgr2=0x7f13dc06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13da7fc640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc06b070 0x7f13dc06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc06b070 0x7f13dc06bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 -- 172.21.15.62:0/1633513162 >> v1:172.21.15.135:6789/0 conn(0x7f13dc15cbb0 legacy=0x7f13dc06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.406+0000 7f13db7fe640 1 -- 172.21.15.62:0/1633513162 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0caee0 con 0x7f13dc0d1410 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.407+0000 7f13db7fe640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc0d1410 0x7f13dc0af3d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009e50 tx=0x7f13d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cc2611ae7ea0a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.407+0000 7f13d9ffb640 1 -- 172.21.15.62:0/1633513162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d402ca70 con 0x7f13dc0d1410 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.407+0000 7f13d9ffb640 1 -- 172.21.15.62:0/1633513162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d402cbd0 con 0x7f13dc0d1410 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.407+0000 7f13d9ffb640 1 -- 172.21.15.62:0/1633513162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40343f0 con 0x7f13dc0d1410 2023-09-30T13:55:12.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 -- 172.21.15.62:0/1633513162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc0d1410 msgr2=0x7f13dc0af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc0d1410 0x7f13dc0af3d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009e50 tx=0x7f13d402bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 -- 172.21.15.62:0/1633513162 shutdown_connections 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc0d1410 0x7f13dc0af3d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1633513162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc06b070 0x7f13dc06bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 -- 172.21.15.62:0/1633513162 >> 172.21.15.62:0/1633513162 conn(0x7f13dc089fe0 msgr2=0x7f13dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 -- 172.21.15.62:0/1633513162 shutdown_connections 2023-09-30T13:55:12.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.408+0000 7f13e16ec640 1 -- 172.21.15.62:0/1633513162 wait complete. 2023-09-30T13:55:12.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.409+0000 7f13e16ec640 1 Processor -- start 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.409+0000 7f13e16ec640 1 -- start start 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc06b070 0x7f13dc0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 0x7f13dc0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0b5960 con 0x7f13dc15cbb0 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ca400 con 0x7f13dc06b070 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13e16ec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0b48c0 con 0x7f13dc0d1410 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39586/0 (socket says 172.21.15.62:39586) 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 -- 172.21.15.62:0/1227559347 learned_addr learned my addr 172.21.15.62:0/1227559347 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13daffd640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc06b070 0x7f13dc0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13da7fc640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 0x7f13dc0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 -- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 msgr2=0x7f13dc0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 0x7f13dc0c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 -- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc06b070 msgr2=0x7f13dc0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc06b070 0x7f13dc0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 -- 172.21.15.62:0/1227559347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009b30 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13da7fc640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 0x7f13dc0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13db7fe640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13d4036040 tx=0x7f13d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d403e450 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.410+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d403e5d0 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.411+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc0b4ba0 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.411+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d403e980 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.411+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc0b5160 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.412+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc06e2a0 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.412+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f13d403eae0 con 0x7f13dc15cbb0 2023-09-30T13:55:12.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.412+0000 7f13c37fe640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 0x7f13c806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.412+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13d40ac410 con 0x7f13dc15cbb0 2023-09-30T13:55:12.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.413+0000 7f13daffd640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 0x7f13c806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.413+0000 7f13daffd640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 0x7f13c806cff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13cc004ea0 tx=0x7f13cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.416+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f13d4077370 con 0x7f13dc15cbb0 2023-09-30T13:55:12.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.635+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f13dc04e0d0 con 0x7f13dc15cbb0 2023-09-30T13:55:12.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.636+0000 7f13c37fe640 1 -- 172.21.15.62:0/1227559347 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f13d407a990 con 0x7f13dc15cbb0 2023-09-30T13:55:12.637 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:12.637 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T13:55:12.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 msgr2=0x7f13c806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 0x7f13c806cff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13cc004ea0 tx=0x7f13cc009040 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 msgr2=0x7f13dc0c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13d4036040 tx=0x7f13d4004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 shutdown_connections 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13c806ab30 0x7f13c806cff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13dc15cbb0 0x7f13dc0c46a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13dc0d1410 0x7f13dc0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 --2- 172.21.15.62:0/1227559347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13dc06b070 0x7f13dc0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 >> 172.21.15.62:0/1227559347 conn(0x7f13dc089fe0 msgr2=0x7f13dc06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 shutdown_connections 2023-09-30T13:55:12.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.638+0000 7f13e16ec640 1 -- 172.21.15.62:0/1227559347 wait complete. 2023-09-30T13:55:12.649 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T13:55:12.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.755+0000 7f3ee81dc640 1 Processor -- start 2023-09-30T13:55:12.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.755+0000 7f3ee81dc640 1 -- start start 2023-09-30T13:55:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee81dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ee00d0040 0x7f3ee00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee81dc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee015d190 con 0x7f3ee00ca200 2023-09-30T13:55:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee81dc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee00d05e0 con 0x7f3ee015cdb0 2023-09-30T13:55:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee81dc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee00b0900 con 0x7f3ee00d0040 2023-09-30T13:55:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee6779640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3ee00ca200 0x7f3ee00ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46014/0 (socket says 172.21.15.62:46014) 2023-09-30T13:55:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee5777640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ee00d0040 0x7f3ee00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee6779640 1 -- 172.21.15.62:0/737176872 learned_addr learned my addr 172.21.15.62:0/737176872 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee5777640 1 -- 172.21.15.62:0/737176872 >> v1:172.21.15.135:6789/0 conn(0x7f3ee015cdb0 legacy=0x7f3ee00cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee5777640 1 -- 172.21.15.62:0/737176872 >> v1:172.21.15.62:6789/0 conn(0x7f3ee00ca200 legacy=0x7f3ee00ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee4f76640 1 -- 172.21.15.62:0/737176872 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700857938 0 0) 0x7f3ee015d190 con 0x7f3ee00ca200 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.756+0000 7f3ee5777640 1 -- 172.21.15.62:0/737176872 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00b0be0 con 0x7f3ee00d0040 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.757+0000 7f3ee5777640 1 --2- 172.21.15.62:0/737176872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee00cc610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159ba4c1644cfc40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.757+0000 7f3ee4f76640 1 -- 172.21.15.62:0/737176872 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0030610 con 0x7f3ee00d0040 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.757+0000 7f3ee4f76640 1 -- 172.21.15.62:0/737176872 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0030770 con 0x7f3ee00d0040 2023-09-30T13:55:12.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.757+0000 7f3ee4f76640 1 -- 172.21.15.62:0/737176872 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0030b00 con 0x7f3ee00d0040 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 -- 172.21.15.62:0/737176872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 msgr2=0x7f3ee00cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/737176872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee00cc610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002b960 comp rx=0 tx=0).stop 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 -- 172.21.15.62:0/737176872 shutdown_connections 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/737176872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee00cc610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 -- 172.21.15.62:0/737176872 >> 172.21.15.62:0/737176872 conn(0x7f3ee0098a50 msgr2=0x7f3ee00cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 -- 172.21.15.62:0/737176872 shutdown_connections 2023-09-30T13:55:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.758+0000 7f3ee81dc640 1 -- 172.21.15.62:0/737176872 wait complete. 2023-09-30T13:55:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.759+0000 7f3ee81dc640 1 Processor -- start 2023-09-30T13:55:12.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.759+0000 7f3ee81dc640 1 -- start start 2023-09-30T13:55:12.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ee00ca200 0x7f3ee015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 0x7f3ee015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee015fd60 con 0x7f3ee00d0040 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee00b2630 con 0x7f3ee015cdb0 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee015a8c0 con 0x7f3ee00ca200 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39612/0 (socket says 172.21.15.62:39612) 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 -- 172.21.15.62:0/748730566 learned_addr learned my addr 172.21.15.62:0/748730566 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee6779640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 0x7f3ee015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 -- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ee00ca200 msgr2=0x7f3ee015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ee00ca200 0x7f3ee015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 -- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 msgr2=0x7f3ee015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 0x7f3ee015ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 -- 172.21.15.62:0/748730566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009400 con 0x7f3ee00d0040 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee6779640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 0x7f3ee015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee5777640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed003f070 con 0x7f3ee00d0040 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0004030 con 0x7f3ee00d0040 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee015f0e0 con 0x7f3ee00d0040 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00043e0 con 0x7f3ee00d0040 2023-09-30T13:55:12.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.760+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee015f6a0 con 0x7f3ee00d0040 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.761+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee015fea0 con 0x7f3ee00d0040 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.762+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3ed0043070 con 0x7f3ee00d0040 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.762+0000 7f3ed67fc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 0x7f3ec406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.763+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ed00ab1b0 con 0x7f3ee00d0040 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.763+0000 7f3ee5f78640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 0x7f3ec406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:12.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.763+0000 7f3ee5f78640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 0x7f3ec406cff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007fd0 tx=0x7f3edc0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:12.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.767+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3ee015fea0 con 0x7f3ee00d0040 2023-09-30T13:55:12.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.944+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ee015fea0 con 0x7f3ee00d0040 2023-09-30T13:55:12.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.946+0000 7f3ed67fc640 1 -- 172.21.15.62:0/748730566 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f3ee015fea0 con 0x7f3ee00d0040 2023-09-30T13:55:12.946 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:12.947 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:12.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.947+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 msgr2=0x7f3ec406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.947+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 0x7f3ec406cff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007fd0 tx=0x7f3edc0079a0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 msgr2=0x7f3ee015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 shutdown_connections 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3ec406ab30 0x7f3ec406cff0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee015cdb0 0x7f3ee015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee00d0040 0x7f3ee015e500 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 --2- 172.21.15.62:0/748730566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ee00ca200 0x7f3ee015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 >> 172.21.15.62:0/748730566 conn(0x7f3ee0098a50 msgr2=0x7f3ee006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 shutdown_connections 2023-09-30T13:55:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:12.948+0000 7f3ee81dc640 1 -- 172.21.15.62:0/748730566 wait complete. 2023-09-30T13:55:12.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:12.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:13.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.067+0000 7f3deb475640 1 Processor -- start 2023-09-30T13:55:13.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.067+0000 7f3deb475640 1 -- start start 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3deb475640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3deb475640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3de406b420 0x7f3de406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3deb475640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de406f6c0 con 0x7f3de406f270 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3deb475640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40ce3f0 con 0x7f3de406b420 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3deb475640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de406a120 con 0x7f3de415ce90 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de8a10640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3de406b420 0x7f3de406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de9a12640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3de406f270 0x7f3de40ca0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46018/0 (socket says 172.21.15.62:46018) 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de9a12640 1 -- 172.21.15.62:0/973197943 learned_addr learned my addr 172.21.15.62:0/973197943 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de9211640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de8a10640 1 -- 172.21.15.62:0/973197943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 msgr2=0x7f3de406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:13.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de8a10640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de8a10640 1 -- 172.21.15.62:0/973197943 >> v1:172.21.15.62:6789/0 conn(0x7f3de406f270 legacy=0x7f3de40ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3ddbfff640 1 -- 172.21.15.62:0/973197943 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419701838 0 0) 0x7f3ddc001490 con 0x7f3de406f270 2023-09-30T13:55:13.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.068+0000 7f3de8a10640 1 -- 172.21.15.62:0/973197943 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de406a400 con 0x7f3de406b420 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.069+0000 7f3de8a10640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406b420 0x7f3de406ed30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097a0 tx=0x7f3dd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffad45c592ce55a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.069+0000 7f3ddbfff640 1 -- 172.21.15.62:0/973197943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4031830 con 0x7f3de406b420 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.069+0000 7f3ddbfff640 1 -- 172.21.15.62:0/973197943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4031990 con 0x7f3de406b420 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.069+0000 7f3ddbfff640 1 -- 172.21.15.62:0/973197943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4031d20 con 0x7f3de406b420 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 -- 172.21.15.62:0/973197943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406b420 msgr2=0x7f3de406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406b420 0x7f3de406ed30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097a0 tx=0x7f3dd402b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 -- 172.21.15.62:0/973197943 shutdown_connections 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406b420 0x7f3de406ed30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 --2- 172.21.15.62:0/973197943 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 -- 172.21.15.62:0/973197943 >> 172.21.15.62:0/973197943 conn(0x7f3de40cc180 msgr2=0x7f3de40cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 -- 172.21.15.62:0/973197943 shutdown_connections 2023-09-30T13:55:13.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.070+0000 7f3deb475640 1 -- 172.21.15.62:0/973197943 wait complete. 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.071+0000 7f3deb475640 1 Processor -- start 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.071+0000 7f3deb475640 1 -- start start 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3de40cd780 0x7f3de40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40cdc30 con 0x7f3de406f270 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415da10 con 0x7f3de40cd780 2023-09-30T13:55:13.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40c5ae0 con 0x7f3de415ce90 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39632/0 (socket says 172.21.15.62:39632) 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 -- 172.21.15.62:0/3197369833 learned_addr learned my addr 172.21.15.62:0/3197369833 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de8a10640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9a12640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3de40cd780 0x7f3de40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 -- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 msgr2=0x7f3de40cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de40cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 -- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3de40cd780 msgr2=0x7f3de40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3de40cd780 0x7f3de40c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 -- 172.21.15.62:0/3197369833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4009400 con 0x7f3de406f270 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3de9211640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d5f0 tx=0x7f3de000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00125f0 con 0x7f3de406f270 2023-09-30T13:55:13.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0012750 con 0x7f3de406f270 2023-09-30T13:55:13.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40c5dc0 con 0x7f3de406f270 2023-09-30T13:55:13.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.072+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0012b00 con 0x7f3de406f270 2023-09-30T13:55:13.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.073+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de415d6a0 con 0x7f3de406f270 2023-09-30T13:55:13.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.074+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de404e0d0 con 0x7f3de406f270 2023-09-30T13:55:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.074+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3de0012c60 con 0x7f3de406f270 2023-09-30T13:55:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.074+0000 7f3dd9ffb640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 0x7f3dc806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.075+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3de00899f0 con 0x7f3de406f270 2023-09-30T13:55:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.075+0000 7f3de8a10640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 0x7f3dc806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.075+0000 7f3de8a10640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 0x7f3dc806cff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4036000 tx=0x7f3dd403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.079+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3de0054950 con 0x7f3de406f270 2023-09-30T13:55:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.253+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3de415d830 con 0x7f3de406f270 2023-09-30T13:55:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.253+0000 7f3dd9ffb640 1 -- 172.21.15.62:0/3197369833 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3de0057f70 con 0x7f3de406f270 2023-09-30T13:55:13.254 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 msgr2=0x7f3dc806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 0x7f3dc806cff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4036000 tx=0x7f3dd403c040 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 msgr2=0x7f3de4151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3de000d5f0 tx=0x7f3de000dab0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 shutdown_connections 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3dc806ab30 0x7f3dc806cff0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3de40cd780 0x7f3de40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3de415ce90 0x7f3de40cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 --2- 172.21.15.62:0/3197369833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3de406f270 0x7f3de4151d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 >> 172.21.15.62:0/3197369833 conn(0x7f3de40cc180 msgr2=0x7f3de4071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 shutdown_connections 2023-09-30T13:55:13.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.255+0000 7f3deb475640 1 -- 172.21.15.62:0/3197369833 wait complete. 2023-09-30T13:55:13.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:13.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.375+0000 7f959b98a640 1 Processor -- start 2023-09-30T13:55:13.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.375+0000 7f959b98a640 1 -- start start 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f959b98a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f959415cbc0 0x7f95940d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f959b98a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f959b98a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940d1410 con 0x7f95940cd8c0 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f959b98a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95940d16f0 con 0x7f959415cbc0 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f959b98a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940d19d0 con 0x7f95940b8760 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9598f25640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599726640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f959415cbc0 0x7f95940d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9598f25640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38564/0 (socket says 172.21.15.62:38564) 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9598f25640 1 -- 172.21.15.62:0/3792920034 learned_addr learned my addr 172.21.15.62:0/3792920034 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599f27640 1 --1- 172.21.15.62:0/3792920034 >> v1:172.21.15.135:6789/0 conn(0x7f95940cd8c0 0x7f95940b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:50354/0 (socket says 172.21.15.62:50354) 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599726640 1 -- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 msgr2=0x7f95940d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599726640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599726640 1 -- 172.21.15.62:0/3792920034 >> v1:172.21.15.135:6789/0 conn(0x7f95940cd8c0 legacy=0x7f95940b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9599726640 1 -- 172.21.15.62:0/3792920034 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940d1cb0 con 0x7f959415cbc0 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9593fff640 1 -- 172.21.15.62:0/3792920034 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986981678 0 0) 0x7f95940d1410 con 0x7f95940cd8c0 2023-09-30T13:55:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.376+0000 7f9598f25640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:13.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.377+0000 7f9599726640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959415cbc0 0x7f95940d24b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9584009d90 tx=0x7f958402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ee6acfb596bf22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.377+0000 7f9593fff640 1 -- 172.21.15.62:0/3792920034 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958402cc60 con 0x7f959415cbc0 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.377+0000 7f9593fff640 1 -- 172.21.15.62:0/3792920034 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958402cdc0 con 0x7f959415cbc0 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.377+0000 7f9593fff640 1 -- 172.21.15.62:0/3792920034 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584034660 con 0x7f959415cbc0 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 -- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959415cbc0 msgr2=0x7f95940d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959415cbc0 0x7f95940d24b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9584009d90 tx=0x7f958402beb0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 -- 172.21.15.62:0/3792920034 shutdown_connections 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95940b8760 0x7f95940d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 --2- 172.21.15.62:0/3792920034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959415cbc0 0x7f95940d24b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 -- 172.21.15.62:0/3792920034 >> 172.21.15.62:0/3792920034 conn(0x7f95940718a0 msgr2=0x7f9594071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 -- 172.21.15.62:0/3792920034 shutdown_connections 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.378+0000 7f959b98a640 1 -- 172.21.15.62:0/3792920034 wait complete. 2023-09-30T13:55:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.379+0000 7f959b98a640 1 Processor -- start 2023-09-30T13:55:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.379+0000 7f959b98a640 1 -- start start 2023-09-30T13:55:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95940b8760 0x7f9594151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959415cbc0 0x7f95940cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9594160180 con 0x7f95940cd8c0 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959415f970 con 0x7f95940b8760 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f959b98a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95941516d0 con 0x7f959415cbc0 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39640/0 (socket says 172.21.15.62:39640) 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 -- 172.21.15.62:0/656536873 learned_addr learned my addr 172.21.15.62:0/656536873 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9599726640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95940b8760 0x7f9594151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9599f27640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959415cbc0 0x7f95940cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 -- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959415cbc0 msgr2=0x7f95940cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959415cbc0 0x7f95940cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 -- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95940b8760 msgr2=0x7f9594151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95940b8760 0x7f9594151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 -- 172.21.15.62:0/656536873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094d0 con 0x7f95940cd8c0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.380+0000 7f9598f25640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f958800ea00 tx=0x7f958800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.381+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800ca60 con 0x7f95940cd8c0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.381+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958800cbc0 con 0x7f95940cd8c0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.381+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9584009a70 con 0x7f95940cd8c0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.381+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588013470 con 0x7f95940cd8c0 2023-09-30T13:55:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.381+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959415fea0 con 0x7f95940cd8c0 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.382+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959404e0d0 con 0x7f95940cd8c0 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.382+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f95880135d0 con 0x7f95940cd8c0 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.383+0000 7f9591ffb640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 0x7f958006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.383+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9588089710 con 0x7f95940cd8c0 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.383+0000 7f9599726640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 0x7f958006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.384+0000 7f9599726640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 0x7f958006cff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9584036000 tx=0x7f9584030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.387+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9588054720 con 0x7f95940cd8c0 2023-09-30T13:55:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.564+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9594072160 con 0x7f95940cd8c0 2023-09-30T13:55:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.564+0000 7f9591ffb640 1 -- 172.21.15.62:0/656536873 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9588057d40 con 0x7f95940cd8c0 2023-09-30T13:55:13.565 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.566+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 msgr2=0x7f958006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.566+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 0x7f958006cff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9584036000 tx=0x7f9584030000 comp rx=0 tx=0).stop 2023-09-30T13:55:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.566+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 msgr2=0x7f95940cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.566+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f958800ea00 tx=0x7f958800eec0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 shutdown_connections 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f958006ab30 0x7f958006cff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959415cbc0 0x7f95940cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95940cd8c0 0x7f95940cac10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 --2- 172.21.15.62:0/656536873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95940b8760 0x7f9594151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 >> 172.21.15.62:0/656536873 conn(0x7f95940718a0 msgr2=0x7f95940d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 shutdown_connections 2023-09-30T13:55:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.567+0000 7f959b98a640 1 -- 172.21.15.62:0/656536873 wait complete. 2023-09-30T13:55:13.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.686+0000 7fa79b21f640 1 Processor -- start 2023-09-30T13:55:13.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.686+0000 7fa79b21f640 1 -- start start 2023-09-30T13:55:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa79b21f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa79415cbc0 0x7fa7940d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa79b21f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940cd8c0 0x7fa7940cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa79b21f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940d1410 con 0x7fa7940b8760 2023-09-30T13:55:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa79b21f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940ce290 con 0x7fa79415cbc0 2023-09-30T13:55:13.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa79b21f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940d16f0 con 0x7fa7940cd8c0 2023-09-30T13:55:13.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa798fbb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa79415cbc0 0x7fa7940d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa793fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa7940b8760 0x7fa7940d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46024/0 (socket says 172.21.15.62:46024) 2023-09-30T13:55:13.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.687+0000 7fa793fff640 1 -- 172.21.15.62:0/2656169706 learned_addr learned my addr 172.21.15.62:0/2656169706 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:13.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa7997bc640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940cd8c0 0x7fa7940cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa798fbb640 1 -- 172.21.15.62:0/2656169706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940cd8c0 msgr2=0x7fa7940cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940cd8c0 0x7fa7940cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa798fbb640 1 -- 172.21.15.62:0/2656169706 >> v1:172.21.15.62:6789/0 conn(0x7fa7940b8760 legacy=0x7fa7940d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa7937fe640 1 -- 172.21.15.62:0/2656169706 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596836946 0 0) 0x7fa7940d1410 con 0x7fa7940b8760 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa798fbb640 1 -- 172.21.15.62:0/2656169706 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940d19d0 con 0x7fa79415cbc0 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.688+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d24b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097a0 tx=0x7fa78802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7906d2da79e0870c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa7937fe640 1 -- 172.21.15.62:0/2656169706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788031830 con 0x7fa79415cbc0 2023-09-30T13:55:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa7937fe640 1 -- 172.21.15.62:0/2656169706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788031990 con 0x7fa79415cbc0 2023-09-30T13:55:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa7937fe640 1 -- 172.21.15.62:0/2656169706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788031d20 con 0x7fa79415cbc0 2023-09-30T13:55:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 -- 172.21.15.62:0/2656169706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 msgr2=0x7fa7940d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d24b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7880097a0 tx=0x7fa78802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 -- 172.21.15.62:0/2656169706 shutdown_connections 2023-09-30T13:55:13.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940cd8c0 0x7fa7940cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2656169706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d24b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 -- 172.21.15.62:0/2656169706 >> 172.21.15.62:0/2656169706 conn(0x7fa7940718a0 msgr2=0x7fa794071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 -- 172.21.15.62:0/2656169706 shutdown_connections 2023-09-30T13:55:13.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.689+0000 7fa79b21f640 1 -- 172.21.15.62:0/2656169706 wait complete. 2023-09-30T13:55:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.690+0000 7fa79b21f640 1 Processor -- start 2023-09-30T13:55:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.690+0000 7fa79b21f640 1 -- start start 2023-09-30T13:55:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 0x7fa7941580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940cd8c0 0x7fa794153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794158da0 con 0x7fa79415cbc0 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7941f56b0 con 0x7fa7940cd8c0 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa79b21f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794158600 con 0x7fa7940b8760 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa7997bc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa7997bc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39648/0 (socket says 172.21.15.62:39648) 2023-09-30T13:55:13.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.691+0000 7fa7997bc640 1 -- 172.21.15.62:0/2614731909 learned_addr learned my addr 172.21.15.62:0/2614731909 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa793fff640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940cd8c0 0x7fa794153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 0x7fa7941580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 -- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 msgr2=0x7fa7941580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 0x7fa7941580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 -- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940cd8c0 msgr2=0x7fa794153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940cd8c0 0x7fa794153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 -- 172.21.15.62:0/2614731909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788009400 con 0x7fa79415cbc0 2023-09-30T13:55:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 0x7fa7941580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:13.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7997bc640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa78c007e40 tx=0x7fa78c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c014620 con 0x7fa79415cbc0 2023-09-30T13:55:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00ee90 con 0x7fa79415cbc0 2023-09-30T13:55:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0149e0 con 0x7fa79415cbc0 2023-09-30T13:55:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7941f5900 con 0x7fa79415cbc0 2023-09-30T13:55:13.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.692+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7941f5ec0 con 0x7fa79415cbc0 2023-09-30T13:55:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.693+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79404e0d0 con 0x7fa79415cbc0 2023-09-30T13:55:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.693+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa78c014b40 con 0x7fa79415cbc0 2023-09-30T13:55:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.694+0000 7fa7917fa640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 0x7fa77806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.694+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa78c089f30 con 0x7fa79415cbc0 2023-09-30T13:55:13.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.694+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 0x7fa77806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.695+0000 7fa798fbb640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 0x7fa77806cff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa788036000 tx=0x7fa78803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.698+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa78c054e90 con 0x7fa79415cbc0 2023-09-30T13:55:13.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.872+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa794159130 con 0x7fa79415cbc0 2023-09-30T13:55:13.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.873+0000 7fa7917fa640 1 -- 172.21.15.62:0/2614731909 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa78c0584b0 con 0x7fa79415cbc0 2023-09-30T13:55:13.873 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 msgr2=0x7fa77806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 0x7fa77806cff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa788036000 tx=0x7fa78803c040 comp rx=0 tx=0).stop 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 msgr2=0x7fa7940d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa78c007e40 tx=0x7fa78c00e4b0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 shutdown_connections 2023-09-30T13:55:13.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa77806ab30 0x7fa77806cff0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa79415cbc0 0x7fa7940d2a80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7940cd8c0 0x7fa794153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 --2- 172.21.15.62:0/2614731909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7940b8760 0x7fa7941580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 >> 172.21.15.62:0/2614731909 conn(0x7fa7940718a0 msgr2=0x7fa794156490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.874+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 shutdown_connections 2023-09-30T13:55:13.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.875+0000 7fa79b21f640 1 -- 172.21.15.62:0/2614731909 wait complete. 2023-09-30T13:55:13.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:13.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 Processor -- start 2023-09-30T13:55:13.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 -- start start 2023-09-30T13:55:13.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780b8760 0x7fd7780d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7780cd8c0 0x7fd7780cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7780d1410 con 0x7fd77815cbc0 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7780ce290 con 0x7fd7780cd8c0 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.994+0000 7fd77dc3f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780d16f0 con 0x7fd7780b8760 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd777fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7780cd8c0 0x7fd7780cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd7777fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd77815cbc0 0x7fd7780d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46030/0 (socket says 172.21.15.62:46030) 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd7777fe640 1 -- 172.21.15.62:0/4260426207 learned_addr learned my addr 172.21.15.62:0/4260426207 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd776ffd640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780b8760 0x7fd7780d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd777fff640 1 -- 172.21.15.62:0/4260426207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780b8760 msgr2=0x7fd7780d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd777fff640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780b8760 0x7fd7780d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd777fff640 1 -- 172.21.15.62:0/4260426207 >> v1:172.21.15.62:6789/0 conn(0x7fd77815cbc0 legacy=0x7fd7780d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd777fff640 1 -- 172.21.15.62:0/4260426207 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780d19d0 con 0x7fd7780cd8c0 2023-09-30T13:55:13.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.995+0000 7fd7767fc640 1 -- 172.21.15.62:0/4260426207 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257397234 0 0) 0x7fd7780d1410 con 0x7fd77815cbc0 2023-09-30T13:55:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd777fff640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7780cd8c0 0x7fd7780cdd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd770009d90 tx=0x7fd77002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90a8710002b9955 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd7767fc640 1 -- 172.21.15.62:0/4260426207 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77002cc60 con 0x7fd7780cd8c0 2023-09-30T13:55:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd7767fc640 1 -- 172.21.15.62:0/4260426207 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77002cdc0 con 0x7fd7780cd8c0 2023-09-30T13:55:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd7767fc640 1 -- 172.21.15.62:0/4260426207 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770034660 con 0x7fd7780cd8c0 2023-09-30T13:55:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 -- 172.21.15.62:0/4260426207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7780cd8c0 msgr2=0x7fd7780cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7780cd8c0 0x7fd7780cdd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd770009d90 tx=0x7fd77002beb0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 -- 172.21.15.62:0/4260426207 shutdown_connections 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7780cd8c0 0x7fd7780cdd50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/4260426207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780b8760 0x7fd7780d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 -- 172.21.15.62:0/4260426207 >> 172.21.15.62:0/4260426207 conn(0x7fd7780718a0 msgr2=0x7fd778071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 -- 172.21.15.62:0/4260426207 shutdown_connections 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.996+0000 7fd77dc3f640 1 -- 172.21.15.62:0/4260426207 wait complete. 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 Processor -- start 2023-09-30T13:55:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 -- start start 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7780b8760 0x7fd7780c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780cd8c0 0x7fd7780b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780cb220 con 0x7fd77815cbc0 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780cb500 con 0x7fd7780b8760 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.998+0000 7fd77dc3f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780cb7e0 con 0x7fd7780cd8c0 2023-09-30T13:55:14.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39676/0 (socket says 172.21.15.62:39676) 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 -- 172.21.15.62:0/1586374466 learned_addr learned my addr 172.21.15.62:0/1586374466 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 -- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780cd8c0 msgr2=0x7fd7780b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780cd8c0 0x7fd7780b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 -- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7780b8760 msgr2=0x7fd7780c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7780b8760 0x7fd7780c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 -- 172.21.15.62:0/1586374466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009a70 con 0x7fd77815cbc0 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd777fff640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd770009d90 tx=0x7fd770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770003b90 con 0x7fd77815cbc0 2023-09-30T13:55:14.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd770003d10 con 0x7fd77815cbc0 2023-09-30T13:55:14.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780cbac0 con 0x7fd77815cbc0 2023-09-30T13:55:14.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770004270 con 0x7fd77815cbc0 2023-09-30T13:55:14.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:13.999+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7780cbda0 con 0x7fd77815cbc0 2023-09-30T13:55:14.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.000+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7780cbf30 con 0x7fd77815cbc0 2023-09-30T13:55:14.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.001+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd77003b050 con 0x7fd77815cbc0 2023-09-30T13:55:14.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.001+0000 7fd75ffff640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 0x7fd76406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.001+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7700aba20 con 0x7fd77815cbc0 2023-09-30T13:55:14.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.001+0000 7fd7777fe640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 0x7fd76406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.002+0000 7fd7777fe640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 0x7fd76406cff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd768007fd0 tx=0x7fd768007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.005+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd770076980 con 0x7fd77815cbc0 2023-09-30T13:55:14.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.185+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd77804e0d0 con 0x7fd77815cbc0 2023-09-30T13:55:14.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.185+0000 7fd75ffff640 1 -- 172.21.15.62:0/1586374466 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd770039020 con 0x7fd77815cbc0 2023-09-30T13:55:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 msgr2=0x7fd76406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 0x7fd76406cff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd768007fd0 tx=0x7fd768007960 comp rx=0 tx=0).stop 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 msgr2=0x7fd7780b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd770009d90 tx=0x7fd770004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 shutdown_connections 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd76406ab30 0x7fd76406cff0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd77815cbc0 0x7fd7780b73d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7780cd8c0 0x7fd7780b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 --2- 172.21.15.62:0/1586374466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7780b8760 0x7fd7780c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 >> 172.21.15.62:0/1586374466 conn(0x7fd7780718a0 msgr2=0x7fd7781e8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 shutdown_connections 2023-09-30T13:55:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.187+0000 7fd77dc3f640 1 -- 172.21.15.62:0/1586374466 wait complete. 2023-09-30T13:55:14.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.304+0000 7f77f0b5a640 1 Processor -- start 2023-09-30T13:55:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.304+0000 7f77f0b5a640 1 -- start start 2023-09-30T13:55:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77ec0d0040 0x7f77ec0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77ec0cc980 0x7f77ec069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec15d190 con 0x7f77ec0d0040 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec0d05e0 con 0x7f77ec0cc980 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77f0b5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0b0900 con 0x7f77ec15cdb0 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77e9d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77ec0d0040 0x7f77ec0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77e9d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77ec0d0040 0x7f77ec0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39688/0 (socket says 172.21.15.62:39688) 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3775146131 learned_addr learned my addr 172.21.15.62:0/3775146131 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77ea59c640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.305+0000 7f77ead9d640 1 --2- 172.21.15.62:0/3775146131 >> v2:172.21.15.135:3300/0 conn(0x7f77ec0cc980 0x7f77ec069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3775146131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 msgr2=0x7f77ec0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3775146131 >> v2:172.21.15.135:3300/0 conn(0x7f77ec0cc980 msgr2=0x7f77ec069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3775146131 >> v2:172.21.15.135:3300/0 conn(0x7f77ec0cc980 0x7f77ec069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3775146131 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0b0be0 con 0x7f77ec0d0040 2023-09-30T13:55:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77ea59c640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.306+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0cc440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b0770 tx=0x7f77d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a84922be157bd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77e959a640 1 -- 172.21.15.62:0/3775146131 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4031870 con 0x7f77ec0d0040 2023-09-30T13:55:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77e959a640 1 -- 172.21.15.62:0/3775146131 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40319d0 con 0x7f77ec0d0040 2023-09-30T13:55:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77e959a640 1 -- 172.21.15.62:0/3775146131 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4031d60 con 0x7f77ec0d0040 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3775146131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 msgr2=0x7f77ec0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0cc440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b0770 tx=0x7f77d402b910 comp rx=0 tx=0).stop 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3775146131 shutdown_connections 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3775146131 >> v2:172.21.15.135:3300/0 conn(0x7f77ec0cc980 0x7f77ec069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0cc440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3775146131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3775146131 >> 172.21.15.62:0/3775146131 conn(0x7f77ec098a50 msgr2=0x7f77ec0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3775146131 shutdown_connections 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.307+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3775146131 wait complete. 2023-09-30T13:55:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.308+0000 7f77f0b5a640 1 Processor -- start 2023-09-30T13:55:14.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.308+0000 7f77f0b5a640 1 -- start start 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ec0cc980 0x7f77ec15f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec150a90 con 0x7f77ec0d0040 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0b1bb0 con 0x7f77ec0cc980 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77f0b5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec0b1e90 con 0x7f77ec15cdb0 2023-09-30T13:55:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77e9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77e9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39704/0 (socket says 172.21.15.62:39704) 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3345571137 learned_addr learned my addr 172.21.15.62:0/3345571137 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77ea59c640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ec0cc980 0x7f77ec15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.309+0000 7f77ead9d640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 msgr2=0x7f77ec150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ec0cc980 msgr2=0x7f77ec15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ec0cc980 0x7f77ec15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 -- 172.21.15.62:0/3345571137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc009a70 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77ead9d640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e9d9b640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f77d402b950 tx=0x7f77d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d403ac60 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d403adc0 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40094d0 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4044630 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.310+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec0b2450 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.311+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec0b2640 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.312+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f77d404d450 con 0x7f77ec0d0040 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.312+0000 7f77e2ffd640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 0x7f77cc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.312+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77d402d040 con 0x7f77ec0d0040 2023-09-30T13:55:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.312+0000 7f77ea59c640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 0x7f77cc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.313+0000 7f77ea59c640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 0x7f77cc06cff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0115a0 tx=0x7f77dc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.316+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f77d40767c0 con 0x7f77ec0d0040 2023-09-30T13:55:14.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.530+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77ec04e0d0 con 0x7f77ec0d0040 2023-09-30T13:55:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.531+0000 7f77e2ffd640 1 -- 172.21.15.62:0/3345571137 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f77d4079de0 con 0x7f77ec0d0040 2023-09-30T13:55:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:14.532 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 msgr2=0x7f77cc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 0x7f77cc06cff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0115a0 tx=0x7f77dc00b040 comp rx=0 tx=0).stop 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 msgr2=0x7f77ec0b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f77d402b950 tx=0x7f77d40046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 shutdown_connections 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f77cc06ab30 0x7f77cc06cff0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77ec15cdb0 0x7f77ec150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ec0d0040 0x7f77ec0b4b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 --2- 172.21.15.62:0/3345571137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77ec0cc980 0x7f77ec15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 >> 172.21.15.62:0/3345571137 conn(0x7f77ec098a50 msgr2=0x7f77ec0c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 shutdown_connections 2023-09-30T13:55:14.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.533+0000 7f77f0b5a640 1 -- 172.21.15.62:0/3345571137 wait complete. 2023-09-30T13:55:14.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.650+0000 7ff81cad4640 1 Processor -- start 2023-09-30T13:55:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.650+0000 7ff81cad4640 1 -- start start 2023-09-30T13:55:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff81cad4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff81815a8c0 0x7ff81815d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff81cad4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81806d0b0 con 0x7ff81806cb40 2023-09-30T13:55:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff81cad4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81806d390 con 0x7ff81806dcd0 2023-09-30T13:55:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff81cad4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81806d670 con 0x7ff81815a8c0 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff80ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff81806cb40 0x7ff818069d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46046/0 (socket says 172.21.15.62:46046) 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff80ffff640 1 -- 172.21.15.62:0/993046301 learned_addr learned my addr 172.21.15.62:0/993046301 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54371108 0 0) 0x7ff81806d0b0 con 0x7ff81806cb40 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff81659c640 1 --2- 172.21.15.62:0/993046301 >> v2:172.21.15.135:3300/0 conn(0x7ff81815a8c0 0x7ff81815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff804003520 con 0x7ff81806cb40 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3171782963 0 0) 0x7ff804003520 con 0x7ff81806cb40 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 >> v2:172.21.15.135:3300/0 conn(0x7ff81815a8c0 msgr2=0x7ff81815d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 --2- 172.21.15.62:0/993046301 >> v2:172.21.15.135:3300/0 conn(0x7ff81815a8c0 0x7ff81815d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 >> v1:172.21.15.135:6789/0 conn(0x7ff81806dcd0 legacy=0x7ff8180ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81806d950 con 0x7ff81806cb40 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7ff800001670 con 0x7ff81806cb40 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 >> v1:172.21.15.62:6789/0 conn(0x7ff81806cb40 legacy=0x7ff818069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.651+0000 7ff815d9b640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 0x7ff804003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff815d9b640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8040047c0 0x7ff804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff815d9b640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff804005180 0x7ff80400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81806d670 con 0x7ff804003970 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80400c020 con 0x7ff804005180 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80400c1e0 con 0x7ff8040047c0 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 0x7ff804003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff816d9d640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff804005180 0x7ff80400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff80ffff640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8040047c0 0x7ff804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 -- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8040047c0 msgr2=0x7ff804004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff8040047c0 0x7ff804004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 -- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff804005180 msgr2=0x7ff80400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff804005180 0x7ff80400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff816d9d640 1 -- 172.21.15.62:0/993046301 reap_dead start 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.652+0000 7ff81659c640 1 -- 172.21.15.62:0/993046301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804003520 con 0x7ff804003970 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81659c640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 0x7ff804003d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff808009ac0 tx=0x7ff8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6e3fdb768d91e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80802c6b0 con 0x7ff804003970 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80802c810 con 0x7ff804003970 2023-09-30T13:55:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff815d9b640 1 -- 172.21.15.62:0/993046301 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80802cba0 con 0x7ff804003970 2023-09-30T13:55:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 -- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 msgr2=0x7ff804003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 0x7ff804003d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff808009ac0 tx=0x7ff8040057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 -- 172.21.15.62:0/993046301 shutdown_connections 2023-09-30T13:55:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 --2- 172.21.15.62:0/993046301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff804003970 0x7ff804003d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 -- 172.21.15.62:0/993046301 >> 172.21.15.62:0/993046301 conn(0x7ff8180b0b50 msgr2=0x7ff8180b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 -- 172.21.15.62:0/993046301 shutdown_connections 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.653+0000 7ff81cad4640 1 -- 172.21.15.62:0/993046301 wait complete. 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 Processor -- start 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 -- start start 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff804003970 0x7ff81806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 0x7ff818155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181562e0 con 0x7ff8181e7500 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff818155840 con 0x7ff8181559e0 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff81cad4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81806b350 con 0x7ff804003970 2023-09-30T13:55:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.655+0000 7ff816d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39718/0 (socket says 172.21.15.62:39718) 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 -- 172.21.15.62:0/1429446139 learned_addr learned my addr 172.21.15.62:0/1429446139 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff80ffff640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 0x7ff818155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 -- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff804003970 msgr2=0x7ff81806ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff804003970 0x7ff81806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 -- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 msgr2=0x7ff818155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 0x7ff818155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 -- 172.21.15.62:0/1429446139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8181e81d0 con 0x7ff8181e7500 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff80ffff640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 0x7ff818155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:14.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff816d9d640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b1c50 tx=0x7ff81000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000feb0 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810006d60 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8181e84b0 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810003bb0 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.656+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8181e8a70 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.657+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8181e8c90 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.657+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff810003d10 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.658+0000 7ff80effd640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 0x7ff7f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.658+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff810088be0 con 0x7ff8181e7500 2023-09-30T13:55:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.658+0000 7ff81659c640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 0x7ff7f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.659+0000 7ff81659c640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 0x7ff7f806cff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff808036000 tx=0x7ff80802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.662+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff810053b40 con 0x7ff8181e7500 2023-09-30T13:55:14.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.839+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff81804e0d0 con 0x7ff8181e7500 2023-09-30T13:55:14.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.840+0000 7ff80effd640 1 -- 172.21.15.62:0/1429446139 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7ff810057160 con 0x7ff8181e7500 2023-09-30T13:55:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:14.842 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.842+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 msgr2=0x7ff7f806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.842+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 0x7ff7f806cff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff808036000 tx=0x7ff80802e000 comp rx=0 tx=0).stop 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.842+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 msgr2=0x7ff8181e7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.842+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b1c50 tx=0x7ff81000fc00 comp rx=0 tx=0).stop 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 shutdown_connections 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7f806ab30 0x7ff7f806cff0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8181e7500 0x7ff8181e7980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8181559e0 0x7ff818155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 --2- 172.21.15.62:0/1429446139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff804003970 0x7ff81806ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 >> 172.21.15.62:0/1429446139 conn(0x7ff8180b0b50 msgr2=0x7ff8180af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 shutdown_connections 2023-09-30T13:55:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.843+0000 7ff81cad4640 1 -- 172.21.15.62:0/1429446139 wait complete. 2023-09-30T13:55:14.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:14.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.962+0000 7f4f729c9640 1 Processor -- start 2023-09-30T13:55:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 -- start start 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4f6c15cbc0 0x7f4f6c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f6c0cd8c0 0x7f4f6c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0ce250 con 0x7f4f6c0b8760 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0d1410 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f729c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0d16f0 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f70f66640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f6c0cd8c0 0x7f4f6c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f6b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f6c0b8760 0x7f4f6c0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46058/0 (socket says 172.21.15.62:46058) 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.963+0000 7f4f6b7fe640 1 -- 172.21.15.62:0/1437749266 learned_addr learned my addr 172.21.15.62:0/1437749266 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:14.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f6bfff640 1 --2- 172.21.15.62:0/1437749266 >> v2:172.21.15.135:3300/0 conn(0x7f4f6c15cbc0 0x7f4f6c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f70f66640 1 -- 172.21.15.62:0/1437749266 >> v2:172.21.15.135:3300/0 conn(0x7f4f6c15cbc0 msgr2=0x7f4f6c0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f70f66640 1 --2- 172.21.15.62:0/1437749266 >> v2:172.21.15.135:3300/0 conn(0x7f4f6c15cbc0 0x7f4f6c0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f70f66640 1 -- 172.21.15.62:0/1437749266 >> v1:172.21.15.62:6789/0 conn(0x7f4f6c0b8760 legacy=0x7f4f6c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f6affd640 1 -- 172.21.15.62:0/1437749266 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051842903 0 0) 0x7f4f54001110 con 0x7f4f6c0b8760 2023-09-30T13:55:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.964+0000 7f4f70f66640 1 -- 172.21.15.62:0/1437749266 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0d19d0 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f70f66640 1 --2- 172.21.15.62:0/1437749266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0cdd10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c06c070 tx=0x7f4f6402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573556d500db789f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f6affd640 1 -- 172.21.15.62:0/1437749266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6402cc80 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f6affd640 1 -- 172.21.15.62:0/1437749266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6402cde0 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f6affd640 1 -- 172.21.15.62:0/1437749266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64034660 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 -- 172.21.15.62:0/1437749266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c0cd8c0 msgr2=0x7f4f6c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 --2- 172.21.15.62:0/1437749266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0cdd10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c06c070 tx=0x7f4f6402bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 -- 172.21.15.62:0/1437749266 shutdown_connections 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 --2- 172.21.15.62:0/1437749266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0cdd10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 --2- 172.21.15.62:0/1437749266 >> v2:172.21.15.135:3300/0 conn(0x7f4f6c15cbc0 0x7f4f6c0d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 -- 172.21.15.62:0/1437749266 >> 172.21.15.62:0/1437749266 conn(0x7f4f6c0718a0 msgr2=0x7f4f6c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 -- 172.21.15.62:0/1437749266 shutdown_connections 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.965+0000 7f4f729c9640 1 -- 172.21.15.62:0/1437749266 wait complete. 2023-09-30T13:55:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.966+0000 7f4f729c9640 1 Processor -- start 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 -- start start 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f6c0b8760 0x7f4f6c158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c1f3430 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c7600 con 0x7f4f6c0cd8c0 2023-09-30T13:55:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f729c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c78e0 con 0x7f4f6c0b8760 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f70f66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f70f66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39744/0 (socket says 172.21.15.62:39744) 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.967+0000 7f4f70f66640 1 -- 172.21.15.62:0/3995161162 learned_addr learned my addr 172.21.15.62:0/3995161162 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 -- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f6c0b8760 msgr2=0x7f4f6c158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f6c0b8760 0x7f4f6c158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 -- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f6c0cd8c0 msgr2=0x7f4f6c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 -- 172.21.15.62:0/3995161162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64009a70 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f70f66640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e80 tx=0x7f4f64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64040650 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f640407b0 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c1f36d0 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64040b60 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.968+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c159410 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.969+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c1f38e0 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.969+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4f64040cc0 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.970+0000 7f4f68ff9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 0x7f4f4c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.970+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f640ac130 con 0x7f4f6c15cbc0 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.970+0000 7f4f6bfff640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 0x7f4f4c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.970+0000 7f4f6bfff640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 0x7f4f4c06cff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006a90 tx=0x7f4f5c006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:14.974+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4f64077120 con 0x7f4f6c15cbc0 2023-09-30T13:55:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.147+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f6c04e0d0 con 0x7f4f6c15cbc0 2023-09-30T13:55:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.148+0000 7f4f68ff9640 1 -- 172.21.15.62:0/3995161162 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f64009450 con 0x7f4f6c15cbc0 2023-09-30T13:55:15.148 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 msgr2=0x7f4f4c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 0x7f4f4c06cff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006a90 tx=0x7f4f5c006a20 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 msgr2=0x7f4f6c1f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f64009e80 tx=0x7f4f64004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 shutdown_connections 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4f4c06ab30 0x7f4f4c06cff0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f6c15cbc0 0x7f4f6c1f57c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f6c0cd8c0 0x7f4f6c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 --2- 172.21.15.62:0/3995161162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f6c0b8760 0x7f4f6c158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 >> 172.21.15.62:0/3995161162 conn(0x7f4f6c0718a0 msgr2=0x7f4f6c157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 shutdown_connections 2023-09-30T13:55:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.150+0000 7f4f729c9640 1 -- 172.21.15.62:0/3995161162 wait complete. 2023-09-30T13:55:15.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.270+0000 7faa0b475640 1 Processor -- start 2023-09-30T13:55:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.270+0000 7faa0b475640 1 -- start start 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa0b475640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa0415cbc0 0x7faa040d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa0b475640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040d1410 con 0x7faa040b8760 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa0b475640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040d16f0 con 0x7faa040cd8c0 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa0b475640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040d19d0 con 0x7faa0415cbc0 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa09211640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa0415cbc0 0x7faa040d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa08a10640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa040b8760 0x7faa040d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46072/0 (socket says 172.21.15.62:46072) 2023-09-30T13:55:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa08a10640 1 -- 172.21.15.62:0/3522786193 learned_addr learned my addr 172.21.15.62:0/3522786193 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa09211640 1 -- 172.21.15.62:0/3522786193 >> v1:172.21.15.135:6789/0 conn(0x7faa040cd8c0 legacy=0x7faa040b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa09211640 1 -- 172.21.15.62:0/3522786193 >> v1:172.21.15.62:6789/0 conn(0x7faa040b8760 legacy=0x7faa040d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa09211640 1 -- 172.21.15.62:0/3522786193 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040d1cb0 con 0x7faa0415cbc0 2023-09-30T13:55:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.271+0000 7faa03fff640 1 -- 172.21.15.62:0/3522786193 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541991505 0 0) 0x7faa040d1410 con 0x7faa040b8760 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.272+0000 7faa09211640 1 --2- 172.21.15.62:0/3522786193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040d24b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0097a0 tx=0x7fa9fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcf95e9cbbb794b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.272+0000 7faa03fff640 1 -- 172.21.15.62:0/3522786193 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc030610 con 0x7faa0415cbc0 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.272+0000 7faa03fff640 1 -- 172.21.15.62:0/3522786193 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc030770 con 0x7faa0415cbc0 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.272+0000 7faa03fff640 1 -- 172.21.15.62:0/3522786193 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc030b00 con 0x7faa0415cbc0 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 -- 172.21.15.62:0/3522786193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 msgr2=0x7faa040d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 --2- 172.21.15.62:0/3522786193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040d24b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0097a0 tx=0x7fa9fc02b960 comp rx=0 tx=0).stop 2023-09-30T13:55:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 -- 172.21.15.62:0/3522786193 shutdown_connections 2023-09-30T13:55:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 --2- 172.21.15.62:0/3522786193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040d24b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 -- 172.21.15.62:0/3522786193 >> 172.21.15.62:0/3522786193 conn(0x7faa040718a0 msgr2=0x7faa04071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 -- 172.21.15.62:0/3522786193 shutdown_connections 2023-09-30T13:55:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.273+0000 7faa0b475640 1 -- 172.21.15.62:0/3522786193 wait complete. 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.274+0000 7faa0b475640 1 Processor -- start 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.274+0000 7faa0b475640 1 -- start start 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa040b8760 0x7faa041547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa040cd8c0 0x7faa040cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c9470 con 0x7faa0415cbc0 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa041539e0 con 0x7faa040b8760 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa0b475640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa04153cc0 con 0x7faa040cd8c0 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39756/0 (socket says 172.21.15.62:39756) 2023-09-30T13:55:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 -- 172.21.15.62:0/636287274 learned_addr learned my addr 172.21.15.62:0/636287274 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09211640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa040b8760 0x7faa041547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa08a10640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa040cd8c0 0x7faa040cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 -- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa040cd8c0 msgr2=0x7faa040cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa040cd8c0 0x7faa040cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 -- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa040b8760 msgr2=0x7faa041547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa040b8760 0x7faa041547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 -- 172.21.15.62:0/636287274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc009400 con 0x7faa0415cbc0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.275+0000 7faa09a12640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c7a0 tx=0x7fa9f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.276+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003b70 con 0x7faa0415cbc0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.276+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4003cf0 con 0x7faa0415cbc0 2023-09-30T13:55:15.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.276+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa04153fa0 con 0x7faa0415cbc0 2023-09-30T13:55:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.276+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003ea0 con 0x7faa0415cbc0 2023-09-30T13:55:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.276+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa040c8590 con 0x7faa0415cbc0 2023-09-30T13:55:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.277+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa041544c0 con 0x7faa0415cbc0 2023-09-30T13:55:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.277+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa9f400aa90 con 0x7faa0415cbc0 2023-09-30T13:55:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.277+0000 7faa01ffb640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 0x7fa9f006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.278+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9f4089160 con 0x7faa0415cbc0 2023-09-30T13:55:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.278+0000 7faa09211640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 0x7fa9f006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.278+0000 7faa09211640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 0x7fa9f006cff0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc036000 tx=0x7fa9fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.282+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7faa041544c0 con 0x7faa0415cbc0 2023-09-30T13:55:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.459+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa041544c0 con 0x7faa0415cbc0 2023-09-30T13:55:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.459+0000 7faa01ffb640 1 -- 172.21.15.62:0/636287274 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa041544c0 con 0x7faa0415cbc0 2023-09-30T13:55:15.460 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 msgr2=0x7fa9f006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 0x7fa9f006cff0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc036000 tx=0x7fa9fc008030 comp rx=0 tx=0).stop 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 msgr2=0x7faa040cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c7a0 tx=0x7fa9f400cc60 comp rx=0 tx=0).stop 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 shutdown_connections 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa9f006ab30 0x7fa9f006cff0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa0415cbc0 0x7faa040cb150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faa040cd8c0 0x7faa040cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 --2- 172.21.15.62:0/636287274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa040b8760 0x7faa041547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 >> 172.21.15.62:0/636287274 conn(0x7faa040718a0 msgr2=0x7faa0415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 shutdown_connections 2023-09-30T13:55:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.462+0000 7faa0b475640 1 -- 172.21.15.62:0/636287274 wait complete. 2023-09-30T13:55:15.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.582+0000 7f663b0de640 1 Processor -- start 2023-09-30T13:55:15.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.582+0000 7f663b0de640 1 -- start start 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f663b0de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f663415d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f663b0de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340ae7b0 con 0x7f663415d1a0 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f663b0de640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340aea90 con 0x7f66340cbc30 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f663b0de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663415d580 con 0x7f663406f440 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f6638e7a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f663415d1a0 0x7f663406ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46088/0 (socket says 172.21.15.62:46088) 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f6638e7a640 1 -- 172.21.15.62:0/1159106726 learned_addr learned my addr 172.21.15.62:0/1159106726 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678060976 0 0) 0x7f66340ae7b0 con 0x7f663415d1a0 2023-09-30T13:55:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f6633fff640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f663415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6624003520 con 0x7f663415d1a0 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784391840 0 0) 0x7f6624003520 con 0x7f663415d1a0 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 msgr2=0x7f663415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f663415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 >> v1:172.21.15.135:6789/0 conn(0x7f66340cbc30 legacy=0x7f663415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340aed70 con 0x7f663415d1a0 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f6628001670 con 0x7f663415d1a0 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 >> v1:172.21.15.62:6789/0 conn(0x7f663415d1a0 legacy=0x7f663406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f66240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6624003f20 0x7f66240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6624004d00 0x7f6624005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663415d580 con 0x7f6624004d00 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662400ba60 con 0x7f6624003f20 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.583+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662400bc20 con 0x7f663406f440 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6624004d00 0x7f6624005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f6633fff640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6624003f20 0x7f66240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f6638e7a640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f66240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 -- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 msgr2=0x7f66240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f663406f440 0x7f66240039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 -- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6624003f20 msgr2=0x7f66240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6624003f20 0x7f66240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.584+0000 7f663967b640 1 -- 172.21.15.62:0/1159106726 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624003520 con 0x7f6624004d00 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663967b640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6624004d00 0x7f6624005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f662c001e50 tx=0x7f66240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad58186a30200cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c003b70 con 0x7f6624004d00 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c003cd0 con 0x7f6624004d00 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f66337fe640 1 -- 172.21.15.62:0/1159106726 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c005310 con 0x7f6624004d00 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 -- 172.21.15.62:0/1159106726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6624004d00 msgr2=0x7f6624005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 --2- 172.21.15.62:0/1159106726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6624004d00 0x7f6624005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f662c001e50 tx=0x7f66240057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663967b640 1 -- 172.21.15.62:0/1159106726 reap_dead start 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 -- 172.21.15.62:0/1159106726 shutdown_connections 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 -- 172.21.15.62:0/1159106726 >> 172.21.15.62:0/1159106726 conn(0x7f66340cc180 msgr2=0x7f66340cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 -- 172.21.15.62:0/1159106726 shutdown_connections 2023-09-30T13:55:15.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.585+0000 7f663b0de640 1 -- 172.21.15.62:0/1159106726 wait complete. 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.586+0000 7f663b0de640 1 Processor -- start 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.586+0000 7f663b0de640 1 -- start start 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66340b34e0 0x7f66340cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66340ce050 0x7f6634069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340ce4d0 con 0x7f663414de80 2023-09-30T13:55:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663414e260 con 0x7f66340ce050 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f663b0de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340b3a60 con 0x7f66340b34e0 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f6638e7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f6638e7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39772/0 (socket says 172.21.15.62:39772) 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.587+0000 7f6638e7a640 1 -- 172.21.15.62:0/1340090287 learned_addr learned my addr 172.21.15.62:0/1340090287 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f663967b640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66340ce050 0x7f6634069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6633fff640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66340b34e0 0x7f66340cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 -- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66340b34e0 msgr2=0x7f66340cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66340b34e0 0x7f66340cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 -- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66340ce050 msgr2=0x7f6634069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66340ce050 0x7f6634069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 -- 172.21.15.62:0/1340090287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340b3d40 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f6638e7a640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6628007290 tx=0x7f6628007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800f960 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800fac0 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66340b4020 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800fe50 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.588+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340b45e0 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.589+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663404e0d0 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.589+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f662801d460 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.590+0000 7f66317fa640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 0x7f661806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.590+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6628089650 con 0x7f663414de80 2023-09-30T13:55:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.590+0000 7f6633fff640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 0x7f661806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.590+0000 7f6633fff640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 0x7f661806d020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66340ce6d0 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.594+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f66280545b0 con 0x7f663414de80 2023-09-30T13:55:15.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.769+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66340cd3e0 con 0x7f663414de80 2023-09-30T13:55:15.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.770+0000 7f66317fa640 1 -- 172.21.15.62:0/1340090287 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6628057bd0 con 0x7f663414de80 2023-09-30T13:55:15.771 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:15.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 msgr2=0x7f661806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 0x7f661806d020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66340ce6d0 tx=0x7f6620008040 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 msgr2=0x7f66340b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6628007290 tx=0x7f6628007750 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 shutdown_connections 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f661806ab60 0x7f661806d020 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66340ce050 0x7f6634069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66340b34e0 0x7f66340cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 --2- 172.21.15.62:0/1340090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663414de80 0x7f66340b2fa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 >> 172.21.15.62:0/1340090287 conn(0x7f66340cc180 msgr2=0x7f663414fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 shutdown_connections 2023-09-30T13:55:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.772+0000 7f663b0de640 1 -- 172.21.15.62:0/1340090287 wait complete. 2023-09-30T13:55:15.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.891+0000 7fa76f75a640 1 Processor -- start 2023-09-30T13:55:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.891+0000 7fa76f75a640 1 -- start start 2023-09-30T13:55:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76f75a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa76815dc60 0x7fa76806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76f75a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7680cdfc0 0x7fa7680ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76f75a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680cdb30 con 0x7fa7680cca40 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76f75a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680ccf20 con 0x7fa7680cdfc0 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76f75a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680cd200 con 0x7fa76815dc60 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76dcf7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7680cdfc0 0x7fa7680ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76dcf7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7680cdfc0 0x7fa7680ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39776/0 (socket says 172.21.15.62:39776) 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76dcf7640 1 -- 172.21.15.62:0/92769106 learned_addr learned my addr 172.21.15.62:0/92769106 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.892+0000 7fa76d4f6640 1 --2- 172.21.15.62:0/92769106 >> v2:172.21.15.135:3300/0 conn(0x7fa76815dc60 0x7fa76806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.893+0000 7fa76dcf7640 1 -- 172.21.15.62:0/92769106 >> v2:172.21.15.135:3300/0 conn(0x7fa76815dc60 msgr2=0x7fa76806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.893+0000 7fa76dcf7640 1 --2- 172.21.15.62:0/92769106 >> v2:172.21.15.135:3300/0 conn(0x7fa76815dc60 0x7fa76806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.893+0000 7fa76dcf7640 1 -- 172.21.15.62:0/92769106 >> v1:172.21.15.135:6789/0 conn(0x7fa7680cca40 legacy=0x7fa7680b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.893+0000 7fa76dcf7640 1 -- 172.21.15.62:0/92769106 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680cd4e0 con 0x7fa7680cdfc0 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.893+0000 7fa76dcf7640 1 --2- 172.21.15.62:0/92769106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680cdfc0 0x7fa7680ce420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa768065fa0 tx=0x7fa75802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16653328c26f1d7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa767fff640 1 -- 172.21.15.62:0/92769106 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75802ca80 con 0x7fa7680cdfc0 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa767fff640 1 -- 172.21.15.62:0/92769106 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75802cbe0 con 0x7fa7680cdfc0 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa767fff640 1 -- 172.21.15.62:0/92769106 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580343f0 con 0x7fa7680cdfc0 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 -- 172.21.15.62:0/92769106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680cdfc0 msgr2=0x7fa7680ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 --2- 172.21.15.62:0/92769106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680cdfc0 0x7fa7680ce420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa768065fa0 tx=0x7fa75802bee0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 -- 172.21.15.62:0/92769106 shutdown_connections 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 --2- 172.21.15.62:0/92769106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7680cdfc0 0x7fa7680ce420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 --2- 172.21.15.62:0/92769106 >> v2:172.21.15.135:3300/0 conn(0x7fa76815dc60 0x7fa76806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 -- 172.21.15.62:0/92769106 >> 172.21.15.62:0/92769106 conn(0x7fa768070970 msgr2=0x7fa768070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 -- 172.21.15.62:0/92769106 shutdown_connections 2023-09-30T13:55:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.894+0000 7fa76f75a640 1 -- 172.21.15.62:0/92769106 wait complete. 2023-09-30T13:55:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.895+0000 7fa76f75a640 1 Processor -- start 2023-09-30T13:55:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.895+0000 7fa76f75a640 1 -- start start 2023-09-30T13:55:15.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 0x7fa7680c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 0x7fa76814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681544c0 con 0x7fa76815dc60 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76806a970 con 0x7fa7680cca40 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76f75a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76806aba0 con 0x7fa7680cdfc0 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76dcf7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76dcf7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39786/0 (socket says 172.21.15.62:39786) 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76dcf7640 1 -- 172.21.15.62:0/3019374911 learned_addr learned my addr 172.21.15.62:0/3019374911 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76ccf5640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 0x7fa76814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.896+0000 7fa76d4f6640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 0x7fa7680c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 -- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 msgr2=0x7fa76814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 0x7fa76814e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 -- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 msgr2=0x7fa7680c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 0x7fa7680c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 -- 172.21.15.62:0/3019374911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758009b30 con 0x7fa76815dc60 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76d4f6640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 0x7fa7680c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76ccf5640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 0x7fa76814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76dcf7640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa758009f40 tx=0x7fa758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758009510 con 0x7fa76815dc60 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75803e450 con 0x7fa76815dc60 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768153e00 con 0x7fa76815dc60 2023-09-30T13:55:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75803e820 con 0x7fa76815dc60 2023-09-30T13:55:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.897+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76814e9d0 con 0x7fa76815dc60 2023-09-30T13:55:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.898+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7680666d0 con 0x7fa76815dc60 2023-09-30T13:55:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.898+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa75802cd50 con 0x7fa76815dc60 2023-09-30T13:55:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.899+0000 7fa765ffb640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 0x7fa75406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:15.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.899+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7580abf70 con 0x7fa76815dc60 2023-09-30T13:55:15.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.899+0000 7fa76d4f6640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 0x7fa75406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:15.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.900+0000 7fa76d4f6640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 0x7fa75406cff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:15.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:15.903+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa7580dead0 con 0x7fa76815dc60 2023-09-30T13:55:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.080+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa768153c60 con 0x7fa76815dc60 2023-09-30T13:55:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.081+0000 7fa765ffb640 1 -- 172.21.15.62:0/3019374911 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa768153c60 con 0x7fa76815dc60 2023-09-30T13:55:16.082 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 msgr2=0x7fa75406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 0x7fa75406cff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa760006fd0 tx=0x7fa760008040 comp rx=0 tx=0).stop 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 msgr2=0x7fa7680c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa758009f40 tx=0x7fa758004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 shutdown_connections 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa75406ab30 0x7fa75406cff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa76815dc60 0x7fa7680c3410 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7680cdfc0 0x7fa76814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 --2- 172.21.15.62:0/3019374911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7680cca40 0x7fa7680c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 >> 172.21.15.62:0/3019374911 conn(0x7fa768070970 msgr2=0x7fa7680b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 shutdown_connections 2023-09-30T13:55:16.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.083+0000 7fa76f75a640 1 -- 172.21.15.62:0/3019374911 wait complete. 2023-09-30T13:55:16.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.200+0000 7f90f3e51640 1 Processor -- start 2023-09-30T13:55:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.200+0000 7f90f3e51640 1 -- start start 2023-09-30T13:55:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f3e51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90ec0cdc20 0x7f90ec0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f3e51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0b2940 0x7f90ec0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f3e51640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0b2e50 con 0x7f90ec0cef70 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f3e51640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0cf400 con 0x7f90ec0cdc20 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f3e51640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0ac2d0 con 0x7f90ec0b2940 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f1bed640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90ec0cdc20 0x7f90ec0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f23ee640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f90ec0cef70 0x7f90ec0ab250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46098/0 (socket says 172.21.15.62:46098) 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f23ee640 1 -- 172.21.15.62:0/361543476 learned_addr learned my addr 172.21.15.62:0/361543476 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.201+0000 7f90f13ec640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0b2940 0x7f90ec0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f1bed640 1 -- 172.21.15.62:0/361543476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0b2940 msgr2=0x7f90ec0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f1bed640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0b2940 0x7f90ec0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f1bed640 1 -- 172.21.15.62:0/361543476 >> v1:172.21.15.62:6789/0 conn(0x7f90ec0cef70 legacy=0x7f90ec0ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f0beb640 1 -- 172.21.15.62:0/361543476 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470610995 0 0) 0x7f90ec0b2e50 con 0x7f90ec0cef70 2023-09-30T13:55:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f1bed640 1 -- 172.21.15.62:0/361543476 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0cc340 con 0x7f90ec0cdc20 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f1bed640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0b2400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009790 tx=0x7f90e402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914de14f5ad13012 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f0beb640 1 -- 172.21.15.62:0/361543476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031770 con 0x7f90ec0cdc20 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.202+0000 7f90f0beb640 1 -- 172.21.15.62:0/361543476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40318d0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f0beb640 1 -- 172.21.15.62:0/361543476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031c60 con 0x7f90ec0cdc20 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 -- 172.21.15.62:0/361543476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 msgr2=0x7f90ec0b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0b2400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009790 tx=0x7f90e402b810 comp rx=0 tx=0).stop 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 -- 172.21.15.62:0/361543476 shutdown_connections 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0b2940 0x7f90ec0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 --2- 172.21.15.62:0/361543476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0b2400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 -- 172.21.15.62:0/361543476 >> 172.21.15.62:0/361543476 conn(0x7f90ec06a170 msgr2=0x7f90ec06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 -- 172.21.15.62:0/361543476 shutdown_connections 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.203+0000 7f90f3e51640 1 -- 172.21.15.62:0/361543476 wait complete. 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.204+0000 7f90f3e51640 1 Processor -- start 2023-09-30T13:55:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.204+0000 7f90f3e51640 1 -- start start 2023-09-30T13:55:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90ec0b2940 0x7f90ec0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 0x7f90ec0983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c8ca0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c79a0 con 0x7f90ec0b2940 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f3e51640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c7c80 con 0x7f90ec0cef70 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f13ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f13ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39816/0 (socket says 172.21.15.62:39816) 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f13ec640 1 -- 172.21.15.62:0/245755982 learned_addr learned my addr 172.21.15.62:0/245755982 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f1bed640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90ec0b2940 0x7f90ec0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.205+0000 7f90f23ee640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 0x7f90ec0983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 -- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 msgr2=0x7f90ec0983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 0x7f90ec0983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 -- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90ec0b2940 msgr2=0x7f90ec0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90ec0b2940 0x7f90ec0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 -- 172.21.15.62:0/245755982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40093a0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f23ee640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 0x7f90ec0983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f13ec640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90e000e840 tx=0x7f90e000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00094f0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000c940 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0c7f60 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000ccd0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.206+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec098f40 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.207+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec04e0d0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.207+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f90e0013470 con 0x7f90ec0cdc20 2023-09-30T13:55:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.208+0000 7f90ea7fc640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 0x7f90d806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.208+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90e0089510 con 0x7f90ec0cdc20 2023-09-30T13:55:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.208+0000 7f90f1bed640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 0x7f90d806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.209+0000 7f90f1bed640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 0x7f90d806cff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f90e4036000 tx=0x7f90e403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.212+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f90e0054520 con 0x7f90ec0cdc20 2023-09-30T13:55:16.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.424+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90ec0b21e0 con 0x7f90ec0cdc20 2023-09-30T13:55:16.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.424+0000 7f90ea7fc640 1 -- 172.21.15.62:0/245755982 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f90e0057b40 con 0x7f90ec0cdc20 2023-09-30T13:55:16.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:16.426 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 msgr2=0x7f90d806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 0x7f90d806cff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f90e4036000 tx=0x7f90e403d040 comp rx=0 tx=0).stop 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 msgr2=0x7f90ec0995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90e000e840 tx=0x7f90e000ed00 comp rx=0 tx=0).stop 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 shutdown_connections 2023-09-30T13:55:16.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f90d806ab30 0x7f90d806cff0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90ec0cef70 0x7f90ec0983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cdc20 0x7f90ec0995e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 --2- 172.21.15.62:0/245755982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90ec0b2940 0x7f90ec0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 >> 172.21.15.62:0/245755982 conn(0x7f90ec06a170 msgr2=0x7f90ec0700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 shutdown_connections 2023-09-30T13:55:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.426+0000 7f90f3e51640 1 -- 172.21.15.62:0/245755982 wait complete. 2023-09-30T13:55:16.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.543+0000 7fc7d673a640 1 Processor -- start 2023-09-30T13:55:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.543+0000 7fc7d673a640 1 -- start start 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d673a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7d015cdb0 0x7fc7d00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d673a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00ca200 0x7fc7d00ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d673a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015d190 con 0x7fc7d00d0040 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d673a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00d05e0 con 0x7fc7d015cdb0 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d673a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b0900 con 0x7fc7d00ca200 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cf7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc7d00d0040 0x7fc7d00cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46114/0 (socket says 172.21.15.62:46114) 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7d015cdb0 0x7fc7d00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cf7fe640 1 -- 172.21.15.62:0/2056662017 learned_addr learned my addr 172.21.15.62:0/2056662017 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7d4cd7640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00ca200 0x7fc7d00ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cffff640 1 -- 172.21.15.62:0/2056662017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00ca200 msgr2=0x7fc7d00ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cffff640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00ca200 0x7fc7d00ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cffff640 1 -- 172.21.15.62:0/2056662017 >> v1:172.21.15.62:6789/0 conn(0x7fc7d00d0040 legacy=0x7fc7d00cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7ceffd640 1 -- 172.21.15.62:0/2056662017 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576242791 0 0) 0x7fc7d015d190 con 0x7fc7d00d0040 2023-09-30T13:55:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.544+0000 7fc7cffff640 1 -- 172.21.15.62:0/2056662017 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00b0be0 con 0x7fc7d015cdb0 2023-09-30T13:55:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.545+0000 7fc7cffff640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00cbf00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009790 tx=0x7fc7c402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89a79ed290f35d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.545+0000 7fc7ceffd640 1 -- 172.21.15.62:0/2056662017 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4031800 con 0x7fc7d015cdb0 2023-09-30T13:55:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.545+0000 7fc7ceffd640 1 -- 172.21.15.62:0/2056662017 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4031960 con 0x7fc7d015cdb0 2023-09-30T13:55:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.545+0000 7fc7ceffd640 1 -- 172.21.15.62:0/2056662017 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4031cf0 con 0x7fc7d015cdb0 2023-09-30T13:55:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 -- 172.21.15.62:0/2056662017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d015cdb0 msgr2=0x7fc7d00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00cbf00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009790 tx=0x7fc7c402b8a0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 -- 172.21.15.62:0/2056662017 shutdown_connections 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00ca200 0x7fc7d00ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 --2- 172.21.15.62:0/2056662017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00cbf00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 -- 172.21.15.62:0/2056662017 >> 172.21.15.62:0/2056662017 conn(0x7fc7d0098a50 msgr2=0x7fc7d00cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 -- 172.21.15.62:0/2056662017 shutdown_connections 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.546+0000 7fc7d673a640 1 -- 172.21.15.62:0/2056662017 wait complete. 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.547+0000 7fc7d673a640 1 Processor -- start 2023-09-30T13:55:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.547+0000 7fc7d673a640 1 -- start start 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00d0040 0x7fc7d00c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015ec60 con 0x7fc7d00ca200 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015dd90 con 0x7fc7d015cdb0 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d673a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01601f0 con 0x7fc7d00d0040 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39842/0 (socket says 172.21.15.62:39842) 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 -- 172.21.15.62:0/1053042801 learned_addr learned my addr 172.21.15.62:0/1053042801 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d4cd7640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cf7fe640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00d0040 0x7fc7d00c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 -- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00d0040 msgr2=0x7fc7d00c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00d0040 0x7fc7d00c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 -- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 msgr2=0x7fc7d00c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 -- 172.21.15.62:0/1053042801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40093a0 con 0x7fc7d00ca200 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7d4cd7640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.548+0000 7fc7cffff640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40098b0 tx=0x7fc7c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.549+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c403bcc0 con 0x7fc7d00ca200 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.549+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c403be20 con 0x7fc7d00ca200 2023-09-30T13:55:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.549+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4045630 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.549+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d015dfe0 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.549+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d015e5a0 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.550+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d004e0d0 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.550+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc7c4045790 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.550+0000 7fc7ccff9640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 0x7fc7bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.551+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7c402e070 con 0x7fc7d00ca200 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.551+0000 7fc7cf7fe640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 0x7fc7bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.551+0000 7fc7cf7fe640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 0x7fc7bc06cff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00cc7b0 tx=0x7fc7c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.555+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc7c4076c30 con 0x7fc7d00ca200 2023-09-30T13:55:16.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.733+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d00c2f70 con 0x7fc7d00ca200 2023-09-30T13:55:16.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.734+0000 7fc7ccff9640 1 -- 172.21.15.62:0/1053042801 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fc7c4035070 con 0x7fc7d00ca200 2023-09-30T13:55:16.735 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:16.735 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:16.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 msgr2=0x7fc7bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 0x7fc7bc06cff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00cc7b0 tx=0x7fc7c0009040 comp rx=0 tx=0).stop 2023-09-30T13:55:16.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 msgr2=0x7fc7d015ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40098b0 tx=0x7fc7c40046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 shutdown_connections 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7bc06ab30 0x7fc7bc06cff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7d015cdb0 0x7fc7d00c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7d00d0040 0x7fc7d00c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 --2- 172.21.15.62:0/1053042801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d00ca200 0x7fc7d015ef00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 >> 172.21.15.62:0/1053042801 conn(0x7fc7d0098a50 msgr2=0x7fc7d00c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 shutdown_connections 2023-09-30T13:55:16.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.736+0000 7fc7d673a640 1 -- 172.21.15.62:0/1053042801 wait complete. 2023-09-30T13:55:16.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.852+0000 7efdf3644640 1 Processor -- start 2023-09-30T13:55:16.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf3644640 1 -- start start 2023-09-30T13:55:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf3644640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efdec0d06b0 0x7efdec06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf3644640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0d0b20 con 0x7efdec15cbe0 2023-09-30T13:55:16.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf3644640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec0cf450 con 0x7efdec0d1410 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf3644640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0cfcf0 con 0x7efdec0d06b0 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf13e0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efdec15cbe0 0x7efdec0d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46118/0 (socket says 172.21.15.62:46118) 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.853+0000 7efdf13e0640 1 -- 172.21.15.62:0/1812267219 learned_addr learned my addr 172.21.15.62:0/1812267219 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf1be1640 1 --2- 172.21.15.62:0/1812267219 >> v2:172.21.15.135:3300/0 conn(0x7efdec0d06b0 0x7efdec06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986210448 0 0) 0x7efdec0d0b20 con 0x7efdec15cbe0 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd8003520 con 0x7efdec15cbe0 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461600193 0 0) 0x7efdd8003520 con 0x7efdec15cbe0 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 >> v2:172.21.15.135:3300/0 conn(0x7efdec0d06b0 msgr2=0x7efdec06bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 --2- 172.21.15.62:0/1812267219 >> v2:172.21.15.135:3300/0 conn(0x7efdec0d06b0 0x7efdec06bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 >> v1:172.21.15.135:6789/0 conn(0x7efdec0d1410 legacy=0x7efdec06b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0cf730 con 0x7efdec15cbe0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7efddc0017f0 con 0x7efdec15cbe0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 >> v1:172.21.15.62:6789/0 conn(0x7efdec15cbe0 legacy=0x7efdec0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdd8003970 0x7efdd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd80047c0 0x7efdd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 0x7efdd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0cfcf0 con 0x7efdd8005180 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd800c030 con 0x7efdd80047c0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd800c1f0 con 0x7efdd8003970 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf1be1640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 0x7efdd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf13e0640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdd8003970 0x7efdd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf0bdf640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd80047c0 0x7efdd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf1be1640 1 -- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdd8003970 msgr2=0x7efdd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf1be1640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdd8003970 0x7efdd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.854+0000 7efdf1be1640 1 -- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd80047c0 msgr2=0x7efdd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efdf1be1640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd80047c0 0x7efdd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efdf1be1640 1 -- 172.21.15.62:0/1812267219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8003520 con 0x7efdd8005180 2023-09-30T13:55:16.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efdf1be1640 1 -- 172.21.15.62:0/1812267219 reap_dead start 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efdf1be1640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 0x7efdd800b980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efde4009fc0 tx=0x7efdd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ef2e8385f115b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde402cc60 con 0x7efdd8005180 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.855+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400f040 con 0x7efdd8005180 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efde3fff640 1 -- 172.21.15.62:0/1812267219 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4003990 con 0x7efdd8005180 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 -- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 msgr2=0x7efdd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 0x7efdd800b980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efde4009fc0 tx=0x7efdd80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 -- 172.21.15.62:0/1812267219 shutdown_connections 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 --2- 172.21.15.62:0/1812267219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdd8005180 0x7efdd800b980 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 -- 172.21.15.62:0/1812267219 >> 172.21.15.62:0/1812267219 conn(0x7efdec089fe0 msgr2=0x7efdec0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 -- 172.21.15.62:0/1812267219 shutdown_connections 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.856+0000 7efdf3644640 1 -- 172.21.15.62:0/1812267219 wait complete. 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.857+0000 7efdf3644640 1 Processor -- start 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.857+0000 7efdf3644640 1 -- start start 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd8005180 0x7efdec1f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec158750 0x7efdec159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0cc8e0 con 0x7efdec0b3a70 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b42a0 con 0x7efdd8005180 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf3644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec158d60 con 0x7efdec158750 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf1be1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf1be1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39862/0 (socket says 172.21.15.62:39862) 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf1be1640 1 -- 172.21.15.62:0/248128733 learned_addr learned my addr 172.21.15.62:0/248128733 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf13e0640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd8005180 0x7efdec1f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.858+0000 7efdf0bdf640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec158750 0x7efdec159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 -- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec158750 msgr2=0x7efdec159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec158750 0x7efdec159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 -- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd8005180 msgr2=0x7efdec1f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd8005180 0x7efdec1f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:16.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 -- 172.21.15.62:0/248128733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec159040 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf1be1640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efde402c6d0 tx=0x7efde4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4035e40 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4003990 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec159320 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4003d80 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.859+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec0b3ef0 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.860+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec159840 con 0x7efdec0b3a70 2023-09-30T13:55:16.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.861+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efde4004030 con 0x7efdec0b3a70 2023-09-30T13:55:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.861+0000 7efde1ffb640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 0x7efdd006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.861+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efde40ac140 con 0x7efdec0b3a70 2023-09-30T13:55:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.861+0000 7efdf13e0640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 0x7efdd006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.862+0000 7efdf13e0640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 0x7efdd006cff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efddc000ef0 tx=0x7efddc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:16.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:16.865+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efdec159840 con 0x7efdec0b3a70 2023-09-30T13:55:17.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.076+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdec159840 con 0x7efdec0b3a70 2023-09-30T13:55:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.076+0000 7efde1ffb640 1 -- 172.21.15.62:0/248128733 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7efdec159840 con 0x7efdec0b3a70 2023-09-30T13:55:17.077 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:17.077 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 msgr2=0x7efdd006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 0x7efdd006cff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efddc000ef0 tx=0x7efddc009040 comp rx=0 tx=0).stop 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 msgr2=0x7efdec06ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efde402c6d0 tx=0x7efde4009750 comp rx=0 tx=0).stop 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 shutdown_connections 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efdd006ab30 0x7efdd006cff0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec0b3a70 0x7efdec06ba60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdec158750 0x7efdec159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 --2- 172.21.15.62:0/248128733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdd8005180 0x7efdec1f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 >> 172.21.15.62:0/248128733 conn(0x7efdec089fe0 msgr2=0x7efdec15be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 shutdown_connections 2023-09-30T13:55:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.078+0000 7efdf3644640 1 -- 172.21.15.62:0/248128733 wait complete. 2023-09-30T13:55:17.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T13:54:49.768336+0000', 'modified': '2023-09-30T13:55:05.842227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/2869657877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 2869657877}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 2869657877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T13:55:17.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T13:55:17.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T13:55:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.603+0000 7f539106f640 1 Processor -- start 2023-09-30T13:55:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.603+0000 7f539106f640 1 -- start start 2023-09-30T13:55:17.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f539106f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f538c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f539106f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0ce300 con 0x7f538c1595e0 2023-09-30T13:55:17.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f539106f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c071880 con 0x7f538c1599c0 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f539106f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c071b60 con 0x7f538c0b0670 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f538ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f538c1595e0 0x7f538c0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52718/0 (socket says 172.21.15.62:52718) 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f538ad9d640 1 -- 172.21.15.62:0/3706168100 learned_addr learned my addr 172.21.15.62:0/3706168100 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605284266 0 0) 0x7f538c0ce300 con 0x7f538c1595e0 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5374003520 con 0x7f538c1595e0 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f538b59e640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f538c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11642068 0 0) 0x7f5374003520 con 0x7f538c1595e0 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 msgr2=0x7f538c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f538c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 >> v1:172.21.15.135:6789/0 conn(0x7f538c1599c0 legacy=0x7f538c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c071e40 con 0x7f538c1595e0 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f5384001670 con 0x7f538c1595e0 2023-09-30T13:55:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 >> v1:172.21.15.62:6789/0 conn(0x7f538c1595e0 legacy=0x7f538c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53740039a0 0x7f5374003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.604+0000 7f5389d9b640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f53740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f5389d9b640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5374004d00 0x7f5374005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c071b60 con 0x7f53740039a0 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537400bb70 con 0x7f5374004d00 2023-09-30T13:55:17.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537400bd30 con 0x7f538c0b0670 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53740039a0 0x7f5374003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538a59c640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f53740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538b59e640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5374004d00 0x7f5374005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 -- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 msgr2=0x7f53740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0b0670 0x7f53740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 -- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5374004d00 msgr2=0x7f5374005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5374004d00 0x7f5374005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.605+0000 7f538ad9d640 1 -- 172.21.15.62:0/3706168100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374003520 con 0x7f53740039a0 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f538ad9d640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53740039a0 0x7f5374003dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5384001050 tx=0x7f53740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22961f4fd16b6241 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384005ad0 con 0x7f53740039a0 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384005c30 con 0x7f53740039a0 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f5389d9b640 1 -- 172.21.15.62:0/3706168100 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538402c890 con 0x7f53740039a0 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 -- 172.21.15.62:0/3706168100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53740039a0 msgr2=0x7f5374003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 --2- 172.21.15.62:0/3706168100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53740039a0 0x7f5374003dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5384001050 tx=0x7f53740057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f538b59e640 1 -- 172.21.15.62:0/3706168100 reap_dead start 2023-09-30T13:55:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 -- 172.21.15.62:0/3706168100 shutdown_connections 2023-09-30T13:55:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 -- 172.21.15.62:0/3706168100 >> 172.21.15.62:0/3706168100 conn(0x7f538c06a430 msgr2=0x7f538c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 -- 172.21.15.62:0/3706168100 shutdown_connections 2023-09-30T13:55:17.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.606+0000 7f539106f640 1 -- 172.21.15.62:0/3706168100 wait complete. 2023-09-30T13:55:17.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.608+0000 7f539106f640 1 Processor -- start 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.608+0000 7f539106f640 1 -- start start 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53740039a0 0x7f538c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0ad110 0x7f538c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c147fe0 con 0x7f538c0ab8d0 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0b1870 con 0x7f53740039a0 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0ac240 con 0x7f538c0ad110 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47068/0 (socket says 172.21.15.62:47068) 2023-09-30T13:55:17.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 -- 172.21.15.62:0/1617916130 learned_addr learned my addr 172.21.15.62:0/1617916130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538ad9d640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53740039a0 0x7f538c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538a59c640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0ad110 0x7f538c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 -- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0ad110 msgr2=0x7f538c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0ad110 0x7f538c0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 -- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53740039a0 msgr2=0x7f538c147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53740039a0 0x7f538c147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 -- 172.21.15.62:0/1617916130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0ac520 con 0x7f538c0ab8d0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f538b59e640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f538c0b0b20 tx=0x7f537c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f53737fe640 1 -- 172.21.15.62:0/1617916130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00e040 con 0x7f538c0ab8d0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f53737fe640 1 -- 172.21.15.62:0/1617916130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00f040 con 0x7f538c0ab8d0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c0ac800 con 0x7f538c0ab8d0 2023-09-30T13:55:17.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f53737fe640 1 -- 172.21.15.62:0/1617916130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c003bd0 con 0x7f538c0ab8d0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.609+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c0c30d0 con 0x7f538c0ab8d0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.611+0000 7f53737fe640 1 -- 172.21.15.62:0/1617916130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f537c003d30 con 0x7f538c0ab8d0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.612+0000 7f53737fe640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 0x7f537806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.612+0000 7f53737fe640 1 -- 172.21.15.62:0/1617916130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f537c089a50 con 0x7f538c0ab8d0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.612+0000 7f538ad9d640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 0x7f537806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f538ad9d640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 0x7f537806d020 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5384034000 tx=0x7f5384007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f5393c02740 1 Processor -- start 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f5393c02740 1 -- start start 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f5393c02740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d769f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.613+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d73a620 0x55727d76a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5393c02740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d6ac770 con 0x55727d7671e0 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d6a9e60 con 0x55727d73a620 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55727d6a5750 con 0x55727d7675c0 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47076/0 (socket says 172.21.15.62:47076) 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 -- 172.21.15.62:0/2027442966 learned_addr learned my addr 172.21.15.62:0/2027442966 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538a59c640 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d769f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538b59e640 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d73a620 0x55727d76a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 -- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 msgr2=0x55727d769f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d769f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 -- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d73a620 msgr2=0x55727d76a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d73a620 0x55727d76a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 -- 172.21.15.62:0/2027442966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55727d6a3dd0 con 0x55727d7671e0 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f538ad9d640 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f538400c2d0 tx=0x7f538402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9268f6cd08a49ffb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5370ff9640 1 -- 172.21.15.62:0/2027442966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840047e0 con 0x55727d7671e0 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5370ff9640 1 -- 172.21.15.62:0/2027442966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384004940 con 0x55727d7671e0 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.614+0000 7f5370ff9640 1 -- 172.21.15.62:0/2027442966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384004cb0 con 0x55727d7671e0 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 -- 172.21.15.62:0/2027442966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 msgr2=0x55727d73a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f538400c2d0 tx=0x7f538402e000 comp rx=0 tx=0).stop 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 -- 172.21.15.62:0/2027442966 shutdown_connections 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d73a620 0x55727d76a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d769f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 --2- 172.21.15.62:0/2027442966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d73a0e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 -- 172.21.15.62:0/2027442966 >> 172.21.15.62:0/2027442966 conn(0x55727d73c3f0 msgr2=0x55727d784f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 -- 172.21.15.62:0/2027442966 shutdown_connections 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.615+0000 7f5393c02740 1 -- 172.21.15.62:0/2027442966 wait complete. 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 -- start start 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 Processor -- start 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d76c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d76cf00 0x55727d7632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d643820 con 0x55727d7671e0 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d6434c0 con 0x55727d7675c0 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55727d626240 con 0x55727d76cf00 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.616+0000 7f5393c02740 10 client.0 _ll_register_callbacks cb 0x55727d6659d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47086/0 (socket says 172.21.15.62:47086) 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 -- 172.21.15.62:0/4086483425 learned_addr learned my addr 172.21.15.62:0/4086483425 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538a59c640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d76c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538b59e640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d76cf00 0x55727d7632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 -- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d76cf00 msgr2=0x55727d7632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d76cf00 0x55727d7632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 -- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 msgr2=0x55727d76c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d76c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 -- 172.21.15.62:0/4086483425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5374003520 con 0x55727d7671e0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f538ad9d640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f538404e040 tx=0x7f5384001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b202d098e5aa7c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840047e0 con 0x55727d7671e0 2023-09-30T13:55:17.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53840076b0 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55727d6cb1b0 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5384001c80 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5393c02740 10 client.4851 fetch_fsmap learned FSMap version 9 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.617+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55727d680470 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55727d6cb1b0 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f5384040070 con 0x55727d7671e0 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 10 client.4851 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 20 client.4851 populate_metadata read hostname 'smithi062' 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d765fb0 0x55727d7a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 4 client.4851 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 --> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55727d678e60 con 0x55727d765fb0 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f538a59c640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d765fb0 0x55727d7a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f538a59c640 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d765fb0 0x55727d7a27a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e68e7e118fce389 server_cookie=ece81e2ac28c3ced in_seq=0 out_seq=0 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.618+0000 7f5369ffb640 10 client.4851 ms_handle_connect on v2:172.21.15.135:6834/2869657877 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5369ffb640 1 -- 172.21.15.62:0/4086483425 <== mds.0 v2:172.21.15.135:6834/2869657877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55727d678e60 con 0x55727d765fb0 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5369ffb640 10 client.4851 handle_command_reply: tid=0 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 client.4851 shutdown 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 msgr2=0x55727d785ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f538404e040 tx=0x7f5384001a00 comp rx=0 tx=0).stop 2023-09-30T13:55:17.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 shutdown_connections 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d765fb0 0x55727d7a27a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d76cf00 0x55727d7632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d76c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5369ffb640 0 client.4851 ms_handle_reset on v2:172.21.15.135:6834/2869657877 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 --2- 172.21.15.62:0/4086483425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d7671e0 0x55727d785ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 >> 172.21.15.62:0/4086483425 conn(0x55727d73a620 msgr2=0x55727d769f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 shutdown_connections 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 1 -- 172.21.15.62:0/4086483425 wait complete. 2023-09-30T13:55:17.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.619+0000 7f5393c02740 20 client.4851 trim_cache size 0 max 16384 2023-09-30T13:55:17.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.634+0000 7f5393c02740 1 Processor -- start 2023-09-30T13:55:17.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.634+0000 7f5393c02740 1 -- start start 2023-09-30T13:55:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7671e0 0x55727d784cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d76c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d76c330 con 0x55727d76cf00 2023-09-30T13:55:17.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d765610 con 0x55727d7671e0 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55727d740930 con 0x55727d7675c0 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47088/0 (socket says 172.21.15.62:47088) 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f538b59e640 1 -- 172.21.15.62:0/1508716023 learned_addr learned my addr 172.21.15.62:0/1508716023 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f538ad9d640 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7671e0 0x55727d784cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.635+0000 7f538a59c640 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d76c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 -- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 msgr2=0x55727d76c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d76c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 -- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7671e0 msgr2=0x55727d784cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7671e0 0x55727d784cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 -- 172.21.15.62:0/1508716023 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55727d6d4500 con 0x55727d76cf00 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f538b59e640 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f537c058420 tx=0x7f537c0581a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187d921fd612f806 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f53717fa640 1 -- 172.21.15.62:0/1508716023 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c056ac0 con 0x55727d76cf00 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f53717fa640 1 -- 172.21.15.62:0/1508716023 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c054e30 con 0x55727d76cf00 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f53717fa640 1 -- 172.21.15.62:0/1508716023 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c060700 con 0x55727d76cf00 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 -- 172.21.15.62:0/1508716023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 msgr2=0x55727d762b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f537c058420 tx=0x7f537c0581a0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 -- 172.21.15.62:0/1508716023 shutdown_connections 2023-09-30T13:55:17.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d762b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7675c0 0x55727d76c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 --2- 172.21.15.62:0/1508716023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7671e0 0x55727d784cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 -- 172.21.15.62:0/1508716023 >> 172.21.15.62:0/1508716023 conn(0x55727d73a620 msgr2=0x55727d739e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 -- 172.21.15.62:0/1508716023 shutdown_connections 2023-09-30T13:55:17.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.636+0000 7f5393c02740 1 -- 172.21.15.62:0/1508716023 wait complete. 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.637+0000 7f5393c02740 1 -- start start 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.637+0000 7f5393c02740 1 Processor -- start 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7671e0 0x55727d763010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d7a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d762bf0 con 0x55727d76cf00 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55727d7ef870 con 0x55727d7675c0 2023-09-30T13:55:17.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55727d788050 con 0x55727d7671e0 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5393c02740 10 client.0 _ll_register_callbacks cb 0x7f53740045e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47094/0 (socket says 172.21.15.62:47094) 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 -- 172.21.15.62:0/318930349 learned_addr learned my addr 172.21.15.62:0/318930349 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538a59c640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d7a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538ad9d640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7671e0 0x55727d763010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 -- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7671e0 msgr2=0x55727d763010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7671e0 0x55727d763010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 -- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 msgr2=0x55727d7a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d7a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 -- 172.21.15.62:0/318930349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c0c30d0 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f538b59e640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f537c004af0 tx=0x7f537c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96cd176a8a7f153 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.638+0000 7f5369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c081dd0 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5384004940 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f537c054fa0 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f537c078030 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 10 client.4857 fetch_fsmap learned FSMap version 9 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55727d642cd0 con 0x55727d76cf00 2023-09-30T13:55:17.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384004940 con 0x55727d76cf00 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f537c07b070 con 0x55727d76cf00 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 10 client.4857 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 20 client.4857 populate_metadata read hostname 'smithi062' 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d7eeaa0 0x55727d7eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 4 client.4857 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 --> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55727d69e730 con 0x55727d7eeaa0 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.639+0000 7f538ad9d640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d7eeaa0 0x55727d7eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5369ffb640 10 client.4857 ms_handle_connect on v2:172.21.15.135:6834/2869657877 2023-09-30T13:55:17.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f538ad9d640 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d7eeaa0 0x55727d7eee80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb888ecd96cb3f3 server_cookie=80daf8e64cabf433 in_seq=0 out_seq=0 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5369ffb640 1 -- 172.21.15.62:0/318930349 <== mds.0 v2:172.21.15.135:6834/2869657877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55727d69e730 con 0x55727d7eeaa0 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5369ffb640 10 client.4857 handle_command_reply: tid=0 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 client.4857 shutdown 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 msgr2=0x55727d797910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f537c004af0 tx=0x7f537c000f40 comp rx=0 tx=0).stop 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 shutdown_connections 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:6834/2869657877,v1:172.21.15.135:6836/2869657877] conn(0x55727d7eeaa0 0x55727d7eee80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55727d76cf00 0x55727d797910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55727d7675c0 0x55727d7a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5369ffb640 0 client.4857 ms_handle_reset on v2:172.21.15.135:6834/2869657877 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 --2- 172.21.15.62:0/318930349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55727d7671e0 0x55727d763010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 >> 172.21.15.62:0/318930349 conn(0x55727d73a620 msgr2=0x55727d766390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 shutdown_connections 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 1 -- 172.21.15.62:0/318930349 wait complete. 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f5393c02740 20 client.4857 trim_cache size 0 max 16384 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "79595c1b-6895-4c76-9183-336503666b5b", 2023-09-30T13:55:17.649 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4285, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 27.224046663999999, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 9, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 24, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 24, 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 34.326279516 2023-09-30T13:55:17.650 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.640+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 msgr2=0x7f537806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 0x7f537806d020 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5384034000 tx=0x7f5384007000 comp rx=0 tx=0).stop 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 msgr2=0x7f538c0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f538c0b0b20 tx=0x7f537c00f580 comp rx=0 tx=0).stop 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 shutdown_connections 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f537806ab60 0x7f537806d020 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f538c0ab8d0 0x7f538c0caf60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f538c0ad110 0x7f538c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 --2- 172.21.15.62:0/1617916130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53740039a0 0x7f538c147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 >> 172.21.15.62:0/1617916130 conn(0x7f538c06a430 msgr2=0x7f538c0ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 shutdown_connections 2023-09-30T13:55:17.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:17.641+0000 7f539106f640 1 -- 172.21.15.62:0/1617916130 wait complete. 2023-09-30T13:55:17.653 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T13:55:17.664 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T13:55:17.664 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-30T13:55:17.664 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T13:55:17.664 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T13:55:17.664 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:17.664 INFO:tasks.ceph_fuse:client.2 config is {} 2023-09-30T13:55:17.664 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T13:55:17.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:17.665 INFO:tasks.ceph_fuse:client.1 config is {} 2023-09-30T13:55:17.665 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T13:55:17.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:17.665 INFO:tasks.ceph_fuse:client.3 config is {} 2023-09-30T13:55:17.665 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T13:55:17.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:17.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:17.665 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:55:17.681 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-09-30T13:55:17.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:17.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-30T13:55:17.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:17.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2023-09-30T13:55:17.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:17.851 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:55:17.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:17.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-09-30T13:55:17.944 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-09-30T13:55:17.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:55:17.946 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T13:55:17.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:55:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.051+0000 7f044c2ec640 1 Processor -- start 2023-09-30T13:55:18.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.051+0000 7f044c2ec640 1 -- start start 2023-09-30T13:55:18.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.052+0000 7f044c2ec640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04440d06b0 0x7f044406bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:18.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.052+0000 7f044c2ec640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440d0b20 con 0x7f044415cbe0 2023-09-30T13:55:18.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.052+0000 7f044c2ec640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440cf450 con 0x7f04440d1410 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.052+0000 7f044c2ec640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440cfcf0 con 0x7f04440d06b0 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a889640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04440d06b0 0x7f044406bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a088640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f044415cbe0 0x7f04440d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52726/0 (socket says 172.21.15.62:52726) 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a088640 1 -- 172.21.15.62:0/3025199085 learned_addr learned my addr 172.21.15.62:0/3025199085 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a889640 1 -- 172.21.15.62:0/3025199085 >> v1:172.21.15.135:6789/0 conn(0x7f04440d1410 legacy=0x7f044406b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a889640 1 -- 172.21.15.62:0/3025199085 >> v1:172.21.15.62:6789/0 conn(0x7f044415cbe0 legacy=0x7f04440d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f044a889640 1 -- 172.21.15.62:0/3025199085 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440cf730 con 0x7f04440d06b0 2023-09-30T13:55:18.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.053+0000 7f0449086640 1 -- 172.21.15.62:0/3025199085 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854274369 0 0) 0x7f04440d0b20 con 0x7f044415cbe0 2023-09-30T13:55:18.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044a889640 1 --2- 172.21.15.62:0/3025199085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f044406bd60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58fc757ce9512fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:18.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f0449086640 1 -- 172.21.15.62:0/3025199085 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043402cd80 con 0x7f04440d06b0 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f0449086640 1 -- 172.21.15.62:0/3025199085 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434034440 con 0x7f04440d06b0 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f0449086640 1 -- 172.21.15.62:0/3025199085 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340347d0 con 0x7f04440d06b0 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 -- 172.21.15.62:0/3025199085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 msgr2=0x7f044406bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3025199085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f044406bd60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0434009d90 tx=0x7f043402bfd0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 -- 172.21.15.62:0/3025199085 shutdown_connections 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3025199085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f044406bd60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 -- 172.21.15.62:0/3025199085 >> 172.21.15.62:0/3025199085 conn(0x7f0444089fe0 msgr2=0x7f04440d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 -- 172.21.15.62:0/3025199085 shutdown_connections 2023-09-30T13:55:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.054+0000 7f044c2ec640 1 -- 172.21.15.62:0/3025199085 wait complete. 2023-09-30T13:55:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 Processor -- start 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 -- start start 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 0x7f0444158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f044415cbe0 0x7f04440cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044415f3c0 con 0x7f04440d06b0 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440cc910 con 0x7f04440d1410 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044c2ec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440c9f20 con 0x7f044415cbe0 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044a088640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044a088640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47112/0 (socket says 172.21.15.62:47112) 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.056+0000 7f044a088640 1 -- 172.21.15.62:0/3463883175 learned_addr learned my addr 172.21.15.62:0/3463883175 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 -- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f044415cbe0 msgr2=0x7f04440cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f044415cbe0 0x7f04440cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 -- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 msgr2=0x7f0444158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f0449887640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 0x7f0444158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 0x7f0444158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 -- 172.21.15.62:0/3463883175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009a70 con 0x7f04440d06b0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f0449887640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 0x7f0444158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044a088640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f043c00c440 tx=0x7f043c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c007480 con 0x7f04440d06b0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c0075e0 con 0x7f04440d06b0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04441591f0 con 0x7f04440d06b0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0059e0 con 0x7f04440d06b0 2023-09-30T13:55:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.057+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044415f8f0 con 0x7f04440d06b0 2023-09-30T13:55:18.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.058+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044404e0d0 con 0x7f04440d06b0 2023-09-30T13:55:18.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.059+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f043c005b40 con 0x7f04440d06b0 2023-09-30T13:55:18.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.059+0000 7f0442ffd640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 0x7f043006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:18.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.059+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f043c088fd0 con 0x7f04440d06b0 2023-09-30T13:55:18.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.059+0000 7f0449887640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 0x7f043006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:18.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.060+0000 7f0449887640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 0x7f043006cff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04440c97a0 tx=0x7f0438009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:18.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.063+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f043c053ff0 con 0x7f04440d06b0 2023-09-30T13:55:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.273+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04440b8750 con 0x7f04440d06b0 2023-09-30T13:55:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.274+0000 7f0442ffd640 1 -- 172.21.15.62:0/3463883175 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f043c057610 con 0x7f04440d06b0 2023-09-30T13:55:18.275 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-30T13:55:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 msgr2=0x7f043006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 0x7f043006cff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04440c97a0 tx=0x7f0438009040 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 msgr2=0x7f04440c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f043c00c440 tx=0x7f043c00c900 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 shutdown_connections 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f043006ab30 0x7f043006cff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f044415cbe0 0x7f04440cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04440d1410 0x7f0444158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 --2- 172.21.15.62:0/3463883175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04440d06b0 0x7f04440c99e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 >> 172.21.15.62:0/3463883175 conn(0x7f0444089fe0 msgr2=0x7f044406c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 shutdown_connections 2023-09-30T13:55:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:18.276+0000 7f044c2ec640 1 -- 172.21.15.62:0/3463883175 wait complete. 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:18.287 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:55:18.288 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:55:18.288 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:55:18.288 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:55:18.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.288 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:55:18.303 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:55:18.304 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42675sec preferred_lft 42675sec 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:55:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:18.306 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T13:55:18.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T13:55:18.306 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:18.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.426 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:55:18.456 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:55:18.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.459 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:55:18.515 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:55:18.516 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:55:18.516 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:55:18.516 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:55:18.516 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:55:18.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:55:18.517 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:18.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.623 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:55:18.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.638 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-09-30T13:55:18.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.692 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:18.692 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:18.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:18.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T13:55:18.693 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:18.782 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T13:55:18.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T13:55:18.783 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:18.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:18.886 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:18.886 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:18.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-09-30T13:55:18.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T13:55:18.886 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:18.934 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T13:55:18.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:18.935 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:18.962 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:55:18.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:18.963 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:19.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:55:19.090 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:19.146 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:55:19.147 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:19.148 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:19.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:19.149 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:55:19.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:55:19.202 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:55:19.203 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T13:55:19.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:55:19.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:55:19.318 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:19.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:2023-09-30T13:55:19.338+0000 7fb9a1c3b480 -1 init, newargv = 0x55d44e72e970 newargc=15 2023-09-30T13:55:19.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[97948]: starting ceph client 2023-09-30T13:55:19.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[97948]: starting fuse 2023-09-30T13:55:19.356 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:55:19.356 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:55:19.356 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:55:19.356 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:55:19.356 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:55:19.357 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:55:19.358 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:19.359 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:55:19.360 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:19.361 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:19.361 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:19.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:19.361 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:55:19.412 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:55:19.413 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:55:19.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:55:19.413 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:55:19.413 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:55:19.413 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:55:19.414 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:55:19.414 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:19.414 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:55:19.414 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T13:55:19.414 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:55:19.415 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:55:19.416 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2023-09-30T13:55:19.417 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:55:19.537 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.97948.asok 2023-09-30T13:55:19.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:55:19.548 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.97948.asok 2023-09-30T13:55:19.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:19.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.97948.asok status 2023-09-30T13:55:19.690 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:55:19.690 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:55:19.690 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:55:19.690 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:55:19.690 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "0", 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "97948", 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4875, 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:55:19.691 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4875 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3410254890 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 3410254890 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4875 192.168.0.1:0/3410254890", 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/3410254890", 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 9, 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 24, 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:55:19.693 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:55:19.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:55:19.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.804+0000 7fbcd412c640 1 Processor -- start 2023-09-30T13:55:19.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.804+0000 7fbcd412c640 1 -- start start 2023-09-30T13:55:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd412c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbccc0ace50 0x7fbccc0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd412c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc15b9a0 con 0x7fbccc0cf140 2023-09-30T13:55:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd412c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0cc950 con 0x7fbccc0b31c0 2023-09-30T13:55:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd412c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0b2e50 con 0x7fbccc0ace50 2023-09-30T13:55:19.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd26c9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbccc0cf140 0x7fbccc0ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52736/0 (socket says 172.21.15.62:52736) 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd26c9640 1 -- 172.21.15.62:0/773688962 learned_addr learned my addr 172.21.15.62:0/773688962 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd1ec8640 1 --2- 172.21.15.62:0/773688962 >> v2:172.21.15.135:3300/0 conn(0x7fbccc0ace50 0x7fbccc0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014426749 0 0) 0x7fbccc15b9a0 con 0x7fbccc0cf140 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb8003520 con 0x7fbccc0cf140 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867868676 0 0) 0x7fbcb8003520 con 0x7fbccc0cf140 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 >> v2:172.21.15.135:3300/0 conn(0x7fbccc0ace50 msgr2=0x7fbccc0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 --2- 172.21.15.62:0/773688962 >> v2:172.21.15.135:3300/0 conn(0x7fbccc0ace50 0x7fbccc0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 >> v1:172.21.15.135:6789/0 conn(0x7fbccc0b31c0 legacy=0x7fbccc0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc15add0 con 0x7fbccc0cf140 2023-09-30T13:55:19.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fbcc40019f0 con 0x7fbccc0cf140 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 >> v1:172.21.15.62:6789/0 conn(0x7fbccc0cf140 legacy=0x7fbccc0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8003970 0x7fbcb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.805+0000 7fbcd0ec6640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb80047c0 0x7fbcb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd0ec6640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 0x7fbcb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0b2e50 con 0x7fbcb8005180 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb800c120 con 0x7fbcb8003970 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb800c2e0 con 0x7fbcb80047c0 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 0x7fbcb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd1ec8640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8003970 0x7fbcb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd16c7640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb80047c0 0x7fbcb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 -- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb80047c0 msgr2=0x7fbcb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb80047c0 0x7fbcb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 -- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8003970 msgr2=0x7fbcb8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8003970 0x7fbcb8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.806+0000 7fbcd26c9640 1 -- 172.21.15.62:0/773688962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8003520 con 0x7fbcb8005180 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd26c9640 1 -- 172.21.15.62:0/773688962 reap_dead start 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 0x7fbcb800b980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbccc15f5d0 tx=0x7fbcb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e2f1bd8950409e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40072d0 con 0x7fbcb8005180 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc402f070 con 0x7fbcb8005180 2023-09-30T13:55:19.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd0ec6640 1 -- 172.21.15.62:0/773688962 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007670 con 0x7fbcb8005180 2023-09-30T13:55:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 -- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 msgr2=0x7fbcb800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 0x7fbcb800b980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbccc15f5d0 tx=0x7fbcb80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 -- 172.21.15.62:0/773688962 shutdown_connections 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 --2- 172.21.15.62:0/773688962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcb8005180 0x7fbcb800b980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 -- 172.21.15.62:0/773688962 >> 172.21.15.62:0/773688962 conn(0x7fbccc06a170 msgr2=0x7fbccc06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 -- 172.21.15.62:0/773688962 shutdown_connections 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.807+0000 7fbcd412c640 1 -- 172.21.15.62:0/773688962 wait complete. 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 Processor -- start 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 -- start start 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb8005180 0x7fbccc0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbccc0c5710 0x7fbccc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1591a0 con 0x7fbccc1f0470 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1f0e60 con 0x7fbccc0c5710 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd412c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c5b90 con 0x7fbcb8005180 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.809+0000 7fbcd26c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47120/0 (socket says 172.21.15.62:47120) 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 -- 172.21.15.62:0/1883598470 learned_addr learned my addr 172.21.15.62:0/1883598470 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd16c7640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbccc0c5710 0x7fbccc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd1ec8640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb8005180 0x7fbccc0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 -- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb8005180 msgr2=0x7fbccc0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb8005180 0x7fbccc0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 -- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbccc0c5710 msgr2=0x7fbccc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbccc0c5710 0x7fbccc0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 -- 172.21.15.62:0/1883598470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0c5e10 con 0x7fbccc1f0470 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd26c9640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbcc402cbf0 tx=0x7fbcc4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4004d60 con 0x7fbccc1f0470 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc40070d0 con 0x7fbccc1f0470 2023-09-30T13:55:19.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc0c60f0 con 0x7fbccc1f0470 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007440 con 0x7fbccc1f0470 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.810+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc0c66b0 con 0x7fbccc1f0470 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.811+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc04e0d0 con 0x7fbccc1f0470 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.812+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbcc4031030 con 0x7fbccc1f0470 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.812+0000 7fbcc27fc640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 0x7fbcb006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:19.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.812+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcc40aa570 con 0x7fbccc1f0470 2023-09-30T13:55:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.812+0000 7fbcd1ec8640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 0x7fbcb006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.813+0000 7fbcd1ec8640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 0x7fbcb006cff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009a70 tx=0x7fbcbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:19.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:19.816+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbcc4075610 con 0x7fbccc1f0470 2023-09-30T13:55:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.034+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbccc0b21e0 con 0x7fbccc1f0470 2023-09-30T13:55:20.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.034+0000 7fbcc27fc640 1 -- 172.21.15.62:0/1883598470 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbcc4078c30 con 0x7fbccc1f0470 2023-09-30T13:55:20.035 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-30T13:55:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 msgr2=0x7fbcb006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 0x7fbcb006cff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009a70 tx=0x7fbcbc008040 comp rx=0 tx=0).stop 2023-09-30T13:55:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 msgr2=0x7fbccc1f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbcc402cbf0 tx=0x7fbcc4001d80 comp rx=0 tx=0).stop 2023-09-30T13:55:20.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 shutdown_connections 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbcb006ab30 0x7fbcb006cff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbccc1f0470 0x7fbccc1f0920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbccc0c5710 0x7fbccc0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 --2- 172.21.15.62:0/1883598470 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcb8005180 0x7fbccc0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 >> 172.21.15.62:0/1883598470 conn(0x7fbccc06a170 msgr2=0x7fbccc15af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 shutdown_connections 2023-09-30T13:55:20.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:20.036+0000 7fbcd412c640 1 -- 172.21.15.62:0/1883598470 wait complete. 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:20.047 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:55:20.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:55:20.048 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:55:20.048 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-30T13:55:20.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.048 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:55:20.063 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:20.064 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:20.064 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:20.064 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.064 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:20.064 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:20.065 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:55:20.066 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:20.066 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:20.066 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:55:20.066 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:20.066 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:55:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42673sec preferred_lft 42673sec 2023-09-30T13:55:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:55:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.067 INFO:teuthology.orchestra.run.smithi062.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 76:90:4c:92:44:62 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1036:68ff:fe6f:69f4/64 scope link 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:55:20.068 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 76:90:4c:92:44:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:20.069 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::7490:4cff:fe92:4462/64 scope link tentative 2023-09-30T13:55:20.069 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.069 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:55:20.133 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:55:20.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.135 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:55:20.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:55:20.191 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:20.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.295 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:55:20.310 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T13:55:20.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.311 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-09-30T13:55:20.365 INFO:teuthology.orchestra.run.smithi062.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-30T13:55:20.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.366 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:20.366 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:20.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:55:20.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-30T13:55:20.366 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:20.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T13:55:20.486 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:20.486 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 16:08:be:0b:d5:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1408:beff:fe0b:d5b2/64 scope link tentative 2023-09-30T13:55:20.487 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-30T13:55:20.559 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:20.559 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 16:08:be:0b:d5:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1408:beff:fe0b:d5b2/64 scope link tentative 2023-09-30T13:55:20.560 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:20.561 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-30T13:55:20.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-30T13:55:20.562 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:20.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.704 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:55:20.704 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:55:20.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.1 up 2023-09-30T13:55:20.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T13:55:20.704 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:55:20.753 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-09-30T13:55:20.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:20.753 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:20.768 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-30T13:55:20.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:20.769 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:20.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:55:20.894 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:20.952 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:55:20.953 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:55:20.954 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:55:20.954 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:55:20.954 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:55:20.954 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:55:20.954 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:55:20.955 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:20.956 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:55:20.957 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:55:20.957 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:55:20.957 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:55:20.957 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:55:20.957 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:55:20.958 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:55:20.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:20.959 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:55:21.007 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:55:21.007 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-09-30T13:55:21.008 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-09-30T13:55:21.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:55:21.080 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:21.136 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:55:21.137 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:55:21.137 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:55:21.137 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:55:21.137 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:55:21.137 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:55:21.138 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:21.139 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:55:21.139 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:55:21.139 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:55:21.142 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:55:21.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:21.143 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:55:21.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi062.stderr:2023-09-30T13:55:21.143+0000 7f0b5283e480 -1 init, newargv = 0x557826ea6a90 newargc=15 2023-09-30T13:55:21.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi062.stderr:ceph-fuse[98443]: starting ceph client 2023-09-30T13:55:21.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi062.stderr:ceph-fuse[98443]: starting fuse 2023-09-30T13:55:21.158 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:55:21.159 INFO:teuthology.orchestra.run.smithi062.stdout:44 2023-09-30T13:55:21.159 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-09-30T13:55:21.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:55:21.159 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:55:21.160 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-09-30T13:55:21.161 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:55:21.161 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-09-30T13:55:21.161 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:21.161 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:55:21.162 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:55:21.163 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:55:21.164 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:55:21.164 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.2")) 2023-09-30T13:55:21.164 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:55:21.283 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.2.98443.asok 2023-09-30T13:55:21.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:55:21.293 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.98443.asok 2023-09-30T13:55:21.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:21.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.98443.asok status 2023-09-30T13:55:21.435 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:55:21.435 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:55:21.435 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "2", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "98443", 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4887, 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:55:21.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4887 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.2:0", 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2632803943 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.2:0", 2023-09-30T13:55:21.437 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2632803943 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4887 192.168.0.2:0/2632803943", 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.2:0/2632803943", 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 9, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 24, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:55:21.438 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:55:21.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:55:21.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.549+0000 7f29179ce640 1 Processor -- start 2023-09-30T13:55:21.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.549+0000 7f29179ce640 1 -- start start 2023-09-30T13:55:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f29179ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 0x7f291006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f29179ce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29100d1410 0x7f29100af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f29179ce640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29100cb810 con 0x7f291006b070 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f29179ce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291006c230 con 0x7f29100d1410 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f29179ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100cccb0 con 0x7f291015cbb0 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29100d1410 0x7f29100af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f29100d1410 0x7f29100af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47132/0 (socket says 172.21.15.62:47132) 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 -- 172.21.15.62:0/1542989657 learned_addr learned my addr 172.21.15.62:0/1542989657 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f291576a640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 0x7f291006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 -- 172.21.15.62:0/1542989657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 msgr2=0x7f291006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 0x7f291006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 -- 172.21.15.62:0/1542989657 >> v1:172.21.15.135:6789/0 conn(0x7f291006b070 legacy=0x7f291006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f2915f6b640 1 -- 172.21.15.62:0/1542989657 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100caee0 con 0x7f29100d1410 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.550+0000 7f291576a640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 0x7f291006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.551+0000 7f2915f6b640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29100d1410 0x7f29100af3d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2908009e50 tx=0x7f290802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca63d8d298d3c470 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.551+0000 7f2907fff640 1 -- 172.21.15.62:0/1542989657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290802cb00 con 0x7f29100d1410 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.551+0000 7f2907fff640 1 -- 172.21.15.62:0/1542989657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290802cc60 con 0x7f29100d1410 2023-09-30T13:55:21.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.551+0000 7f2907fff640 1 -- 172.21.15.62:0/1542989657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080343f0 con 0x7f29100d1410 2023-09-30T13:55:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 -- 172.21.15.62:0/1542989657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29100d1410 msgr2=0x7f29100af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29100d1410 0x7f29100af3d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2908009e50 tx=0x7f290802bf60 comp rx=0 tx=0).stop 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 -- 172.21.15.62:0/1542989657 shutdown_connections 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29100d1410 0x7f29100af3d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 --2- 172.21.15.62:0/1542989657 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f291015cbb0 0x7f291006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 -- 172.21.15.62:0/1542989657 >> 172.21.15.62:0/1542989657 conn(0x7f2910089fe0 msgr2=0x7f29100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 -- 172.21.15.62:0/1542989657 shutdown_connections 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.552+0000 7f29179ce640 1 -- 172.21.15.62:0/1542989657 wait complete. 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.553+0000 7f29179ce640 1 Processor -- start 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.553+0000 7f29179ce640 1 -- start start 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29100d1410 0x7f291009c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291015cbb0 0x7f291009caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291009dd10 con 0x7f291006b070 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291009b920 con 0x7f291015cbb0 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291009d100 con 0x7f29100d1410 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47146/0 (socket says 172.21.15.62:47146) 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 -- 172.21.15.62:0/259074388 learned_addr learned my addr 172.21.15.62:0/259074388 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f2915f6b640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291015cbb0 0x7f291009caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f2914f69640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29100d1410 0x7f291009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 -- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29100d1410 msgr2=0x7f291009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29100d1410 0x7f291009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 -- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291015cbb0 msgr2=0x7f291009caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291015cbb0 0x7f291009caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 -- 172.21.15.62:0/259074388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009b30 con 0x7f291006b070 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f291576a640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c7f0 tx=0x7f290c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c007a30 con 0x7f291006b070 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c007b90 con 0x7f291006b070 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.554+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291009d3e0 con 0x7f291006b070 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.555+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c00ce40 con 0x7f291006b070 2023-09-30T13:55:21.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.555+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291009d9a0 con 0x7f291006b070 2023-09-30T13:55:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.556+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291006e2a0 con 0x7f291006b070 2023-09-30T13:55:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.556+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f290c0113f0 con 0x7f291006b070 2023-09-30T13:55:21.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.556+0000 7f2905ffb640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 0x7f28f406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:21.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.556+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f290c0896f0 con 0x7f291006b070 2023-09-30T13:55:21.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.556+0000 7f2914f69640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 0x7f28f406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:21.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.557+0000 7f2914f69640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 0x7f28f406cff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29101f5430 tx=0x7f2900009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:21.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.561+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f290c054650 con 0x7f291006b070 2023-09-30T13:55:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.774+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f291004e0d0 con 0x7f291006b070 2023-09-30T13:55:21.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.774+0000 7f2905ffb640 1 -- 172.21.15.62:0/259074388 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f290c057c70 con 0x7f291006b070 2023-09-30T13:55:21.775 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-30T13:55:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 msgr2=0x7f28f406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 0x7f28f406cff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29101f5430 tx=0x7f2900009040 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 msgr2=0x7f291015aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c7f0 tx=0x7f290c00cbf0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 shutdown_connections 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f28f406ab30 0x7f28f406cff0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f291015cbb0 0x7f291009caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29100d1410 0x7f291009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 --2- 172.21.15.62:0/259074388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f291006b070 0x7f291015aaf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 >> 172.21.15.62:0/259074388 conn(0x7f2910089fe0 msgr2=0x7f291015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 shutdown_connections 2023-09-30T13:55:21.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:21.776+0000 7f29179ce640 1 -- 172.21.15.62:0/259074388 wait complete. 2023-09-30T13:55:21.786 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:55:21.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:55:21.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:21.787 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-09-30T13:55:21.805 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:21.806 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42674sec preferred_lft 42674sec 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-09-30T13:55:21.807 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:21.808 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T13:55:21.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T13:55:21.808 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:21.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:21.975 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:55:22.003 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-09-30T13:55:22.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.005 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-09-30T13:55:22.084 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-09-30T13:55:22.085 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:55:22.085 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:55:22.085 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:55:22.085 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:55:22.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.086 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:22.086 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:22.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:55:22.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:55:22.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:55:22.087 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:22.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.380 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:55:22.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.394 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-09-30T13:55:22.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.450 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:22.450 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:22.450 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:22.450 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-30T13:55:22.450 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:22.534 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-30T13:55:22.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.534 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-30T13:55:22.535 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:22.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.675 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:22.675 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:22.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-09-30T13:55:22.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T13:55:22.675 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:22.717 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-09-30T13:55:22.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:22.717 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:22.771 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:55:22.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:22.771 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:22.827 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:55:22.895 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:55:22.951 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:22.952 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:55:22.953 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:22.954 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:22.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:22.954 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:55:23.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:55:23.006 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-09-30T13:55:23.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:55:23.075 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:55:23.131 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:55:23.132 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:23.133 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:55:23.134 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:55:23.135 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:23.135 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:23.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.135 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:55:23.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:2023-09-30T13:55:23.173+0000 7f8aa443a480 -1 init, newargv = 0x55c1804f5cd0 newargc=15 2023-09-30T13:55:23.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[93603]: starting ceph client 2023-09-30T13:55:23.177 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[93603]: starting fuse 2023-09-30T13:55:23.187 INFO:teuthology.orchestra.run.smithi135.stdout:41 2023-09-30T13:55:23.187 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:55:23.187 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:55:23.187 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2023-09-30T13:55:23.187 DEBUG:teuthology.orchestra.run.smithi135:> import re 2023-09-30T13:55:23.187 DEBUG:teuthology.orchestra.run.smithi135:> import os 2023-09-30T13:55:23.187 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2023-09-30T13:55:23.188 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> return f 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.1")) 2023-09-30T13:55:23.189 DEBUG:teuthology.orchestra.run.smithi135:> ' 2023-09-30T13:55:23.306 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.1.93603.asok 2023-09-30T13:55:23.309 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:55:23.316 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.93603.asok 2023-09-30T13:55:23.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.316 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.93603.asok status 2023-09-30T13:55:23.452 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "1", 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-09-30T13:55:23.453 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "93603", 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4768, 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4768 2023-09-30T13:55:23.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2330121785 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:55:23.455 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2330121785 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4768 192.168.0.1:0/2330121785", 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/2330121785", 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 9, 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 24, 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:55:23.456 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2023-09-30T13:55:23.457 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2023-09-30T13:55:23.457 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-30T13:55:23.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:55:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.579+0000 7fc1f451d640 1 Processor -- start 2023-09-30T13:55:23.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.579+0000 7fc1f451d640 1 -- start start 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f451d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1ec0cea30 0x7fc1ec0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f451d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1ec0ab250 0x7fc1ec0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f451d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0cf3d0 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f451d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b2e50 con 0x7fc1ec0cea30 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f451d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0ac2d0 con 0x7fc1ec0ab250 2023-09-30T13:55:23.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f1ab8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1ec0cea30 0x7fc1ec0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f1ab8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1ec0cea30 0x7fc1ec0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47154/0 (socket says 172.21.15.62:47154) 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/2202742957 learned_addr learned my addr 172.21.15.62:0/2202742957 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.580+0000 7fc1f2aba640 1 --2- 172.21.15.62:0/2202742957 >> v2:172.21.15.135:3300/0 conn(0x7fc1ec0ab250 0x7fc1ec0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/2202742957 >> v2:172.21.15.135:3300/0 conn(0x7fc1ec0ab250 msgr2=0x7fc1ec0ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f1ab8640 1 --2- 172.21.15.62:0/2202742957 >> v2:172.21.15.135:3300/0 conn(0x7fc1ec0ab250 0x7fc1ec0ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/2202742957 >> v1:172.21.15.135:6789/0 conn(0x7fc1ec0cdc20 legacy=0x7fc1ec0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f12b7640 1 -- 172.21.15.62:0/2202742957 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360118165 0 0) 0x7fc1ec0cf3d0 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/2202742957 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0cc340 con 0x7fc1ec0cea30 2023-09-30T13:55:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.581+0000 7fc1f1ab8640 1 --2- 172.21.15.62:0/2202742957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cea30 0x7fc1ec0cee90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec15afc0 tx=0x7fc1dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3003d9d7d99734fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f12b7640 1 -- 172.21.15.62:0/2202742957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc031870 con 0x7fc1ec0cea30 2023-09-30T13:55:23.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f12b7640 1 -- 172.21.15.62:0/2202742957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0319d0 con 0x7fc1ec0cea30 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f12b7640 1 -- 172.21.15.62:0/2202742957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc031d60 con 0x7fc1ec0cea30 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 -- 172.21.15.62:0/2202742957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cea30 msgr2=0x7fc1ec0cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 --2- 172.21.15.62:0/2202742957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cea30 0x7fc1ec0cee90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec15afc0 tx=0x7fc1dc02b910 comp rx=0 tx=0).stop 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 -- 172.21.15.62:0/2202742957 shutdown_connections 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 --2- 172.21.15.62:0/2202742957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cea30 0x7fc1ec0cee90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 --2- 172.21.15.62:0/2202742957 >> v2:172.21.15.135:3300/0 conn(0x7fc1ec0ab250 0x7fc1ec0ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 -- 172.21.15.62:0/2202742957 >> 172.21.15.62:0/2202742957 conn(0x7fc1ec06a170 msgr2=0x7fc1ec06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 -- 172.21.15.62:0/2202742957 shutdown_connections 2023-09-30T13:55:23.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.582+0000 7fc1f451d640 1 -- 172.21.15.62:0/2202742957 wait complete. 2023-09-30T13:55:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 Processor -- start 2023-09-30T13:55:23.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 -- start start 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1ec0ab250 0x7fc1ec1f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 0x7fc1ec15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0c7400 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0c5710 con 0x7fc1ec0ab250 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f451d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1f0970 con 0x7fc1ec0cea30 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f1ab8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.584+0000 7fc1f1ab8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47166/0 (socket says 172.21.15.62:47166) 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/484503616 learned_addr learned my addr 172.21.15.62:0/484503616 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f22b9640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1ec0ab250 0x7fc1ec1f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f2aba640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 0x7fc1ec15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 msgr2=0x7fc1ec15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 0x7fc1ec15bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1ec0ab250 msgr2=0x7fc1ec1f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1ec0ab250 0x7fc1ec1f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 -- 172.21.15.62:0/484503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc0094d0 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f2aba640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 0x7fc1ec15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f1ab8640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000c00 tx=0x7fc1dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:23.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004230 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0043b0 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004520 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1f0c50 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.585+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec0c7610 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.586+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec0c8cb0 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.587+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc1dc043070 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.587+0000 7fc1e2ffd640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 0x7fc1d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.587+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1dc02d040 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.587+0000 7fc1f22b9640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 0x7fc1d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:23.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.588+0000 7fc1f22b9640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 0x7fc1d006cff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0c5090 tx=0x7fc1e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.591+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc1dc076470 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.808+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1ec0c7800 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.808+0000 7fc1e2ffd640 1 -- 172.21.15.62:0/484503616 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc1dc035070 con 0x7fc1ec0cdc20 2023-09-30T13:55:23.809 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-30T13:55:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 msgr2=0x7fc1d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 0x7fc1d006cff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0c5090 tx=0x7fc1e8009040 comp rx=0 tx=0).stop 2023-09-30T13:55:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 msgr2=0x7fc1ec157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000c00 tx=0x7fc1dc0046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 shutdown_connections 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc1d006ab30 0x7fc1d006cff0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1ec0cea30 0x7fc1ec15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ec0cdc20 0x7fc1ec157560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 --2- 172.21.15.62:0/484503616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1ec0ab250 0x7fc1ec1f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 >> 172.21.15.62:0/484503616 conn(0x7fc1ec06a170 msgr2=0x7fc1ec0ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 shutdown_connections 2023-09-30T13:55:23.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:23.810+0000 7fc1f451d640 1 -- 172.21.15.62:0/484503616 wait complete. 2023-09-30T13:55:23.821 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:55:23.821 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:55:23.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:55:23.822 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-30T13:55:23.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.822 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-09-30T13:55:23.839 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.839 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:23.840 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42672sec preferred_lft 42672sec 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.841 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::6cbb:34ff:fe6b:3087/64 scope link tentative 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::9413:a8ff:fed8:bd0b/64 scope link tentative 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:23.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.842 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:55:23.907 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-09-30T13:55:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.909 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-09-30T13:55:23.965 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-09-30T13:55:23.965 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:55:23.965 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:55:23.966 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:55:23.966 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:55:23.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:23.966 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:23.966 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:23.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:55:23.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:55:23.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:55:23.967 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:24.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.063 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:55:24.078 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T13:55:24.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.078 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-09-30T13:55:24.132 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-30T13:55:24.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.133 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:24.133 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:24.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:55:24.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-30T13:55:24.133 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:24.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.215 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T13:55:24.280 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 4e:c7:33:3d:87:f3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T13:55:24.281 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T13:55:24.282 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.282 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4cc7:33ff:fe3d:87f3/64 scope link tentative 2023-09-30T13:55:24.282 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.283 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.349 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:55:24.350 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 4e:c7:33:3d:87:f3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-30T13:55:24.350 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-30T13:55:24.350 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.350 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4cc7:33ff:fe3d:87f3/64 scope link 2023-09-30T13:55:24.350 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:55:24.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-30T13:55:24.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.351 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:24.351 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:24.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-30T13:55:24.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-30T13:55:24.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-30T13:55:24.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-30T13:55:24.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-30T13:55:24.352 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:24.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.477 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:55:24.477 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:55:24.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2023-09-30T13:55:24.478 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2023-09-30T13:55:24.478 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:55:24.520 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-09-30T13:55:24.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:24.520 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:24.576 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-30T13:55:24.576 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:55:24.577 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:24.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:55:24.699 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:24.756 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:55:24.756 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:55:24.756 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:55:24.756 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:55:24.756 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:55:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:55:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:55:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:55:24.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.761 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:55:24.810 INFO:teuthology.orchestra.run.smithi135.stdout:41 2023-09-30T13:55:24.811 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-09-30T13:55:24.811 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-09-30T13:55:24.853 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:55:24.879 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:55:24.935 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:55:24.936 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:55:24.937 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run.smithi135.stdout:/home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:55:24.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:24.939 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:55:24.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi135.stderr:2023-09-30T13:55:24.937+0000 7fe1ee7d7480 -1 init, newargv = 0x55cc9b648b60 newargc=15 2023-09-30T13:55:24.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi135.stderr:ceph-fuse[94038]: starting ceph client 2023-09-30T13:55:24.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi135.stderr:ceph-fuse[94038]: starting fuse 2023-09-30T13:55:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:41 2023-09-30T13:55:24.954 INFO:teuthology.orchestra.run.smithi135.stdout:44 2023-09-30T13:55:24.954 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-09-30T13:55:24.954 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:55:24.954 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> import re 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> import os 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2023-09-30T13:55:24.955 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> return f 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.3")) 2023-09-30T13:55:24.956 DEBUG:teuthology.orchestra.run.smithi135:> ' 2023-09-30T13:55:25.073 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.3.94038.asok 2023-09-30T13:55:25.076 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:55:25.084 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94038.asok 2023-09-30T13:55:25.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94038.asok status 2023-09-30T13:55:25.218 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-30T13:55:25.218 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "3", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "94038", 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2023-09-30T13:55:25.219 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4640, 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4640 2023-09-30T13:55:25.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.2:0", 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 179116646 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.2:0", 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 179116646 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:55:25.221 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4640 192.168.0.2:0/179116646", 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.2:0/179116646", 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 9, 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 24, 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2023-09-30T13:55:25.222 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-30T13:55:25.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.227 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:55:25.227 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:25.246 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:55:25.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:25.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:25.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.322 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:55:25.322 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:25.380 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:55:25.380 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:25.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:25.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.454 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2023-09-30T13:55:25.454 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:25.470 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2023-09-30T13:55:25.470 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:25.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:25.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.536 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2023-09-30T13:55:25.537 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:25.592 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2023-09-30T13:55:25.592 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:25.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:25.592 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:25.658 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-30T13:55:25.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:25.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.794+0000 7f1c34905640 1 Processor -- start 2023-09-30T13:55:25.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.794+0000 7f1c34905640 1 -- start start 2023-09-30T13:55:25.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c34905640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c300cdc20 0x7f1c300b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c34905640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c300ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c34905640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300b2e50 con 0x7f1c300b2940 2023-09-30T13:55:25.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c34905640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300ac2d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c34905640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300cc340 con 0x7f1c300cf140 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2ed9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c300ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2e59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c300cdc20 0x7f1c300b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c27fff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1c300b2940 0x7f1c300cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:51194/0 (socket says 172.21.15.62:51194) 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c27fff640 1 -- 172.21.15.62:0/1762554666 learned_addr learned my addr 172.21.15.62:0/1762554666 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2e59c640 1 -- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 msgr2=0x7f1c300ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c300ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2e59c640 1 -- 172.21.15.62:0/1762554666 >> v1:172.21.15.135:6789/0 conn(0x7f1c300b2940 legacy=0x7f1c300cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2e59c640 1 -- 172.21.15.62:0/1762554666 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300cc620 con 0x7f1c300cdc20 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2ed9d640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c300ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.795+0000 7f1c2dd9b640 1 -- 172.21.15.62:0/1762554666 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328668317 0 0) 0x7f1c300b2e50 con 0x7f1c300b2940 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.796+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300cdc20 0x7f1c300b2400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009790 tx=0x7f1c2002b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c74f99e2d8c4bfe7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.796+0000 7f1c2dd9b640 1 -- 172.21.15.62:0/1762554666 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20031770 con 0x7f1c300cdc20 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.796+0000 7f1c2dd9b640 1 -- 172.21.15.62:0/1762554666 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200318d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.796+0000 7f1c2dd9b640 1 -- 172.21.15.62:0/1762554666 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20031c60 con 0x7f1c300cdc20 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 -- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300cdc20 msgr2=0x7f1c300b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300cdc20 0x7f1c300b2400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009790 tx=0x7f1c2002b810 comp rx=0 tx=0).stop 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 -- 172.21.15.62:0/1762554666 shutdown_connections 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c300ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 --2- 172.21.15.62:0/1762554666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300cdc20 0x7f1c300b2400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 -- 172.21.15.62:0/1762554666 >> 172.21.15.62:0/1762554666 conn(0x7f1c3006a170 msgr2=0x7f1c3006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 -- 172.21.15.62:0/1762554666 shutdown_connections 2023-09-30T13:55:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.797+0000 7f1c34905640 1 -- 172.21.15.62:0/1762554666 wait complete. 2023-09-30T13:55:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.798+0000 7f1c34905640 1 Processor -- start 2023-09-30T13:55:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.798+0000 7f1c34905640 1 -- start start 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 0x7f1c300c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c30159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30151690 con 0x7f1c300cdc20 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30156500 con 0x7f1c300b2940 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c34905640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301567e0 con 0x7f1c300cf140 2023-09-30T13:55:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47180/0 (socket says 172.21.15.62:47180) 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c27fff640 1 -- 172.21.15.62:0/111509 learned_addr learned my addr 172.21.15.62:0/111509 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c2ed9d640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c30159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.799+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 0x7f1c300c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 -- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 msgr2=0x7f1c30159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c30159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 -- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 msgr2=0x7f1c300c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 0x7f1c300c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 -- 172.21.15.62:0/111509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28009a70 con 0x7f1c300cdc20 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c2ed9d640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c30159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 0x7f1c300c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c27fff640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c410 tx=0x7f1c1800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180074e0 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18007640 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c200093a0 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18004a00 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.800+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c301512b0 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.801+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c301517d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.801+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1c18004b60 con 0x7f1c300cdc20 2023-09-30T13:55:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.802+0000 7f1c26ffd640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 0x7f1c1006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.802+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c18089170 con 0x7f1c300cdc20 2023-09-30T13:55:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.802+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 0x7f1c1006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.803+0000 7f1c2e59c640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 0x7f1c1006cff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c20036000 tx=0x7f1c2003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:25.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.807+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1c301517d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.984+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c301517d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.985+0000 7f1c26ffd640 1 -- 172.21.15.62:0/111509 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f1c301517d0 con 0x7f1c300cdc20 2023-09-30T13:55:25.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:25.986 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 msgr2=0x7f1c1006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 0x7f1c1006cff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c20036000 tx=0x7f1c2003d040 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 msgr2=0x7f1c301573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c410 tx=0x7f1c1800c810 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 shutdown_connections 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c1006ab30 0x7f1c1006cff0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c300cf140 0x7f1c30159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c300cdc20 0x7f1c301573b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 --2- 172.21.15.62:0/111509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c300b2940 0x7f1c300c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 >> 172.21.15.62:0/111509 conn(0x7f1c3006a170 msgr2=0x7f1c30070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:25.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 shutdown_connections 2023-09-30T13:55:25.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:25.987+0000 7f1c34905640 1 -- 172.21.15.62:0/111509 wait complete. 2023-09-30T13:55:25.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:25.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:26.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.107+0000 7fc5a7894640 1 Processor -- start 2023-09-30T13:55:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.107+0000 7fc5a7894640 1 -- start start 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a7894640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5a00cdfd0 0x7fc5a00d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a7894640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a00d1410 con 0x7fc5a00b8760 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a7894640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a00d16f0 con 0x7fc5a015cbc0 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a7894640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00d19d0 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a4e2f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc5a00b8760 0x7fc5a00cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52744/0 (socket says 172.21.15.62:52744) 2023-09-30T13:55:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a4e2f640 1 -- 172.21.15.62:0/2511266678 learned_addr learned my addr 172.21.15.62:0/2511266678 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a5e31640 1 --2- 172.21.15.62:0/2511266678 >> v2:172.21.15.135:3300/0 conn(0x7fc5a00cdfd0 0x7fc5a00d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590768210 0 0) 0x7fc5a00d1410 con 0x7fc5a00b8760 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc588003520 con 0x7fc5a00b8760 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a5e31640 1 -- 172.21.15.62:0/2511266678 >> v1:172.21.15.135:6789/0 conn(0x7fc5a015cbc0 legacy=0x7fc5a00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a5e31640 1 -- 172.21.15.62:0/2511266678 >> v1:172.21.15.62:6789/0 conn(0x7fc5a00b8760 legacy=0x7fc5a00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100172380 0 0) 0x7fc5a00d16f0 con 0x7fc5a015cbc0 2023-09-30T13:55:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.108+0000 7fc5a5e31640 1 -- 172.21.15.62:0/2511266678 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00d1cb0 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.109+0000 7fc5a5e31640 1 --2- 172.21.15.62:0/2511266678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a00d24b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5980097a0 tx=0x7fc59802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d63309e008da9f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.109+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598030610 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.109+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598030770 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc59ffff640 1 -- 172.21.15.62:0/2511266678 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598030b00 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 -- 172.21.15.62:0/2511266678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 msgr2=0x7fc5a00d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 --2- 172.21.15.62:0/2511266678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a00d24b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5980097a0 tx=0x7fc59802b960 comp rx=0 tx=0).stop 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 -- 172.21.15.62:0/2511266678 shutdown_connections 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 --2- 172.21.15.62:0/2511266678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a00d24b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 -- 172.21.15.62:0/2511266678 >> 172.21.15.62:0/2511266678 conn(0x7fc5a00718a0 msgr2=0x7fc5a0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 -- 172.21.15.62:0/2511266678 shutdown_connections 2023-09-30T13:55:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.110+0000 7fc5a7894640 1 -- 172.21.15.62:0/2511266678 wait complete. 2023-09-30T13:55:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.111+0000 7fc5a7894640 1 Processor -- start 2023-09-30T13:55:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.111+0000 7fc5a7894640 1 -- start start 2023-09-30T13:55:26.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5a015cbc0 0x7fc5a01e6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01e5440 con 0x7fc5a00b8760 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01e62a0 con 0x7fc5a00cdfd0 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a7894640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01f6890 con 0x7fc5a015cbc0 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5630640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5630640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47184/0 (socket says 172.21.15.62:47184) 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5630640 1 -- 172.21.15.62:0/3352751838 learned_addr learned my addr 172.21.15.62:0/3352751838 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5e31640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5a015cbc0 0x7fc5a01e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a4e2f640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5630640 1 -- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5a015cbc0 msgr2=0x7fc5a01e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.112+0000 7fc5a5630640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5a015cbc0 0x7fc5a01e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a5630640 1 -- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 msgr2=0x7fc5a014b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a5630640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a014b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a5630640 1 -- 172.21.15.62:0/3352751838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598009400 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a5630640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c820 tx=0x7fc59000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590003da0 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590005070 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590005400 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a01e5690 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.113+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a01e5c50 con 0x7fc5a00b8760 2023-09-30T13:55:26.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.114+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a004e0d0 con 0x7fc5a00b8760 2023-09-30T13:55:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.114+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc590005560 con 0x7fc5a00b8760 2023-09-30T13:55:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.115+0000 7fc59dffb640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 0x7fc58c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.115+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc590088c50 con 0x7fc5a00b8760 2023-09-30T13:55:26.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.115+0000 7fc5a4e2f640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 0x7fc58c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.115+0000 7fc5a4e2f640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 0x7fc58c06cff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5a014ea90 tx=0x7fc594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.119+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc59008e020 con 0x7fc5a00b8760 2023-09-30T13:55:26.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.293+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5a01589f0 con 0x7fc5a00b8760 2023-09-30T13:55:26.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.293+0000 7fc59dffb640 1 -- 172.21.15.62:0/3352751838 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc590017070 con 0x7fc5a00b8760 2023-09-30T13:55:26.294 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 msgr2=0x7fc58c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 0x7fc58c06cff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5a014ea90 tx=0x7fc594009040 comp rx=0 tx=0).stop 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 msgr2=0x7fc5a01f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c820 tx=0x7fc59000cce0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 shutdown_connections 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc58c06ab30 0x7fc58c06cff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5a015cbc0 0x7fc5a01e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00cdfd0 0x7fc5a014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 --2- 172.21.15.62:0/3352751838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a00b8760 0x7fc5a01f6350 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 >> 172.21.15.62:0/3352751838 conn(0x7fc5a00718a0 msgr2=0x7fc5a00b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 shutdown_connections 2023-09-30T13:55:26.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.295+0000 7fc5a7894640 1 -- 172.21.15.62:0/3352751838 wait complete. 2023-09-30T13:55:26.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 Processor -- start 2023-09-30T13:55:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 -- start start 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92240b2160 0x7f92240b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f92240b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 0x7f922415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922415afa0 con 0x7f92240b2160 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240b0ef0 con 0x7f92240b4230 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.415+0000 7f92298f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922415b190 con 0x7f92240b0a70 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92240b2160 0x7f92240b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92240b2160 0x7f92240b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47190/0 (socket says 172.21.15.62:47190) 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 -- 172.21.15.62:0/1340627369 learned_addr learned my addr 172.21.15.62:0/1340627369 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f921bfff640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f92240b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f92237fe640 1 --2- 172.21.15.62:0/1340627369 >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 0x7f922415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 -- 172.21.15.62:0/1340627369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 msgr2=0x7f92240b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f92240b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 -- 172.21.15.62:0/1340627369 >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 msgr2=0x7f922415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1340627369 >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 0x7f922415e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f9222ffd640 1 -- 172.21.15.62:0/1340627369 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922415b470 con 0x7f92240b2160 2023-09-30T13:55:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.416+0000 7f92237fe640 1 --2- 172.21.15.62:0/1340627369 >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 0x7f922415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b2160 0x7f92240b0530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae2d0 tx=0x7f921402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8d43cc9689fabf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92227fc640 1 -- 172.21.15.62:0/1340627369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214031860 con 0x7f92240b2160 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92227fc640 1 -- 172.21.15.62:0/1340627369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92140319c0 con 0x7f92240b2160 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92227fc640 1 -- 172.21.15.62:0/1340627369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214031d50 con 0x7f92240b2160 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 -- 172.21.15.62:0/1340627369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b2160 msgr2=0x7f92240b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b2160 0x7f92240b0530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92240ae2d0 tx=0x7f921402b900 comp rx=0 tx=0).stop 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 -- 172.21.15.62:0/1340627369 shutdown_connections 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 --2- 172.21.15.62:0/1340627369 >> v2:172.21.15.135:3300/0 conn(0x7f92240b4230 0x7f922415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f92240b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 --2- 172.21.15.62:0/1340627369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b2160 0x7f92240b0530 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.417+0000 7f92298f2640 1 -- 172.21.15.62:0/1340627369 >> 172.21.15.62:0/1340627369 conn(0x7f92240cb720 msgr2=0x7f92240ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.418+0000 7f92298f2640 1 -- 172.21.15.62:0/1340627369 shutdown_connections 2023-09-30T13:55:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.418+0000 7f92298f2640 1 -- 172.21.15.62:0/1340627369 wait complete. 2023-09-30T13:55:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.419+0000 7f92298f2640 1 Processor -- start 2023-09-30T13:55:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.419+0000 7f92298f2640 1 -- start start 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.419+0000 7f92298f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f922413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.419+0000 7f92298f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92240b2160 0x7f92241f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.419+0000 7f92298f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92298f2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922413f3e0 con 0x7f92240b4230 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92298f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922413e570 con 0x7f92240b2160 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92298f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92241f10b0 con 0x7f92240b0a70 2023-09-30T13:55:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47196/0 (socket says 172.21.15.62:47196) 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 -- 172.21.15.62:0/1209232516 learned_addr learned my addr 172.21.15.62:0/1209232516 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f921bfff640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92240b2160 0x7f92241f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f922413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 -- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 msgr2=0x7f922413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f922413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 -- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92240b2160 msgr2=0x7f92241f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92240b2160 0x7f92241f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 -- 172.21.15.62:0/1209232516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140094d0 con 0x7f92240b4230 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92237fe640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f921c00cd80 tx=0x7f921c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00f680 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00f800 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922415a380 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00fbb0 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.420+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922413ea40 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.421+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922413f520 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.422+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f921c00b040 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.422+0000 7f9220ff9640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 0x7f920406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.422+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f921c089da0 con 0x7f92240b4230 2023-09-30T13:55:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.422+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 0x7f920406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.423+0000 7f9222ffd640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 0x7f920406cff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9214036000 tx=0x7f921403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.426+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f921c054e40 con 0x7f92240b4230 2023-09-30T13:55:26.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.607+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f922404e0d0 con 0x7f92240b4230 2023-09-30T13:55:26.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.608+0000 7f9220ff9640 1 -- 172.21.15.62:0/1209232516 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f921c058460 con 0x7f92240b4230 2023-09-30T13:55:26.608 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 msgr2=0x7f920406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 0x7f920406cff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9214036000 tx=0x7f921403c040 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 msgr2=0x7f9224159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f921c00cd80 tx=0x7f921c00a650 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 shutdown_connections 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f920406ab30 0x7f920406cff0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92240b4230 0x7f9224159e40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92240b2160 0x7f92241f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 --2- 172.21.15.62:0/1209232516 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92240b0a70 0x7f922413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 >> 172.21.15.62:0/1209232516 conn(0x7f92240cb720 msgr2=0x7f92240cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 shutdown_connections 2023-09-30T13:55:26.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.610+0000 7f92298f2640 1 -- 172.21.15.62:0/1209232516 wait complete. 2023-09-30T13:55:26.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.729+0000 7fd8ed35a640 1 Processor -- start 2023-09-30T13:55:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.729+0000 7fd8ed35a640 1 -- start start 2023-09-30T13:55:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8ed35a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8e80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8ed35a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80d0050 con 0x7fd8e80cd960 2023-09-30T13:55:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8ed35a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e806b500 con 0x7fd8e806b070 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8ed35a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cdd40 con 0x7fd8e806bf80 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd8e80cd960 0x7fd8e806b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52748/0 (socket says 172.21.15.62:52748) 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e6ffd640 1 -- 172.21.15.62:0/4253201140 learned_addr learned my addr 172.21.15.62:0/4253201140 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8e80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204239705 0 0) 0x7fd8e80d0050 con 0x7fd8e80cd960 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d4003520 con 0x7fd8e80cd960 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603165371 0 0) 0x7fd8e806b500 con 0x7fd8e806b070 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e80d0050 con 0x7fd8e806b070 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282684627 0 0) 0x7fd8d4003520 con 0x7fd8e80cd960 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 msgr2=0x7fd8e80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8e80b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.730+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 >> v1:172.21.15.135:6789/0 conn(0x7fd8e806b070 legacy=0x7fd8e80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80cf720 con 0x7fd8e80cd960 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd8e0001670 con 0x7fd8e80cd960 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8e80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 >> v1:172.21.15.62:6789/0 conn(0x7fd8e80cd960 legacy=0x7fd8e806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d4003b30 0x7fd8d4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d4004d00 0x7fd8d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400ba30 con 0x7fd8d4004d00 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400bb70 con 0x7fd8d4003b30 2023-09-30T13:55:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400bce0 con 0x7fd8e806bf80 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d4004d00 0x7fd8d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e6ffd640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d4003b30 0x7fd8d4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e67fc640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 -- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 msgr2=0x7fd8d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e806bf80 0x7fd8d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 -- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d4003b30 msgr2=0x7fd8d4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d4003b30 0x7fd8d4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.731+0000 7fd8e77fe640 1 -- 172.21.15.62:0/4253201140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009a70 con 0x7fd8d4004d00 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d4004d00 0x7fd8d4005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800e350 tx=0x7fd8d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41ed10575e195c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d802cd60 con 0x7fd8d4004d00 2023-09-30T13:55:26.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800f040 con 0x7fd8d4004d00 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8e5ffb640 1 -- 172.21.15.62:0/4253201140 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8034640 con 0x7fd8d4004d00 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8ed35a640 1 -- 172.21.15.62:0/4253201140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d4004d00 msgr2=0x7fd8d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/4253201140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8d4004d00 0x7fd8d4005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800e350 tx=0x7fd8d40057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8e77fe640 1 -- 172.21.15.62:0/4253201140 reap_dead start 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8ed35a640 1 -- 172.21.15.62:0/4253201140 shutdown_connections 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.732+0000 7fd8ed35a640 1 -- 172.21.15.62:0/4253201140 >> 172.21.15.62:0/4253201140 conn(0x7fd8e80d08e0 msgr2=0x7fd8e80d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.733+0000 7fd8ed35a640 1 -- 172.21.15.62:0/4253201140 shutdown_connections 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.733+0000 7fd8ed35a640 1 -- 172.21.15.62:0/4253201140 wait complete. 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.734+0000 7fd8ed35a640 1 Processor -- start 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.734+0000 7fd8ed35a640 1 -- start start 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 0x7fd8e80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 0x7fd8e80c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80c64a0 con 0x7fd8e814a970 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e814a7f0 con 0x7fd8e80ae730 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80b3960 con 0x7fd8e81f2ba0 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47208/0 (socket says 172.21.15.62:47208) 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 -- 172.21.15.62:0/989443150 learned_addr learned my addr 172.21.15.62:0/989443150 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 0x7fd8e80c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e6ffd640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 0x7fd8e80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 -- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 msgr2=0x7fd8e80c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 0x7fd8e80c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 -- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 msgr2=0x7fd8e80b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 0x7fd8e80b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 -- 172.21.15.62:0/989443150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80c5b00 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 0x7fd8e80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e6ffd640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 0x7fd8e80b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8e67fc640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000f7d0 tx=0x7fd8d000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000fe80 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d00052e0 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e80c5de0 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000d970 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.735+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e80aeb10 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.736+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e80c65e0 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.737+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd8d000dad0 con 0x7fd8e814a970 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.737+0000 7fd8df7fe640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 0x7fd8c806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.738+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8d0089480 con 0x7fd8e814a970 2023-09-30T13:55:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.738+0000 7fd8e6ffd640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 0x7fd8c806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.738+0000 7fd8e6ffd640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 0x7fd8c806d020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001eb0 tx=0x7fd8e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.742+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd8e80c65e0 con 0x7fd8e814a970 2023-09-30T13:55:26.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.915+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8e80c65e0 con 0x7fd8e814a970 2023-09-30T13:55:26.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.916+0000 7fd8df7fe640 1 -- 172.21.15.62:0/989443150 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8e80c65e0 con 0x7fd8e814a970 2023-09-30T13:55:26.917 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:26.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 msgr2=0x7fd8c806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 0x7fd8c806d020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001eb0 tx=0x7fd8e0009040 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 msgr2=0x7fd8e81f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000f7d0 tx=0x7fd8d000fc90 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 shutdown_connections 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd8c806ab60 0x7fd8c806d020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8e81f2ba0 0x7fd8e80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8e814a970 0x7fd8e81f2660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 --2- 172.21.15.62:0/989443150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8e80ae730 0x7fd8e80b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 >> 172.21.15.62:0/989443150 conn(0x7fd8e80d08e0 msgr2=0x7fd8e815f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 shutdown_connections 2023-09-30T13:55:26.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:26.918+0000 7fd8ed35a640 1 -- 172.21.15.62:0/989443150 wait complete. 2023-09-30T13:55:26.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:27.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.037+0000 7fe84117c640 1 Processor -- start 2023-09-30T13:55:27.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 -- start start 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe83c15ce90 0x7fe83c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe83c06b420 0x7fe83c06ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c06f680 con 0x7fe83c06f270 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0ce3f0 con 0x7fe83c15ce90 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe84117c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c06a120 con 0x7fe83c06b420 2023-09-30T13:55:27.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.038+0000 7fe83ad9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe83c15ce90 0x7fe83c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe83c15ce90 0x7fe83c06aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47212/0 (socket says 172.21.15.62:47212) 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 -- 172.21.15.62:0/4252204106 learned_addr learned my addr 172.21.15.62:0/4252204106 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83a59c640 1 --2- 172.21.15.62:0/4252204106 >> v2:172.21.15.135:3300/0 conn(0x7fe83c06b420 0x7fe83c06ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 -- 172.21.15.62:0/4252204106 >> v2:172.21.15.135:3300/0 conn(0x7fe83c06b420 msgr2=0x7fe83c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 --2- 172.21.15.62:0/4252204106 >> v2:172.21.15.135:3300/0 conn(0x7fe83c06b420 0x7fe83c06ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 -- 172.21.15.62:0/4252204106 >> v1:172.21.15.135:6789/0 conn(0x7fe83c06f270 legacy=0x7fe83c0ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.039+0000 7fe83ad9d640 1 -- 172.21.15.62:0/4252204106 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c06a400 con 0x7fe83c15ce90 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe83ad9d640 1 --2- 172.21.15.62:0/4252204106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c15ce90 0x7fe83c06aee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0cd1d0 tx=0x7fe82c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e080e7f55bf9243d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe839d9b640 1 -- 172.21.15.62:0/4252204106 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c031870 con 0x7fe83c15ce90 2023-09-30T13:55:27.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe839d9b640 1 -- 172.21.15.62:0/4252204106 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c0319d0 con 0x7fe83c15ce90 2023-09-30T13:55:27.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe839d9b640 1 -- 172.21.15.62:0/4252204106 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c031d60 con 0x7fe83c15ce90 2023-09-30T13:55:27.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 -- 172.21.15.62:0/4252204106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c15ce90 msgr2=0x7fe83c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 --2- 172.21.15.62:0/4252204106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c15ce90 0x7fe83c06aee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0cd1d0 tx=0x7fe82c02b910 comp rx=0 tx=0).stop 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 -- 172.21.15.62:0/4252204106 shutdown_connections 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 --2- 172.21.15.62:0/4252204106 >> v2:172.21.15.135:3300/0 conn(0x7fe83c06b420 0x7fe83c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 --2- 172.21.15.62:0/4252204106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c15ce90 0x7fe83c06aee0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 -- 172.21.15.62:0/4252204106 >> 172.21.15.62:0/4252204106 conn(0x7fe83c0cc180 msgr2=0x7fe83c0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 -- 172.21.15.62:0/4252204106 shutdown_connections 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.040+0000 7fe84117c640 1 -- 172.21.15.62:0/4252204106 wait complete. 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.042+0000 7fe84117c640 1 Processor -- start 2023-09-30T13:55:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.042+0000 7fe84117c640 1 -- start start 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c06f270 0x7fe83c0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe83c15ce90 0x7fe83c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c6ea0 con 0x7fe83c0c5940 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c7800 con 0x7fe83c15ce90 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1581d0 con 0x7fe83c06f270 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47214/0 (socket says 172.21.15.62:47214) 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 -- 172.21.15.62:0/2762431185 learned_addr learned my addr 172.21.15.62:0/2762431185 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83ad9d640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c06f270 0x7fe83c0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83a59c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe83c15ce90 0x7fe83c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 -- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c06f270 msgr2=0x7fe83c0c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c06f270 0x7fe83c0c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 -- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe83c15ce90 msgr2=0x7fe83c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe83c15ce90 0x7fe83c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 -- 172.21.15.62:0/2762431185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0094d0 con 0x7fe83c0c5940 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe83b59e640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c7b0 tx=0x7fe83400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834004b60 con 0x7fe83c0c5940 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834004cc0 con 0x7fe83c0c5940 2023-09-30T13:55:27.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c0c8b50 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.043+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400aa90 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.044+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c0c6ac0 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.045+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c0c6fe0 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.045+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe83400abf0 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.045+0000 7fe8237fe640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 0x7fe82806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.045+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8340894a0 con 0x7fe83c0c5940 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.046+0000 7fe83ad9d640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 0x7fe82806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.046+0000 7fe83ad9d640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 0x7fe82806cff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe82c036000 tx=0x7fe82c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.050+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe83c0c6fe0 con 0x7fe83c0c5940 2023-09-30T13:55:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.226+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe83c0c6fe0 con 0x7fe83c0c5940 2023-09-30T13:55:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.226+0000 7fe8237fe640 1 -- 172.21.15.62:0/2762431185 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe83c0c6fe0 con 0x7fe83c0c5940 2023-09-30T13:55:27.227 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 msgr2=0x7fe82806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 0x7fe82806cff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe82c036000 tx=0x7fe82c03c040 comp rx=0 tx=0).stop 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 msgr2=0x7fe83c0c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c7b0 tx=0x7fe83400cc70 comp rx=0 tx=0).stop 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 shutdown_connections 2023-09-30T13:55:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe82806ab30 0x7fe82806cff0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe83c0c5940 0x7fe83c0c8270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe83c15ce90 0x7fe83c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 --2- 172.21.15.62:0/2762431185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c06f270 0x7fe83c0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 >> 172.21.15.62:0/2762431185 conn(0x7fe83c0cc180 msgr2=0x7fe83c0afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 shutdown_connections 2023-09-30T13:55:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.228+0000 7fe84117c640 1 -- 172.21.15.62:0/2762431185 wait complete. 2023-09-30T13:55:27.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:27.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.347+0000 7fb63a094640 1 Processor -- start 2023-09-30T13:55:27.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.347+0000 7fb63a094640 1 -- start start 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb63a094640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63415a8c0 0x7fb63415d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb63a094640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb63406cb40 0x7fb634069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb63a094640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63406d0b0 con 0x7fb63406dcd0 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb63a094640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63406d390 con 0x7fb63406cb40 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb63a094640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406d670 con 0x7fb63415a8c0 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb63406cb40 0x7fb634069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb63406cb40 0x7fb634069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47222/0 (socket says 172.21.15.62:47222) 2023-09-30T13:55:27.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 -- 172.21.15.62:0/4150518188 learned_addr learned my addr 172.21.15.62:0/4150518188 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb6337fe640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63415a8c0 0x7fb63415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 -- 172.21.15.62:0/4150518188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63415a8c0 msgr2=0x7fb63415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63415a8c0 0x7fb63415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 -- 172.21.15.62:0/4150518188 >> v1:172.21.15.135:6789/0 conn(0x7fb63406dcd0 legacy=0x7fb6340ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.348+0000 7fb632ffd640 1 -- 172.21.15.62:0/4150518188 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63406d950 con 0x7fb63406cb40 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.349+0000 7fb632ffd640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63406cb40 0x7fb634069d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6539076f714be4ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.349+0000 7fb6327fc640 1 -- 172.21.15.62:0/4150518188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280317c0 con 0x7fb63406cb40 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.349+0000 7fb6327fc640 1 -- 172.21.15.62:0/4150518188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628031920 con 0x7fb63406cb40 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.349+0000 7fb6327fc640 1 -- 172.21.15.62:0/4150518188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628031cb0 con 0x7fb63406cb40 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 -- 172.21.15.62:0/4150518188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63406cb40 msgr2=0x7fb634069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63406cb40 0x7fb634069d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62802b860 comp rx=0 tx=0).stop 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 -- 172.21.15.62:0/4150518188 shutdown_connections 2023-09-30T13:55:27.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63406cb40 0x7fb634069d50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 --2- 172.21.15.62:0/4150518188 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63415a8c0 0x7fb63415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 -- 172.21.15.62:0/4150518188 >> 172.21.15.62:0/4150518188 conn(0x7fb6340b0b50 msgr2=0x7fb6340b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 -- 172.21.15.62:0/4150518188 shutdown_connections 2023-09-30T13:55:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.350+0000 7fb63a094640 1 -- 172.21.15.62:0/4150518188 wait complete. 2023-09-30T13:55:27.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.351+0000 7fb63a094640 1 Processor -- start 2023-09-30T13:55:27.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.351+0000 7fb63a094640 1 -- start start 2023-09-30T13:55:27.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 0x7fb63415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63406dcd0 0x7fb6341e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63415bfc0 con 0x7fb63415a8c0 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63415b6b0 con 0x7fb63406cb40 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb63a094640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63409f600 con 0x7fb63406dcd0 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47230/0 (socket says 172.21.15.62:47230) 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 -- 172.21.15.62:0/698891271 learned_addr learned my addr 172.21.15.62:0/698891271 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb632ffd640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63406dcd0 0x7fb6341e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb6337fe640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 0x7fb63415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 -- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63406dcd0 msgr2=0x7fb6341e7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63406dcd0 0x7fb6341e7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 -- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 msgr2=0x7fb63415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 0x7fb63415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 -- 172.21.15.62:0/698891271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280094d0 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb6337fe640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 0x7fb63415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.352+0000 7fb633fff640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c780 tx=0x7fb62c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.353+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c004b60 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.353+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00ce90 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.353+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63415b900 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.353+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00a850 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.353+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb634157c30 con 0x7fb63415a8c0 2023-09-30T13:55:27.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.354+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb634066f40 con 0x7fb63415a8c0 2023-09-30T13:55:27.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.354+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb62c00a9b0 con 0x7fb63415a8c0 2023-09-30T13:55:27.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.354+0000 7fb61bfff640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 0x7fb62006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.355+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb62c089610 con 0x7fb63415a8c0 2023-09-30T13:55:27.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.355+0000 7fb6337fe640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 0x7fb62006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.355+0000 7fb6337fe640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 0x7fb62006cff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb624006fd0 tx=0x7fb624008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.359+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb62c054600 con 0x7fb63415a8c0 2023-09-30T13:55:27.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.534+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb63415c100 con 0x7fb63415a8c0 2023-09-30T13:55:27.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.536+0000 7fb61bfff640 1 -- 172.21.15.62:0/698891271 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fb63415c100 con 0x7fb63415a8c0 2023-09-30T13:55:27.535 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:27.536 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:27.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 msgr2=0x7fb62006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 0x7fb62006cff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb624006fd0 tx=0x7fb624008040 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 msgr2=0x7fb6341576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c780 tx=0x7fb62c00cc40 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 shutdown_connections 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb62006ab30 0x7fb62006cff0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb63415a8c0 0x7fb6341576f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb63406dcd0 0x7fb6341e7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 --2- 172.21.15.62:0/698891271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb63406cb40 0x7fb63415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 >> 172.21.15.62:0/698891271 conn(0x7fb6340b0b50 msgr2=0x7fb6341606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 shutdown_connections 2023-09-30T13:55:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.538+0000 7fb63a094640 1 -- 172.21.15.62:0/698891271 wait complete. 2023-09-30T13:55:27.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:27.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:27.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.658+0000 7f301075a640 1 Processor -- start 2023-09-30T13:55:27.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.658+0000 7f301075a640 1 -- start start 2023-09-30T13:55:27.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f301075a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30080b0c40 0x7f30080b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f301075a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300815b190 con 0x7f30080b4230 2023-09-30T13:55:27.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f301075a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300815b470 con 0x7f30080b2160 2023-09-30T13:55:27.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f301075a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300815afa0 con 0x7f30080b0c40 2023-09-30T13:55:27.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f300dcf5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30080b0c40 0x7f30080b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f300dcf5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30080b0c40 0x7f30080b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58068/0 (socket says 172.21.15.62:58068) 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f300ecf7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30080b4230 0x7f3008070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33074/0 (socket says 172.21.15.62:33074) 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.659+0000 7f300dcf5640 1 -- 172.21.15.62:0/2556091629 learned_addr learned my addr 172.21.15.62:0/2556091629 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.660+0000 7f300dcf5640 1 -- 172.21.15.62:0/2556091629 >> v1:172.21.15.135:6789/0 conn(0x7f30080b2160 legacy=0x7f30080b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.660+0000 7f300dcf5640 1 -- 172.21.15.62:0/2556091629 >> v1:172.21.15.62:6789/0 conn(0x7f30080b4230 legacy=0x7f3008070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.660+0000 7f300dcf5640 1 -- 172.21.15.62:0/2556091629 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300815b750 con 0x7f30080b0c40 2023-09-30T13:55:27.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.660+0000 7f300d4f4640 1 -- 172.21.15.62:0/2556091629 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215755902 0 0) 0x7f300815b190 con 0x7f30080b4230 2023-09-30T13:55:27.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.660+0000 7f300dcf5640 1 --2- 172.21.15.62:0/2556091629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b0c40 0x7f30080b3cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca2937e187adab1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f300d4f4640 1 -- 172.21.15.62:0/2556091629 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8030860 con 0x7f30080b0c40 2023-09-30T13:55:27.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f300d4f4640 1 -- 172.21.15.62:0/2556091629 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80309c0 con 0x7f30080b0c40 2023-09-30T13:55:27.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f300d4f4640 1 -- 172.21.15.62:0/2556091629 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8030d50 con 0x7f30080b0c40 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 -- 172.21.15.62:0/2556091629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b0c40 msgr2=0x7f30080b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 --2- 172.21.15.62:0/2556091629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b0c40 0x7f30080b3cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 -- 172.21.15.62:0/2556091629 shutdown_connections 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 --2- 172.21.15.62:0/2556091629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b0c40 0x7f30080b3cf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 -- 172.21.15.62:0/2556091629 >> 172.21.15.62:0/2556091629 conn(0x7f30080cb720 msgr2=0x7f30080ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 -- 172.21.15.62:0/2556091629 shutdown_connections 2023-09-30T13:55:27.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.661+0000 7f301075a640 1 -- 172.21.15.62:0/2556091629 wait complete. 2023-09-30T13:55:27.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.662+0000 7f301075a640 1 Processor -- start 2023-09-30T13:55:27.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.662+0000 7f301075a640 1 -- start start 2023-09-30T13:55:27.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 0x7f30080a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 0x7f30080cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3008141550 con 0x7f30080b2160 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30081f0bb0 con 0x7f30080b0c40 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f301075a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080a78f0 con 0x7f30080b4230 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f300dcf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f300dcf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58070/0 (socket says 172.21.15.62:58070) 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f300dcf5640 1 -- 172.21.15.62:0/3486990267 learned_addr learned my addr 172.21.15.62:0/3486990267 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f300ecf7640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 0x7f30080cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.663+0000 7f300e4f6640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 0x7f30080a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 -- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 msgr2=0x7f30080cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 0x7f30080cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 -- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 msgr2=0x7f30080a83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 0x7f30080a83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 -- 172.21.15.62:0/3486990267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80094d0 con 0x7f30080b2160 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300ecf7640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 0x7f30080cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300e4f6640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 0x7f30080a83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f300dcf5640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8039d60 con 0x7f30080b2160 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8043400 con 0x7f30080b2160 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30080a7bd0 con 0x7f30080b2160 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80437b0 con 0x7f30080b2160 2023-09-30T13:55:27.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.664+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30080a8910 con 0x7f30080b2160 2023-09-30T13:55:27.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.665+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30080a80f0 con 0x7f30080b2160 2023-09-30T13:55:27.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.665+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2ff8043910 con 0x7f30080b2160 2023-09-30T13:55:27.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.666+0000 7f2ffeffd640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 0x7f2fec06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.666+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ff803e070 con 0x7f30080b2160 2023-09-30T13:55:27.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.666+0000 7f300e4f6640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 0x7f2fec06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.667+0000 7f300e4f6640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 0x7f2fec06cff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f300806d2f0 tx=0x7f3000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.670+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f30080a80f0 con 0x7f30080b2160 2023-09-30T13:55:27.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.844+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30080a80f0 con 0x7f30080b2160 2023-09-30T13:55:27.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.845+0000 7f2ffeffd640 1 -- 172.21.15.62:0/3486990267 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30080a80f0 con 0x7f30080b2160 2023-09-30T13:55:27.844 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:27.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 msgr2=0x7f2fec06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 0x7f2fec06cff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f300806d2f0 tx=0x7f3000009040 comp rx=0 tx=0).stop 2023-09-30T13:55:27.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 msgr2=0x7f30081409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff8004730 comp rx=0 tx=0).stop 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 shutdown_connections 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2fec06ab30 0x7f2fec06cff0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30080b4230 0x7f30080cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30080b2160 0x7f30081409a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 --2- 172.21.15.62:0/3486990267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30080b0c40 0x7f30080a83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.846+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 >> 172.21.15.62:0/3486990267 conn(0x7f30080cb720 msgr2=0x7f3008154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.847+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 shutdown_connections 2023-09-30T13:55:27.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.847+0000 7f301075a640 1 -- 172.21.15.62:0/3486990267 wait complete. 2023-09-30T13:55:27.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:27.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.966+0000 7fa0c9ec9640 1 Processor -- start 2023-09-30T13:55:27.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.966+0000 7fa0c9ec9640 1 -- start start 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c9ec9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0c406b070 0x7fa0c40b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c9ec9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40d0050 con 0x7fa0c40cd960 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c9ec9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c406b500 con 0x7fa0c406bf80 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c9ec9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40cdd40 con 0x7fa0c406b070 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c2ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0c406b070 0x7fa0c40b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c37fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa0c40cd960 0x7fa0c406b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33088/0 (socket says 172.21.15.62:33088) 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c37fe640 1 -- 172.21.15.62:0/211512304 learned_addr learned my addr 172.21.15.62:0/211512304 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/211512304 >> v1:172.21.15.135:6789/0 conn(0x7fa0c406bf80 legacy=0x7fa0c40b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/211512304 >> v1:172.21.15.62:6789/0 conn(0x7fa0c40cd960 legacy=0x7fa0c406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.967+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/211512304 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40cf720 con 0x7fa0c406b070 2023-09-30T13:55:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.968+0000 7fa0c2ffd640 1 --2- 172.21.15.62:0/211512304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c406b070 0x7fa0c40b04c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80097a0 tx=0x7fa0b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f2da89e60a8568 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.968+0000 7fa0c27fc640 1 -- 172.21.15.62:0/211512304 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031830 con 0x7fa0c406b070 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.968+0000 7fa0c27fc640 1 -- 172.21.15.62:0/211512304 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8031990 con 0x7fa0c406b070 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.968+0000 7fa0c27fc640 1 -- 172.21.15.62:0/211512304 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031d20 con 0x7fa0c406b070 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/211512304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c406b070 msgr2=0x7fa0c40b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/211512304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c406b070 0x7fa0c40b04c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80097a0 tx=0x7fa0b802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/211512304 shutdown_connections 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/211512304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c406b070 0x7fa0c40b04c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/211512304 >> 172.21.15.62:0/211512304 conn(0x7fa0c40d08e0 msgr2=0x7fa0c40d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/211512304 shutdown_connections 2023-09-30T13:55:27.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.969+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/211512304 wait complete. 2023-09-30T13:55:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.970+0000 7fa0c9ec9640 1 Processor -- start 2023-09-30T13:55:27.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.970+0000 7fa0c9ec9640 1 -- start start 2023-09-30T13:55:27.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c406bf80 0x7fa0c415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 0x7fa0c41577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c415c350 con 0x7fa0c40cd960 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c5310 con 0x7fa0c406bf80 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c9ec9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c55f0 con 0x7fa0c40c4d50 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58090/0 (socket says 172.21.15.62:58090) 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/216730868 learned_addr learned my addr 172.21.15.62:0/216730868 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c37fe640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c406bf80 0x7fa0c415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c3fff640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 0x7fa0c41577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 msgr2=0x7fa0c41577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 0x7fa0c41577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c406bf80 msgr2=0x7fa0c415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c406bf80 0x7fa0c415be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 -- 172.21.15.62:0/216730868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009400 con 0x7fa0c40cd960 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c3fff640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 0x7fa0c41577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.971+0000 7fa0c2ffd640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.972+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b803aa60 con 0x7fa0c40cd960 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.972+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b803abe0 con 0x7fa0c40cd960 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.972+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40c58d0 con 0x7fa0c40cd960 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.972+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80443f0 con 0x7fa0c40cd960 2023-09-30T13:55:27.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.972+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40c7470 con 0x7fa0c40cd960 2023-09-30T13:55:27.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.973+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c404e0d0 con 0x7fa0c40cd960 2023-09-30T13:55:27.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.973+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa0b804d450 con 0x7fa0c40cd960 2023-09-30T13:55:27.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.973+0000 7fa0abfff640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 0x7fa0b006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:27.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.974+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0b80ab670 con 0x7fa0c40cd960 2023-09-30T13:55:27.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.974+0000 7fa0c37fe640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 0x7fa0b006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:27.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.974+0000 7fa0c37fe640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 0x7fa0b006cff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4007fd0 tx=0x7fa0b4007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:27.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:27.978+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa0b8076660 con 0x7fa0c40cd960 2023-09-30T13:55:28.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.152+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0c40c7720 con 0x7fa0c40cd960 2023-09-30T13:55:28.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.152+0000 7fa0abfff640 1 -- 172.21.15.62:0/216730868 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0b8079c80 con 0x7fa0c40cd960 2023-09-30T13:55:28.152 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 msgr2=0x7fa0b006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 0x7fa0b006cff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4007fd0 tx=0x7fa0b4007e80 comp rx=0 tx=0).stop 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 msgr2=0x7fa0c40c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b80046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 shutdown_connections 2023-09-30T13:55:28.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa0b006ab30 0x7fa0b006cff0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0c40c4d50 0x7fa0c41577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c40cd960 0x7fa0c40c6f30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 --2- 172.21.15.62:0/216730868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c406bf80 0x7fa0c415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 >> 172.21.15.62:0/216730868 conn(0x7fa0c40d08e0 msgr2=0x7fa0c40adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 shutdown_connections 2023-09-30T13:55:28.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.154+0000 7fa0c9ec9640 1 -- 172.21.15.62:0/216730868 wait complete. 2023-09-30T13:55:28.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:28.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.274+0000 7fc54e9d5640 1 Processor -- start 2023-09-30T13:55:28.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.274+0000 7fc54e9d5640 1 -- start start 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54e9d5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 0x7fc5480b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54e9d5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 0x7fc5480b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54e9d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc548071170 con 0x7fc5480b4230 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54e9d5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54815afa0 con 0x7fc5480b0a70 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54e9d5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480b0ef0 con 0x7fc5480b2160 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54cf72640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc5480b4230 0x7fc54815e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33090/0 (socket says 172.21.15.62:33090) 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc54cf72640 1 -- 172.21.15.62:0/3031698463 learned_addr learned my addr 172.21.15.62:0/3031698463 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc547fff640 1 --2- 172.21.15.62:0/3031698463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 0x7fc5480b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc5477fe640 1 --2- 172.21.15.62:0/3031698463 >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 0x7fc5480b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717549055 0 0) 0x7fc540001490 con 0x7fc5480b4230 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc534003520 con 0x7fc5480b4230 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840768112 0 0) 0x7fc534003520 con 0x7fc5480b4230 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc547fff640 1 -- 172.21.15.62:0/3031698463 >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 msgr2=0x7fc5480b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc547fff640 1 --2- 172.21.15.62:0/3031698463 >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 0x7fc5480b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc547fff640 1 -- 172.21.15.62:0/3031698463 >> v1:172.21.15.62:6789/0 conn(0x7fc5480b4230 legacy=0x7fc54815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc547fff640 1 -- 172.21.15.62:0/3031698463 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54815b190 con 0x7fc5480b2160 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.275+0000 7fc5477fe640 1 --2- 172.21.15.62:0/3031698463 >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 0x7fc5480b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.276+0000 7fc547fff640 1 --2- 172.21.15.62:0/3031698463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 0x7fc5480b0530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5300097a0 tx=0x7fc53002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30798fcfb7bb7580 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.276+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540001b80 con 0x7fc5480b2160 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.276+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53002e050 con 0x7fc5480b2160 2023-09-30T13:55:28.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.276+0000 7fc546ffd640 1 -- 172.21.15.62:0/3031698463 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530030730 con 0x7fc5480b2160 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 -- 172.21.15.62:0/3031698463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 msgr2=0x7fc5480b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/3031698463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 0x7fc5480b0530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5300097a0 tx=0x7fc53002b790 comp rx=0 tx=0).stop 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 -- 172.21.15.62:0/3031698463 shutdown_connections 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/3031698463 >> v2:172.21.15.135:3300/0 conn(0x7fc5480b0a70 0x7fc5480b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/3031698463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b2160 0x7fc5480b0530 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 -- 172.21.15.62:0/3031698463 >> 172.21.15.62:0/3031698463 conn(0x7fc5480cb720 msgr2=0x7fc5480ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 -- 172.21.15.62:0/3031698463 shutdown_connections 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.277+0000 7fc54e9d5640 1 -- 172.21.15.62:0/3031698463 wait complete. 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.278+0000 7fc54e9d5640 1 Processor -- start 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.278+0000 7fc54e9d5640 1 -- start start 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b0a70 0x7fc5480a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5480b2160 0x7fc5481392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481f4180 con 0x7fc5480b4230 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481f4460 con 0x7fc5480b2160 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54e9d5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481f4740 con 0x7fc5480b0a70 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58106/0 (socket says 172.21.15.62:58106) 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 -- 172.21.15.62:0/1431267909 learned_addr learned my addr 172.21.15.62:0/1431267909 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc5477fe640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5480b2160 0x7fc5481392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc547fff640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b0a70 0x7fc5480a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 -- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b0a70 msgr2=0x7fc5480a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b0a70 0x7fc5480a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 -- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5480b2160 msgr2=0x7fc5481392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5480b2160 0x7fc5481392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.279+0000 7fc54cf72640 1 -- 172.21.15.62:0/1431267909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538009400 con 0x7fc5480b4230 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc54cf72640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc54000cc00 tx=0x7fc54000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000ce10 con 0x7fc5480b4230 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540012400 con 0x7fc5480b4230 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc530009400 con 0x7fc5480b4230 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400127b0 con 0x7fc5480b4230 2023-09-30T13:55:28.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.280+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5480ac250 con 0x7fc5480b4230 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.281+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5480abdd0 con 0x7fc5480b4230 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.281+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc540012910 con 0x7fc5480b4230 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.282+0000 7fc544ff9640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 0x7fc52806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.282+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc540089960 con 0x7fc5480b4230 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.282+0000 7fc547fff640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 0x7fc52806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.282+0000 7fc547fff640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 0x7fc52806cff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc530034000 tx=0x7fc53002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.286+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc5480abdd0 con 0x7fc5480b4230 2023-09-30T13:55:28.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.466+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc548071170 con 0x7fc5480b4230 2023-09-30T13:55:28.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.466+0000 7fc544ff9640 1 -- 172.21.15.62:0/1431267909 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc548071170 con 0x7fc5480b4230 2023-09-30T13:55:28.466 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.468+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 msgr2=0x7fc52806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.468+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 0x7fc52806cff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc530034000 tx=0x7fc53002f000 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.468+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 msgr2=0x7fc5481f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.468+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc54000cc00 tx=0x7fc54000a430 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 shutdown_connections 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc52806ab30 0x7fc52806cff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5480b4230 0x7fc5481f3880 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5480b2160 0x7fc5481392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 --2- 172.21.15.62:0/1431267909 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5480b0a70 0x7fc5480a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 >> 172.21.15.62:0/1431267909 conn(0x7fc5480cb720 msgr2=0x7fc5480cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 shutdown_connections 2023-09-30T13:55:28.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.469+0000 7fc54e9d5640 1 -- 172.21.15.62:0/1431267909 wait complete. 2023-09-30T13:55:28.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:28.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 Processor -- start 2023-09-30T13:55:28.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 -- start start 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 0x7fd5140b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140af960 con 0x7fd514159610 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51406c390 con 0x7fd5140b0e60 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.591+0000 7fd5195ee640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51406c670 con 0x7fd5141599f0 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd512ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd514159610 0x7fd5140af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33104/0 (socket says 172.21.15.62:33104) 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd512ffd640 1 -- 172.21.15.62:0/1955822328 learned_addr learned my addr 172.21.15.62:0/1955822328 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd5127fc640 1 --2- 172.21.15.62:0/1955822328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 0x7fd5140b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447391601 0 0) 0x7fd5140af960 con 0x7fd514159610 2023-09-30T13:55:28.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4fc003520 con 0x7fd514159610 2023-09-30T13:55:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682900651 0 0) 0x7fd51406c390 con 0x7fd5140b0e60 2023-09-30T13:55:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5140af960 con 0x7fd5140b0e60 2023-09-30T13:55:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd5127fc640 1 -- 172.21.15.62:0/1955822328 >> v1:172.21.15.135:6789/0 conn(0x7fd5140b0e60 legacy=0x7fd5140b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd5127fc640 1 -- 172.21.15.62:0/1955822328 >> v1:172.21.15.62:6789/0 conn(0x7fd514159610 legacy=0x7fd5140af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.592+0000 7fd5127fc640 1 -- 172.21.15.62:0/1955822328 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51406c950 con 0x7fd5141599f0 2023-09-30T13:55:28.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.594+0000 7fd5127fc640 1 --2- 172.21.15.62:0/1955822328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 0x7fd5140b29a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5040097d0 tx=0x7fd50402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc37b89f8ba051b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504031800 con 0x7fd5141599f0 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504031960 con 0x7fd5141599f0 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd511ffb640 1 -- 172.21.15.62:0/1955822328 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504031cf0 con 0x7fd5141599f0 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 -- 172.21.15.62:0/1955822328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 msgr2=0x7fd5140b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 --2- 172.21.15.62:0/1955822328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 0x7fd5140b29a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5040097d0 tx=0x7fd50402b8a0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 -- 172.21.15.62:0/1955822328 shutdown_connections 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 --2- 172.21.15.62:0/1955822328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5141599f0 0x7fd5140b29a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 -- 172.21.15.62:0/1955822328 >> 172.21.15.62:0/1955822328 conn(0x7fd5140cb720 msgr2=0x7fd5140ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 -- 172.21.15.62:0/1955822328 shutdown_connections 2023-09-30T13:55:28.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.595+0000 7fd5195ee640 1 -- 172.21.15.62:0/1955822328 wait complete. 2023-09-30T13:55:28.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 Processor -- start 2023-09-30T13:55:28.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 -- start start 2023-09-30T13:55:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd514159610 0x7fd5141f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5141599f0 0x7fd51415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51415ad50 con 0x7fd5140b0e60 2023-09-30T13:55:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141f3370 con 0x7fd5141599f0 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd5195ee640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51415b1e0 con 0x7fd514159610 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd512ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd512ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58120/0 (socket says 172.21.15.62:58120) 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.597+0000 7fd512ffd640 1 -- 172.21.15.62:0/4279980902 learned_addr learned my addr 172.21.15.62:0/4279980902 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd5127fc640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd514159610 0x7fd5141f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd5137fe640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5141599f0 0x7fd51415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 -- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd514159610 msgr2=0x7fd5141f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd514159610 0x7fd5141f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 -- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5141599f0 msgr2=0x7fd51415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5141599f0 0x7fd51415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 -- 172.21.15.62:0/4279980902 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009400 con 0x7fd5140b0e60 2023-09-30T13:55:28.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd512ffd640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd50800c530 tx=0x7fd50800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508005ce0 con 0x7fd5140b0e60 2023-09-30T13:55:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508005e40 con 0x7fd5140b0e60 2023-09-30T13:55:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51415a140 con 0x7fd5140b0e60 2023-09-30T13:55:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508007270 con 0x7fd5140b0e60 2023-09-30T13:55:28.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.598+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51415a700 con 0x7fd5140b0e60 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.599+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514158e50 con 0x7fd5140b0e60 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.600+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd5080073d0 con 0x7fd5140b0e60 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.600+0000 7fd4fb7fe640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 0x7fd50006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.600+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd508088a50 con 0x7fd5140b0e60 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.600+0000 7fd5127fc640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 0x7fd50006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.601+0000 7fd5127fc640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 0x7fd50006cff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd504036000 tx=0x7fd50403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.604+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd508053a60 con 0x7fd5140b0e60 2023-09-30T13:55:28.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.780+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd51404e0d0 con 0x7fd5140b0e60 2023-09-30T13:55:28.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.780+0000 7fd4fb7fe640 1 -- 172.21.15.62:0/4279980902 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd508017020 con 0x7fd5140b0e60 2023-09-30T13:55:28.780 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 msgr2=0x7fd50006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 0x7fd50006cff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd504036000 tx=0x7fd50403c040 comp rx=0 tx=0).stop 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 msgr2=0x7fd51414f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd50800c530 tx=0x7fd50800c9f0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 shutdown_connections 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd50006ab30 0x7fd50006cff0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5141599f0 0x7fd51415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd514159610 0x7fd5141f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 --2- 172.21.15.62:0/4279980902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5140b0e60 0x7fd51414f3d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 >> 172.21.15.62:0/4279980902 conn(0x7fd5140cb720 msgr2=0x7fd514154420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 shutdown_connections 2023-09-30T13:55:28.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.782+0000 7fd5195ee640 1 -- 172.21.15.62:0/4279980902 wait complete. 2023-09-30T13:55:28.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:28.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.899+0000 7f294584b640 1 Processor -- start 2023-09-30T13:55:28.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.899+0000 7f294584b640 1 -- start start 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f294584b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f294015cbb0 0x7f294006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f294584b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400cb810 con 0x7f294006b070 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f294584b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400cccb0 con 0x7f29400d1410 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f294584b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294006c230 con 0x7f294015cbb0 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f293e7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f294006b070 0x7f294006bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33114/0 (socket says 172.21.15.62:33114) 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f293e7fc640 1 -- 172.21.15.62:0/2390189090 learned_addr learned my addr 172.21.15.62:0/2390189090 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f293effd640 1 --2- 172.21.15.62:0/2390189090 >> v2:172.21.15.135:3300/0 conn(0x7f294015cbb0 0x7f294006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f293dffb640 1 -- 172.21.15.62:0/2390189090 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941046883 0 0) 0x7f29400cb810 con 0x7f294006b070 2023-09-30T13:55:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.900+0000 7f293dffb640 1 -- 172.21.15.62:0/2390189090 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c003520 con 0x7f294006b070 2023-09-30T13:55:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.901+0000 7f293effd640 1 -- 172.21.15.62:0/2390189090 >> v1:172.21.15.135:6789/0 conn(0x7f29400d1410 legacy=0x7f29400af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.901+0000 7f293effd640 1 -- 172.21.15.62:0/2390189090 >> v1:172.21.15.62:6789/0 conn(0x7f294006b070 legacy=0x7f294006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.901+0000 7f293effd640 1 -- 172.21.15.62:0/2390189090 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400caee0 con 0x7f294015cbb0 2023-09-30T13:55:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.901+0000 7f293effd640 1 --2- 172.21.15.62:0/2390189090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f294006b5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29380097a0 tx=0x7f293802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6d7c33c838591f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f293dffb640 1 -- 172.21.15.62:0/2390189090 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938030610 con 0x7f294015cbb0 2023-09-30T13:55:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f293dffb640 1 -- 172.21.15.62:0/2390189090 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938030770 con 0x7f294015cbb0 2023-09-30T13:55:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f293dffb640 1 -- 172.21.15.62:0/2390189090 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938030ae0 con 0x7f294015cbb0 2023-09-30T13:55:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 -- 172.21.15.62:0/2390189090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 msgr2=0x7f294006b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 --2- 172.21.15.62:0/2390189090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f294006b5e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29380097a0 tx=0x7f293802b960 comp rx=0 tx=0).stop 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 -- 172.21.15.62:0/2390189090 shutdown_connections 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 --2- 172.21.15.62:0/2390189090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f294006b5e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 -- 172.21.15.62:0/2390189090 >> 172.21.15.62:0/2390189090 conn(0x7f2940089fe0 msgr2=0x7f29400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 -- 172.21.15.62:0/2390189090 shutdown_connections 2023-09-30T13:55:28.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.902+0000 7f294584b640 1 -- 172.21.15.62:0/2390189090 wait complete. 2023-09-30T13:55:28.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.903+0000 7f294584b640 1 Processor -- start 2023-09-30T13:55:28.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.903+0000 7f294584b640 1 -- start start 2023-09-30T13:55:28.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f294006b070 0x7f29400c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f29401f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400c5310 con 0x7f29400d1410 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400cf2e0 con 0x7f294015cbb0 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f294584b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400c6110 con 0x7f294006b070 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f293e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f293e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58126/0 (socket says 172.21.15.62:58126) 2023-09-30T13:55:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f293e7fc640 1 -- 172.21.15.62:0/2506684690 learned_addr learned my addr 172.21.15.62:0/2506684690 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.904+0000 7f293f7fe640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f29401f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293effd640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f294006b070 0x7f29400c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 -- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f294006b070 msgr2=0x7f29400c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f294006b070 0x7f29400c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 -- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 msgr2=0x7f29401f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f29401f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 -- 172.21.15.62:0/2506684690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2938009400 con 0x7f29400d1410 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293f7fe640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f29401f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f293e7fc640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f292800c440 tx=0x7f292800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928005ce0 con 0x7f29400d1410 2023-09-30T13:55:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928005e40 con 0x7f29400d1410 2023-09-30T13:55:28.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29400c5500 con 0x7f29400d1410 2023-09-30T13:55:28.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280072b0 con 0x7f29400d1410 2023-09-30T13:55:28.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.905+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29400c5ac0 con 0x7f29400d1410 2023-09-30T13:55:28.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.906+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294006e2a0 con 0x7f29400d1410 2023-09-30T13:55:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.906+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2928007410 con 0x7f29400d1410 2023-09-30T13:55:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.907+0000 7f2937fff640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 0x7f292006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.907+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2928088a80 con 0x7f29400d1410 2023-09-30T13:55:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.907+0000 7f293effd640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 0x7f292006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:28.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.907+0000 7f293effd640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 0x7f292006cff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2938036000 tx=0x7f293803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:28.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:28.911+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2928053aa0 con 0x7f29400d1410 2023-09-30T13:55:29.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.086+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f294004e0d0 con 0x7f29400d1410 2023-09-30T13:55:29.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.088+0000 7f2937fff640 1 -- 172.21.15.62:0/2506684690 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2928017020 con 0x7f29400d1410 2023-09-30T13:55:29.087 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:29.087 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:54:54.816674+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:29.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.089+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 msgr2=0x7f292006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.089+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 0x7f292006cff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2938036000 tx=0x7f293803b040 comp rx=0 tx=0).stop 2023-09-30T13:55:29.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.089+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 msgr2=0x7f29401f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.089+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f292800c440 tx=0x7f292800c900 comp rx=0 tx=0).stop 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 shutdown_connections 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f292006ab30 0x7f292006cff0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f294015cbb0 0x7f29401f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29400d1410 0x7f29401f2040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 --2- 172.21.15.62:0/2506684690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f294006b070 0x7f29400c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 >> 172.21.15.62:0/2506684690 conn(0x7f2940089fe0 msgr2=0x7f29400d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 shutdown_connections 2023-09-30T13:55:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.090+0000 7f294584b640 1 -- 172.21.15.62:0/2506684690 wait complete. 2023-09-30T13:55:29.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:29.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:29.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.210+0000 7f664e8de640 1 Processor -- start 2023-09-30T13:55:29.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.210+0000 7f664e8de640 1 -- start start 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f664e8de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66480b0c40 0x7f66480b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f664e8de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664815b290 con 0x7f66480b2030 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f664e8de640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664815b570 con 0x7f66480b3fe0 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f664e8de640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664815bc30 con 0x7f66480b0c40 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f66477fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66480b0c40 0x7f66480b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f6647fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f66480b2030 0x7f66480b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33122/0 (socket says 172.21.15.62:33122) 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f6647fff640 1 -- 172.21.15.62:0/1962814110 learned_addr learned my addr 172.21.15.62:0/1962814110 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f66477fe640 1 -- 172.21.15.62:0/1962814110 >> v1:172.21.15.135:6789/0 conn(0x7f66480b3fe0 legacy=0x7f6648070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f66477fe640 1 -- 172.21.15.62:0/1962814110 >> v1:172.21.15.62:6789/0 conn(0x7f66480b2030 legacy=0x7f66480b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f66477fe640 1 -- 172.21.15.62:0/1962814110 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664815b850 con 0x7f66480b0c40 2023-09-30T13:55:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.211+0000 7f6646ffd640 1 -- 172.21.15.62:0/1962814110 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115416340 0 0) 0x7f664815b290 con 0x7f66480b2030 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.212+0000 7f66477fe640 1 --2- 172.21.15.62:0/1962814110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b0c40 0x7f66480b3aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66380097a0 tx=0x7f663802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cf1817fd33a31f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.212+0000 7f6646ffd640 1 -- 172.21.15.62:0/1962814110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638031830 con 0x7f66480b0c40 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.212+0000 7f6646ffd640 1 -- 172.21.15.62:0/1962814110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638031990 con 0x7f66480b0c40 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.212+0000 7f6646ffd640 1 -- 172.21.15.62:0/1962814110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638031d20 con 0x7f66480b0c40 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 -- 172.21.15.62:0/1962814110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b0c40 msgr2=0x7f66480b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 --2- 172.21.15.62:0/1962814110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b0c40 0x7f66480b3aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66380097a0 tx=0x7f663802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 -- 172.21.15.62:0/1962814110 shutdown_connections 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 --2- 172.21.15.62:0/1962814110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b0c40 0x7f66480b3aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 -- 172.21.15.62:0/1962814110 >> 172.21.15.62:0/1962814110 conn(0x7f66480cb720 msgr2=0x7f66480ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 -- 172.21.15.62:0/1962814110 shutdown_connections 2023-09-30T13:55:29.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.213+0000 7f664e8de640 1 -- 172.21.15.62:0/1962814110 wait complete. 2023-09-30T13:55:29.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.214+0000 7f664e8de640 1 Processor -- start 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.214+0000 7f664e8de640 1 -- start start 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 0x7f66481f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66480b2030 0x7f66481541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480aecb0 con 0x7f66480b3fe0 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66480ab9f0 con 0x7f66480b2030 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664e8de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66481f3100 con 0x7f66480b0c40 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58140/0 (socket says 172.21.15.62:58140) 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 -- 172.21.15.62:0/1468554216 learned_addr learned my addr 172.21.15.62:0/1468554216 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f66477fe640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66480b2030 0x7f66481541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f6647fff640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 0x7f66481f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 -- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 msgr2=0x7f66481f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 0x7f66481f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 -- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66480b2030 msgr2=0x7f66481541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66480b2030 0x7f66481541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f664ce7b640 1 -- 172.21.15.62:0/1468554216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009400 con 0x7f66480b3fe0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.215+0000 7f6647fff640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 0x7f66481f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f664ce7b640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f664000b970 tx=0x7f664000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000cb40 con 0x7f66480b3fe0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000cca0 con 0x7f66480b3fe0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66480aef00 con 0x7f66480b3fe0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640014680 con 0x7f66480b3fe0 2023-09-30T13:55:29.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.216+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66480abc90 con 0x7f66480b3fe0 2023-09-30T13:55:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.217+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66480abe80 con 0x7f66480b3fe0 2023-09-30T13:55:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.217+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f664001d3b0 con 0x7f66480b3fe0 2023-09-30T13:55:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.218+0000 7f6644ff9640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 0x7f663406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.218+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66400891f0 con 0x7f66480b3fe0 2023-09-30T13:55:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.218+0000 7f6647fff640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 0x7f663406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.218+0000 7f6647fff640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 0x7f663406d020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f663c000f60 tx=0x7f663c007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.222+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6640054290 con 0x7f66480b3fe0 2023-09-30T13:55:29.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.399+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f664815af20 con 0x7f66480b3fe0 2023-09-30T13:55:29.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.400+0000 7f6644ff9640 1 -- 172.21.15.62:0/1468554216 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66400578b0 con 0x7f66480b3fe0 2023-09-30T13:55:29.400 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 msgr2=0x7f663406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 0x7f663406d020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f663c000f60 tx=0x7f663c007c10 comp rx=0 tx=0).stop 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 msgr2=0x7f66480ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f664000b970 tx=0x7f664000be30 comp rx=0 tx=0).stop 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 shutdown_connections 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f663406ab60 0x7f663406d020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66480b3fe0 0x7f66480ac1b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66480b2030 0x7f66481541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 --2- 172.21.15.62:0/1468554216 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66480b0c40 0x7f66481f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 >> 172.21.15.62:0/1468554216 conn(0x7f66480cb720 msgr2=0x7f664815c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 shutdown_connections 2023-09-30T13:55:29.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.402+0000 7f664e8de640 1 -- 172.21.15.62:0/1468554216 wait complete. 2023-09-30T13:55:29.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.522+0000 7fd71e8bb640 1 Processor -- start 2023-09-30T13:55:29.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.522+0000 7fd71e8bb640 1 -- start start 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd71806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd7180cca40 0x7fd7180b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7180b2240 0x7fd7180cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180cdb30 con 0x7fd7180b2240 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180ccf20 con 0x7fd7180cca40 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71e8bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180cd200 con 0x7fd71815dc60 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7180b2240 0x7fd7180cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd7180b2240 0x7fd7180cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58154/0 (socket says 172.21.15.62:58154) 2023-09-30T13:55:29.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 -- 172.21.15.62:0/1139155910 learned_addr learned my addr 172.21.15.62:0/1139155910 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd717fff640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd71806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd7177fe640 1 --2- 172.21.15.62:0/1139155910 >> v2:172.21.15.135:3300/0 conn(0x7fd7180cca40 0x7fd7180b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 -- 172.21.15.62:0/1139155910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 msgr2=0x7fd71806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd71806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 -- 172.21.15.62:0/1139155910 >> v2:172.21.15.135:3300/0 conn(0x7fd7180cca40 msgr2=0x7fd7180b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 --2- 172.21.15.62:0/1139155910 >> v2:172.21.15.135:3300/0 conn(0x7fd7180cca40 0x7fd7180b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.523+0000 7fd71ce58640 1 -- 172.21.15.62:0/1139155910 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180cd4e0 con 0x7fd7180b2240 2023-09-30T13:55:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd71ce58640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180cdfc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd7180cb6d0 tx=0x7fd71002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ce5a7caff78bf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd716ffd640 1 -- 172.21.15.62:0/1139155910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71002c9e0 con 0x7fd7180b2240 2023-09-30T13:55:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd716ffd640 1 -- 172.21.15.62:0/1139155910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71002cb40 con 0x7fd7180b2240 2023-09-30T13:55:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd716ffd640 1 -- 172.21.15.62:0/1139155910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100343f0 con 0x7fd7180b2240 2023-09-30T13:55:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd71e8bb640 1 -- 172.21.15.62:0/1139155910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 msgr2=0x7fd7180cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.524+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180cdfc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd7180cb6d0 tx=0x7fd71002be40 comp rx=0 tx=0).stop 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 -- 172.21.15.62:0/1139155910 shutdown_connections 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180cdfc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/1139155910 >> v2:172.21.15.135:3300/0 conn(0x7fd7180cca40 0x7fd7180b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/1139155910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd71806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 -- 172.21.15.62:0/1139155910 >> 172.21.15.62:0/1139155910 conn(0x7fd718070970 msgr2=0x7fd718070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 -- 172.21.15.62:0/1139155910 shutdown_connections 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.525+0000 7fd71e8bb640 1 -- 172.21.15.62:0/1139155910 wait complete. 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.526+0000 7fd71e8bb640 1 Processor -- start 2023-09-30T13:55:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.526+0000 7fd71e8bb640 1 -- start start 2023-09-30T13:55:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7180cca40 0x7fd7180afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd7181f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c9a30 con 0x7fd7180b2240 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c9d10 con 0x7fd7180cca40 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c9ff0 con 0x7fd71815dc60 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58170/0 (socket says 172.21.15.62:58170) 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 -- 172.21.15.62:0/3924422783 learned_addr learned my addr 172.21.15.62:0/3924422783 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 -- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 msgr2=0x7fd7181f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd7181f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 -- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7180cca40 msgr2=0x7fd7180afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7180cca40 0x7fd7180afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 -- 172.21.15.62:0/3924422783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009b30 con 0x7fd7180b2240 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd717fff640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d800 tx=0x7fd70800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70800b6c0 con 0x7fd7180b2240 2023-09-30T13:55:29.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800b820 con 0x7fd7180b2240 2023-09-30T13:55:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7180ca2d0 con 0x7fd7180b2240 2023-09-30T13:55:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70800bbb0 con 0x7fd7180b2240 2023-09-30T13:55:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.527+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7180ac900 con 0x7fd7180b2240 2023-09-30T13:55:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.528+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180666d0 con 0x7fd7180b2240 2023-09-30T13:55:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.529+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd70800bd10 con 0x7fd7180b2240 2023-09-30T13:55:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.529+0000 7fd714ff9640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 0x7fd70406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.529+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd708089a30 con 0x7fd7180b2240 2023-09-30T13:55:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.530+0000 7fd7177fe640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 0x7fd70406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.530+0000 7fd7177fe640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 0x7fd70406cff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7180b2040 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.533+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd708054990 con 0x7fd7180b2240 2023-09-30T13:55:29.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.709+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd71804e0d0 con 0x7fd7180b2240 2023-09-30T13:55:29.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.710+0000 7fd714ff9640 1 -- 172.21.15.62:0/3924422783 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd708057fb0 con 0x7fd7180b2240 2023-09-30T13:55:29.709 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 msgr2=0x7fd70406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 0x7fd70406cff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7180b2040 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 msgr2=0x7fd7180ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d800 tx=0x7fd70800dcc0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 shutdown_connections 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd70406ab30 0x7fd70406cff0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd71815dc60 0x7fd7181f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7180cca40 0x7fd7180afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 --2- 172.21.15.62:0/3924422783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd7180b2240 0x7fd7180ac3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 >> 172.21.15.62:0/3924422783 conn(0x7fd718070970 msgr2=0x7fd718069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 shutdown_connections 2023-09-30T13:55:29.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.712+0000 7fd71e8bb640 1 -- 172.21.15.62:0/3924422783 wait complete. 2023-09-30T13:55:29.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:29.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.831+0000 7f8902b41640 1 Processor -- start 2023-09-30T13:55:29.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 -- start start 2023-09-30T13:55:29.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 0x7f88fc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0d1410 con 0x7f88fc0b8760 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0ce290 con 0x7f88fc0cd8c0 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.832+0000 7f8902b41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0d16f0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89010de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 0x7f88fc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:60994/0 (socket says 172.21.15.62:60994) 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89010de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 0x7f88fc0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:42240/0 (socket says 172.21.15.62:42240) 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 -- 172.21.15.62:0/3819836143 learned_addr learned my addr 172.21.15.62:0/3819836143 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f88fbfff640 1 --1- 172.21.15.62:0/3819836143 >> v1:172.21.15.135:6789/0 conn(0x7f88fc0b8760 0x7f88fc0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:39784/0 (socket says 172.21.15.62:39784) 2023-09-30T13:55:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 -- 172.21.15.62:0/3819836143 >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 msgr2=0x7f88fc0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 --2- 172.21.15.62:0/3819836143 >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 0x7f88fc0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 -- 172.21.15.62:0/3819836143 >> v1:172.21.15.135:6789/0 conn(0x7f88fc0b8760 legacy=0x7f88fc0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.833+0000 7f89008dd640 1 -- 172.21.15.62:0/3819836143 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0d19d0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.834+0000 7f89008dd640 1 --2- 172.21.15.62:0/3819836143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009870 tx=0x7f88f002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e82da54c78e031d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.834+0000 7f88fb7fe640 1 -- 172.21.15.62:0/3819836143 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0030840 con 0x7f88fc15cbc0 2023-09-30T13:55:29.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.834+0000 7f88fb7fe640 1 -- 172.21.15.62:0/3819836143 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f00309a0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.834+0000 7f88fb7fe640 1 -- 172.21.15.62:0/3819836143 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0030d30 con 0x7f88fc15cbc0 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 -- 172.21.15.62:0/3819836143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 msgr2=0x7f88fc0d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 --2- 172.21.15.62:0/3819836143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009870 tx=0x7f88f002b980 comp rx=0 tx=0).stop 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 -- 172.21.15.62:0/3819836143 shutdown_connections 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 --2- 172.21.15.62:0/3819836143 >> v2:172.21.15.135:3300/0 conn(0x7f88fc0cd8c0 0x7f88fc0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 --2- 172.21.15.62:0/3819836143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc15cbc0 0x7f88fc0d24b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 -- 172.21.15.62:0/3819836143 >> 172.21.15.62:0/3819836143 conn(0x7f88fc0718a0 msgr2=0x7f88fc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 -- 172.21.15.62:0/3819836143 shutdown_connections 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.835+0000 7f8902b41640 1 -- 172.21.15.62:0/3819836143 wait complete. 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.836+0000 7f8902b41640 1 Processor -- start 2023-09-30T13:55:29.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.836+0000 7f8902b41640 1 -- start start 2023-09-30T13:55:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc0b8760 0x7f88fc151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 0x7f88fc15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc15e2f0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc15d6e0 con 0x7f88fc0cd8c0 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f8902b41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc15d9c0 con 0x7f88fc0b8760 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58182/0 (socket says 172.21.15.62:58182) 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 -- 172.21.15.62:0/541358032 learned_addr learned my addr 172.21.15.62:0/541358032 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f88fbfff640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 0x7f88fc15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89008dd640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc0b8760 0x7f88fc151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 -- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc0b8760 msgr2=0x7f88fc151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc0b8760 0x7f88fc151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 -- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 msgr2=0x7f88fc15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 0x7f88fc15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 -- 172.21.15.62:0/541358032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00094d0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f88fbfff640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 0x7f88fc15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f89010de640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88f400efc0 tx=0x7f88f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4014480 con 0x7f88fc15cbc0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.837+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400f040 con 0x7f88fc15cbc0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.838+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc15dca0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.838+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4014820 con 0x7f88fc15cbc0 2023-09-30T13:55:29.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.838+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc15d290 con 0x7f88fc15cbc0 2023-09-30T13:55:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.839+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc15d4b0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.839+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f88f4014980 con 0x7f88fc15cbc0 2023-09-30T13:55:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.839+0000 7f88f97fa640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 0x7f88e006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.840+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88f408a3d0 con 0x7f88fc15cbc0 2023-09-30T13:55:29.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.840+0000 7f89008dd640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 0x7f88e006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:29.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.840+0000 7f89008dd640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 0x7f88e006cff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88f0036000 tx=0x7f88f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:29.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:29.844+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f88f4055290 con 0x7f88fc15cbc0 2023-09-30T13:55:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.019+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88fc04e0d0 con 0x7f88fc15cbc0 2023-09-30T13:55:30.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.019+0000 7f88f97fa640 1 -- 172.21.15.62:0/541358032 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88f40588b0 con 0x7f88fc15cbc0 2023-09-30T13:55:30.019 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 msgr2=0x7f88e006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 0x7f88e006cff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88f0036000 tx=0x7f88f0008030 comp rx=0 tx=0).stop 2023-09-30T13:55:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 msgr2=0x7f88fc15adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88f400efc0 tx=0x7f88f400c490 comp rx=0 tx=0).stop 2023-09-30T13:55:30.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 shutdown_connections 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88e006ab30 0x7f88e006cff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc15cbc0 0x7f88fc15adc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88fc0cd8c0 0x7f88fc15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 --2- 172.21.15.62:0/541358032 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88fc0b8760 0x7f88fc151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 >> 172.21.15.62:0/541358032 conn(0x7f88fc0718a0 msgr2=0x7f88fc0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 shutdown_connections 2023-09-30T13:55:30.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.021+0000 7f8902b41640 1 -- 172.21.15.62:0/541358032 wait complete. 2023-09-30T13:55:30.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.141+0000 7f9c1e55a640 1 Processor -- start 2023-09-30T13:55:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.141+0000 7f9c1e55a640 1 -- start start 2023-09-30T13:55:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c1e55a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 0x7f9c18070060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c1e55a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c1815dd80 0x7f9c180705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c1e55a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1815d8f0 con 0x7f9c180ac520 2023-09-30T13:55:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c1e55a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1815d090 con 0x7f9c1815dd80 2023-09-30T13:55:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c1e55a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180ad0e0 con 0x7f9c18146420 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c1815dd80 0x7f9c180705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9c1815dd80 0x7f9c180705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58186/0 (socket says 172.21.15.62:58186) 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 -- 172.21.15.62:0/523654493 learned_addr learned my addr 172.21.15.62:0/523654493 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c17fff640 1 --2- 172.21.15.62:0/523654493 >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 0x7f9c18070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 -- 172.21.15.62:0/523654493 >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 msgr2=0x7f9c18070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 --2- 172.21.15.62:0/523654493 >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 0x7f9c18070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 -- 172.21.15.62:0/523654493 >> v1:172.21.15.135:6789/0 conn(0x7f9c180ac520 legacy=0x7f9c180ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c177fe640 1 -- 172.21.15.62:0/523654493 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180ad630 con 0x7f9c1815dd80 2023-09-30T13:55:30.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.142+0000 7f9c17fff640 1 --2- 172.21.15.62:0/523654493 >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 0x7f9c18070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.143+0000 7f9c177fe640 1 --2- 172.21.15.62:0/523654493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c180705a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c180cefb0 tx=0x7f9c0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ddeff645f3383b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.143+0000 7f9c16ffd640 1 -- 172.21.15.62:0/523654493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08031870 con 0x7f9c1815dd80 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.143+0000 7f9c16ffd640 1 -- 172.21.15.62:0/523654493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c080319d0 con 0x7f9c1815dd80 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.143+0000 7f9c16ffd640 1 -- 172.21.15.62:0/523654493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08031d60 con 0x7f9c1815dd80 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 -- 172.21.15.62:0/523654493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 msgr2=0x7f9c180705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/523654493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c180705a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c180cefb0 tx=0x7f9c0802b910 comp rx=0 tx=0).stop 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 -- 172.21.15.62:0/523654493 shutdown_connections 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/523654493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c180705a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/523654493 >> v2:172.21.15.135:3300/0 conn(0x7f9c18146420 0x7f9c18070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 -- 172.21.15.62:0/523654493 >> 172.21.15.62:0/523654493 conn(0x7f9c180cb720 msgr2=0x7f9c180ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 -- 172.21.15.62:0/523654493 shutdown_connections 2023-09-30T13:55:30.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.144+0000 7f9c1e55a640 1 -- 172.21.15.62:0/523654493 wait complete. 2023-09-30T13:55:30.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.145+0000 7f9c1e55a640 1 Processor -- start 2023-09-30T13:55:30.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.145+0000 7f9c1e55a640 1 -- start start 2023-09-30T13:55:30.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c180ac520 0x7f9c1815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 0x7f9c18132d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1815c7f0 con 0x7f9c1815dd80 2023-09-30T13:55:30.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18133620 con 0x7f9c18146420 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1e55a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18133900 con 0x7f9c180ac520 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58200/0 (socket says 172.21.15.62:58200) 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 -- 172.21.15.62:0/2537746177 learned_addr learned my addr 172.21.15.62:0/2537746177 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c17fff640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c180ac520 0x7f9c1815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c177fe640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 0x7f9c18132d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 -- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c180ac520 msgr2=0x7f9c1815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c180ac520 0x7f9c1815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 -- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 msgr2=0x7f9c18132d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 0x7f9c18132d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c1caf7640 1 -- 172.21.15.62:0/2537746177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080094d0 con 0x7f9c1815dd80 2023-09-30T13:55:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.146+0000 7f9c177fe640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 0x7f9c18132d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c1caf7640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000b970 tx=0x7f9c1000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000cb40 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000cca0 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10014680 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c18133be0 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.147+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c181341a0 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.148+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c18134390 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.148+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9c1001d3b0 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.149+0000 7f9c14ff9640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 0x7f9c0406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.149+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c100892d0 con 0x7f9c1815dd80 2023-09-30T13:55:30.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.149+0000 7f9c17fff640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 0x7f9c0406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.149+0000 7f9c17fff640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 0x7f9c0406cff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00a950 tx=0x7f9c0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.153+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9c100542c0 con 0x7f9c1815dd80 2023-09-30T13:55:30.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.326+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9c1804e0d0 con 0x7f9c1815dd80 2023-09-30T13:55:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.326+0000 7f9c14ff9640 1 -- 172.21.15.62:0/2537746177 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9c100578e0 con 0x7f9c1815dd80 2023-09-30T13:55:30.326 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 msgr2=0x7f9c0406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 0x7f9c0406cff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00a950 tx=0x7f9c0c008040 comp rx=0 tx=0).stop 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 msgr2=0x7f9c18131900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000b970 tx=0x7f9c1000be30 comp rx=0 tx=0).stop 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 shutdown_connections 2023-09-30T13:55:30.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9c0406ab30 0x7f9c0406cff0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c1815dd80 0x7f9c18131900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c18146420 0x7f9c18132d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 --2- 172.21.15.62:0/2537746177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9c180ac520 0x7f9c1815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 >> 172.21.15.62:0/2537746177 conn(0x7f9c180cb720 msgr2=0x7f9c181434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 shutdown_connections 2023-09-30T13:55:30.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.328+0000 7f9c1e55a640 1 -- 172.21.15.62:0/2537746177 wait complete. 2023-09-30T13:55:30.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:30.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.448+0000 7f4d09df0640 1 Processor -- start 2023-09-30T13:55:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.448+0000 7f4d09df0640 1 -- start start 2023-09-30T13:55:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.448+0000 7f4d09df0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d040cf140 0x7f4d040ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d09df0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d040b1e20 con 0x7f4d041598c0 2023-09-30T13:55:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d09df0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d040b1530 con 0x7f4d040c8c90 2023-09-30T13:55:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d09df0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040b17d0 con 0x7f4d040cf140 2023-09-30T13:55:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d037fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4d041598c0 0x7f4d040cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33126/0 (socket says 172.21.15.62:33126) 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d037fe640 1 -- 172.21.15.62:0/1248150359 learned_addr learned my addr 172.21.15.62:0/1248150359 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d02ffd640 1 --2- 172.21.15.62:0/1248150359 >> v2:172.21.15.135:3300/0 conn(0x7f4d040cf140 0x7f4d040ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242175063 0 0) 0x7f4d040b1e20 con 0x7f4d041598c0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec003520 con 0x7f4d041598c0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177997132 0 0) 0x7f4cec003520 con 0x7f4d041598c0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 >> v2:172.21.15.135:3300/0 conn(0x7f4d040cf140 msgr2=0x7f4d040ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 --2- 172.21.15.62:0/1248150359 >> v2:172.21.15.135:3300/0 conn(0x7f4d040cf140 0x7f4d040ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 >> v1:172.21.15.135:6789/0 conn(0x7f4d040c8c90 legacy=0x7f4d040c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040b1ab0 con 0x7f4d041598c0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f4cf40017f0 con 0x7f4d041598c0 2023-09-30T13:55:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 >> v1:172.21.15.62:6789/0 conn(0x7f4d041598c0 legacy=0x7f4d040cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 0x7f4cec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cec0047c0 0x7f4cec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec005180 0x7f4cec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040b17d0 con 0x7f4cec0039a0 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec00c050 con 0x7f4cec0047c0 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec00c210 con 0x7f4cec005180 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d037fe640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 0x7f4cec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.449+0000 7f4d02ffd640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cec0047c0 0x7f4cec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d03fff640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec005180 0x7f4cec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 -- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec005180 msgr2=0x7f4cec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec005180 0x7f4cec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 -- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cec0047c0 msgr2=0x7f4cec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cec0047c0 0x7f4cec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 -- 172.21.15.62:0/1248150359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec003520 con 0x7f4cec0039a0 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d03fff640 1 -- 172.21.15.62:0/1248150359 reap_dead start 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.450+0000 7f4d037fe640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 0x7f4cec003dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c190 tx=0x7f4cec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c4b0ca09553bed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4007270 con 0x7f4cec0039a0 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf40073f0 con 0x7f4cec0039a0 2023-09-30T13:55:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d027fc640 1 -- 172.21.15.62:0/1248150359 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf402c8a0 con 0x7f4cec0039a0 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 -- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 msgr2=0x7f4cec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 0x7f4cec003dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c190 tx=0x7f4cec0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 -- 172.21.15.62:0/1248150359 shutdown_connections 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 --2- 172.21.15.62:0/1248150359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cec0039a0 0x7f4cec003dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 -- 172.21.15.62:0/1248150359 >> 172.21.15.62:0/1248150359 conn(0x7f4d0406a170 msgr2=0x7f4d0406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 -- 172.21.15.62:0/1248150359 shutdown_connections 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.451+0000 7f4d09df0640 1 -- 172.21.15.62:0/1248150359 wait complete. 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.452+0000 7f4d09df0640 1 Processor -- start 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.452+0000 7f4d09df0640 1 -- start start 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 0x7f4d041535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 0x7f4d04071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0406d920 con 0x7f4d041e6270 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04153af0 con 0x7f4d0406c830 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d09df0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041e6c30 con 0x7f4cec0039a0 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d03fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d03fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58220/0 (socket says 172.21.15.62:58220) 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d03fff640 1 -- 172.21.15.62:0/724071800 learned_addr learned my addr 172.21.15.62:0/724071800 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d037fe640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 0x7f4d041535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.453+0000 7f4d02ffd640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 0x7f4d04071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 -- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 msgr2=0x7f4d041535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 0x7f4d041535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 -- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 msgr2=0x7f4d04071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 0x7f4d04071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 -- 172.21.15.62:0/724071800 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04071fa0 con 0x7f4d041e6270 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d02ffd640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 0x7f4d04071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d037fe640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 0x7f4d041535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d03fff640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4d040cf620 tx=0x7f4cfc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00eed0 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc003970 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc003d00 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0406cda0 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.454+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0406d360 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.455+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0404e0d0 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.455+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4cfc0050d0 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.456+0000 7f4cebfff640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 0x7f4cf006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.456+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4cfc089160 con 0x7f4d041e6270 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.456+0000 7f4d037fe640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 0x7f4cf006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.456+0000 7f4d037fe640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 0x7f4cf006d020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4034000 tx=0x7f4cf4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.460+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4cfc054150 con 0x7f4d041e6270 2023-09-30T13:55:30.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.642+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d040b3410 con 0x7f4d041e6270 2023-09-30T13:55:30.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.643+0000 7f4cebfff640 1 -- 172.21.15.62:0/724071800 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f4cfc003e60 con 0x7f4d041e6270 2023-09-30T13:55:30.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:30.644 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":25,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:30.569227+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 msgr2=0x7f4cf006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 0x7f4cf006d020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4034000 tx=0x7f4cf4009030 comp rx=0 tx=0).stop 2023-09-30T13:55:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 msgr2=0x7f4d041e66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4d040cf620 tx=0x7f4cfc00eb90 comp rx=0 tx=0).stop 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 shutdown_connections 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4cf006ab60 0x7f4cf006d020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d041e6270 0x7f4d041e66f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0406c830 0x7f4d04071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 --2- 172.21.15.62:0/724071800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cec0039a0 0x7f4d041535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 >> 172.21.15.62:0/724071800 conn(0x7f4d0406a170 msgr2=0x7f4d040cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.645+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 shutdown_connections 2023-09-30T13:55:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.646+0000 7f4d09df0640 1 -- 172.21.15.62:0/724071800 wait complete. 2023-09-30T13:55:30.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:30.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:30.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.765+0000 7fafe02af640 1 Processor -- start 2023-09-30T13:55:30.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.765+0000 7fafe02af640 1 -- start start 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafd815cd90 0x7fafd80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd81606e0 0x7fafd8160b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fafd80ca560 0x7fafd80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd8161080 con 0x7fafd815cd90 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80caf30 con 0x7fafd80ca560 2023-09-30T13:55:30.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafe02af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80cc700 con 0x7fafd81606e0 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafd815cd90 0x7fafd80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fafd815cd90 0x7fafd80cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58234/0 (socket says 172.21.15.62:58234) 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 -- 172.21.15.62:0/1085868111 learned_addr learned my addr 172.21.15.62:0/1085868111 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 -- 172.21.15.62:0/1085868111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd81606e0 msgr2=0x7fafd8160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 --2- 172.21.15.62:0/1085868111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd81606e0 0x7fafd8160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 -- 172.21.15.62:0/1085868111 >> v2:172.21.15.135:3300/0 conn(0x7fafd80ca560 msgr2=0x7fafd80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.766+0000 7fafde04b640 1 --2- 172.21.15.62:0/1085868111 >> v2:172.21.15.135:3300/0 conn(0x7fafd80ca560 0x7fafd80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.767+0000 7fafde04b640 1 -- 172.21.15.62:0/1085868111 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80cc9e0 con 0x7fafd815cd90 2023-09-30T13:55:30.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.767+0000 7fafde04b640 1 --2- 172.21.15.62:0/1085868111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd815cd90 0x7fafd80cd7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fafd80ae310 tx=0x7fafd002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e620d0ab5052978 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.767+0000 7fafdd049640 1 -- 172.21.15.62:0/1085868111 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0031870 con 0x7fafd815cd90 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.767+0000 7fafdd049640 1 -- 172.21.15.62:0/1085868111 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00319d0 con 0x7fafd815cd90 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.767+0000 7fafdd049640 1 -- 172.21.15.62:0/1085868111 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0031d60 con 0x7fafd815cd90 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 -- 172.21.15.62:0/1085868111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd815cd90 msgr2=0x7fafd80cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 --2- 172.21.15.62:0/1085868111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd815cd90 0x7fafd80cd7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fafd80ae310 tx=0x7fafd002b910 comp rx=0 tx=0).stop 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 -- 172.21.15.62:0/1085868111 shutdown_connections 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 --2- 172.21.15.62:0/1085868111 >> v2:172.21.15.135:3300/0 conn(0x7fafd80ca560 0x7fafd80ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 --2- 172.21.15.62:0/1085868111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd81606e0 0x7fafd8160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 --2- 172.21.15.62:0/1085868111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd815cd90 0x7fafd80cd7a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 -- 172.21.15.62:0/1085868111 >> 172.21.15.62:0/1085868111 conn(0x7fafd80cb4a0 msgr2=0x7fafd80cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 -- 172.21.15.62:0/1085868111 shutdown_connections 2023-09-30T13:55:30.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.768+0000 7fafe02af640 1 -- 172.21.15.62:0/1085868111 wait complete. 2023-09-30T13:55:30.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.769+0000 7fafe02af640 1 Processor -- start 2023-09-30T13:55:30.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.769+0000 7fafe02af640 1 -- start start 2023-09-30T13:55:30.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd80ca560 0x7fafd81f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd815cd90 0x7fafd806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80b2050 con 0x7fafd81606e0 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80b22a0 con 0x7fafd815cd90 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafe02af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81f2220 con 0x7fafd80ca560 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58238/0 (socket says 172.21.15.62:58238) 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 -- 172.21.15.62:0/1344123433 learned_addr learned my addr 172.21.15.62:0/1344123433 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde04b640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd80ca560 0x7fafd81f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafdd84a640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd815cd90 0x7fafd806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 -- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd80ca560 msgr2=0x7fafd81f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd80ca560 0x7fafd81f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 -- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd815cd90 msgr2=0x7fafd806e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd815cd90 0x7fafd806e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.770+0000 7fafde84c640 1 -- 172.21.15.62:0/1344123433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00094d0 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafde84c640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafc800b970 tx=0x7fafc800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800cb40 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc800ccc0 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd81f2500 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8014680 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.771+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd80b2580 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.772+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd80ae310 con 0x7fafd81606e0 2023-09-30T13:55:30.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.772+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fafc801d3b0 con 0x7fafd81606e0 2023-09-30T13:55:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.773+0000 7fafd6ffd640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 0x7fafc406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.773+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fafc8089580 con 0x7fafd81606e0 2023-09-30T13:55:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.773+0000 7fafde04b640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 0x7fafc406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.774+0000 7fafde04b640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 0x7fafc406cff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fafd0036000 tx=0x7fafd003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:30.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.777+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fafc8054410 con 0x7fafd81606e0 2023-09-30T13:55:30.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.950+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafd81f2a20 con 0x7fafd81606e0 2023-09-30T13:55:30.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.950+0000 7fafd6ffd640 1 -- 172.21.15.62:0/1344123433 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafd81f2a20 con 0x7fafd81606e0 2023-09-30T13:55:30.950 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 msgr2=0x7fafc406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 0x7fafc406cff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fafd0036000 tx=0x7fafd003c040 comp rx=0 tx=0).stop 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 msgr2=0x7fafd806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafc800b970 tx=0x7fafc800be30 comp rx=0 tx=0).stop 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 shutdown_connections 2023-09-30T13:55:30.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fafc406ab30 0x7fafc406cff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafd81606e0 0x7fafd806d900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd815cd90 0x7fafd806e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 --2- 172.21.15.62:0/1344123433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fafd80ca560 0x7fafd81f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 >> 172.21.15.62:0/1344123433 conn(0x7fafd80cb4a0 msgr2=0x7fafd8070490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 shutdown_connections 2023-09-30T13:55:30.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:30.952+0000 7fafe02af640 1 -- 172.21.15.62:0/1344123433 wait complete. 2023-09-30T13:55:30.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 Processor -- start 2023-09-30T13:55:31.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 -- start start 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c815ab50 0x7fd9c8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd9c80c9070 0x7fd9c80c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c806ce00 con 0x7fd9c80c3de0 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9850 con 0x7fd9c80c9070 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.072+0000 7fd9cec56640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c806d680 con 0x7fd9c815ab50 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9cd1f3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9c80c3de0 0x7fd9c806db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33134/0 (socket says 172.21.15.62:33134) 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9cd1f3640 1 -- 172.21.15.62:0/1805349038 learned_addr learned my addr 172.21.15.62:0/1805349038 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:31.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> v2:172.21.15.135:3300/0 conn(0x7fd9c80c9070 0x7fd9c80c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c815ab50 0x7fd9c8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596097165 0 0) 0x7fd9c806ce00 con 0x7fd9c80c3de0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b8003520 con 0x7fd9c80c3de0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131670377 0 0) 0x7fd9b8003520 con 0x7fd9c80c3de0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c815ab50 msgr2=0x7fd9c8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c815ab50 0x7fd9c8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 >> v2:172.21.15.135:3300/0 conn(0x7fd9c80c9070 msgr2=0x7fd9c80c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 --2- 172.21.15.62:0/1805349038 >> v2:172.21.15.135:3300/0 conn(0x7fd9c80c9070 0x7fd9c80c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80c9570 con 0x7fd9c80c3de0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd9c00019f0 con 0x7fd9c80c3de0 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> v2:172.21.15.135:3300/0 conn(0x7fd9c80c9070 0x7fd9c80c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:31.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 >> v1:172.21.15.62:6789/0 conn(0x7fd9c80c3de0 legacy=0x7fd9c806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b8003970 0x7fd9b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b8005180 0x7fd9b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9850 con 0x7fd9b80047c0 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c806d680 con 0x7fd9b8003970 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b800bec0 con 0x7fd9b8005180 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c815ab50 0x7fd9c8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.073+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b8003970 0x7fd9b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9cd1f3640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b8005180 0x7fd9b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 -- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b8005180 msgr2=0x7fd9b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b8005180 0x7fd9b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 -- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b8003970 msgr2=0x7fd9b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9b8003970 0x7fd9b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 -- 172.21.15.62:0/1805349038 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8003520 con 0x7fd9b80047c0 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9cd1f3640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9b8005180 0x7fd9b800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.074+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9b8004c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009cc0 tx=0x7fd9b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a27801445f6e680 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b402c960 con 0x7fd9b80047c0 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b402cac0 con 0x7fd9b80047c0 2023-09-30T13:55:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9c77fe640 1 -- 172.21.15.62:0/1805349038 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b402ce70 con 0x7fd9b80047c0 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 -- 172.21.15.62:0/1805349038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 msgr2=0x7fd9b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 --2- 172.21.15.62:0/1805349038 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9b8004c40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009cc0 tx=0x7fd9b80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cd1f3640 1 -- 172.21.15.62:0/1805349038 reap_dead start 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 -- 172.21.15.62:0/1805349038 shutdown_connections 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 -- 172.21.15.62:0/1805349038 >> 172.21.15.62:0/1805349038 conn(0x7fd9c80cb4a0 msgr2=0x7fd9c80cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 -- 172.21.15.62:0/1805349038 shutdown_connections 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.075+0000 7fd9cec56640 1 -- 172.21.15.62:0/1805349038 wait complete. 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.076+0000 7fd9cec56640 1 Processor -- start 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.076+0000 7fd9cec56640 1 -- start start 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 0x7fd9c80c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 0x7fd9c81553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8155930 con 0x7fd9b80047c0 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81549b0 con 0x7fd9c8154f60 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cec56640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80ab8c0 con 0x7fd9c80c5b60 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cc9f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cc9f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58246/0 (socket says 172.21.15.62:58246) 2023-09-30T13:55:31.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.077+0000 7fd9cc9f2640 1 -- 172.21.15.62:0/522366885 learned_addr learned my addr 172.21.15.62:0/522366885 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 0x7fd9c80c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 -- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 msgr2=0x7fd9c80c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cd1f3640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 0x7fd9c81553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 0x7fd9c80c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 -- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 msgr2=0x7fd9c81553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 0x7fd9c81553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 -- 172.21.15.62:0/522366885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80abb60 con 0x7fd9b80047c0 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 0x7fd9c80c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cd1f3640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 0x7fd9c81553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cc9f2640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0119d0 tx=0x7fd9bc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc00fc10 con 0x7fd9b80047c0 2023-09-30T13:55:31.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc00fd70 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c80abe40 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc00fee0 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.078+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c80ac400 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.079+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c804e0d0 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.080+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd9bc014640 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.080+0000 7fd9c57fa640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 0x7fd9ac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.080+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd9bc089e50 con 0x7fd9b80047c0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.080+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 0x7fd9ac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.081+0000 7fd9c7fff640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 0x7fd9ac06cff0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4036000 tx=0x7fd9b4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.084+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd9bc054ce0 con 0x7fd9b80047c0 2023-09-30T13:55:31.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.259+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9c80aead0 con 0x7fd9b80047c0 2023-09-30T13:55:31.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.259+0000 7fd9c57fa640 1 -- 172.21.15.62:0/522366885 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9bc0220a0 con 0x7fd9b80047c0 2023-09-30T13:55:31.259 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:31.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 msgr2=0x7fd9ac06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 0x7fd9ac06cff0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4036000 tx=0x7fd9b4030000 comp rx=0 tx=0).stop 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 msgr2=0x7fd9c8154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0119d0 tx=0x7fd9bc011e90 comp rx=0 tx=0).stop 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 shutdown_connections 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd9ac06ab30 0x7fd9ac06cff0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9c8154f60 0x7fd9c81553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9c80c5b60 0x7fd9c80c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 --2- 172.21.15.62:0/522366885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b80047c0 0x7fd9c8154470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 >> 172.21.15.62:0/522366885 conn(0x7fd9c80cb4a0 msgr2=0x7fd9c80ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.261+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 shutdown_connections 2023-09-30T13:55:31.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.262+0000 7fd9cec56640 1 -- 172.21.15.62:0/522366885 wait complete. 2023-09-30T13:55:31.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.382+0000 7f65dc189640 1 Processor -- start 2023-09-30T13:55:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.382+0000 7f65dc189640 1 -- start start 2023-09-30T13:55:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65dc189640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d415cbc0 0x7f65d40d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65dc189640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65d40b8760 0x7f65d40d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65dc189640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40d1410 con 0x7f65d40cd8c0 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65dc189640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40d16f0 con 0x7f65d415cbc0 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65dc189640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40d19d0 con 0x7f65d40b8760 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65d9f25640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d415cbc0 0x7f65d40d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65da726640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f65d40cd8c0 0x7f65d40b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33142/0 (socket says 172.21.15.62:33142) 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65da726640 1 -- 172.21.15.62:0/144290800 learned_addr learned my addr 172.21.15.62:0/144290800 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65d9f25640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d415cbc0 0x7f65d40d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58252/0 (socket says 172.21.15.62:58252) 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.383+0000 7f65d9724640 1 --2- 172.21.15.62:0/144290800 >> v2:172.21.15.135:3300/0 conn(0x7f65d40b8760 0x7f65d40d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d9f25640 1 -- 172.21.15.62:0/144290800 >> v2:172.21.15.135:3300/0 conn(0x7f65d40b8760 msgr2=0x7f65d40d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d9f25640 1 --2- 172.21.15.62:0/144290800 >> v2:172.21.15.135:3300/0 conn(0x7f65d40b8760 0x7f65d40d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d9f25640 1 -- 172.21.15.62:0/144290800 >> v1:172.21.15.62:6789/0 conn(0x7f65d40cd8c0 legacy=0x7f65d40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d9f25640 1 -- 172.21.15.62:0/144290800 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40d1cb0 con 0x7f65d415cbc0 2023-09-30T13:55:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d8f23640 1 -- 172.21.15.62:0/144290800 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344198078 0 0) 0x7f65d40d1410 con 0x7f65d40cd8c0 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.384+0000 7f65d9f25640 1 --2- 172.21.15.62:0/144290800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d40d24b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b56e0 tx=0x7f65cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9134dde408ac3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65d8f23640 1 -- 172.21.15.62:0/144290800 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc031830 con 0x7f65d415cbc0 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65d8f23640 1 -- 172.21.15.62:0/144290800 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc031990 con 0x7f65d415cbc0 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65d8f23640 1 -- 172.21.15.62:0/144290800 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc031d20 con 0x7f65d415cbc0 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 -- 172.21.15.62:0/144290800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 msgr2=0x7f65d40d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 --2- 172.21.15.62:0/144290800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d40d24b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b56e0 tx=0x7f65cc02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 -- 172.21.15.62:0/144290800 shutdown_connections 2023-09-30T13:55:31.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 --2- 172.21.15.62:0/144290800 >> v2:172.21.15.135:3300/0 conn(0x7f65d40b8760 0x7f65d40d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 --2- 172.21.15.62:0/144290800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d40d24b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 -- 172.21.15.62:0/144290800 >> 172.21.15.62:0/144290800 conn(0x7f65d40718a0 msgr2=0x7f65d4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 -- 172.21.15.62:0/144290800 shutdown_connections 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.385+0000 7f65dc189640 1 -- 172.21.15.62:0/144290800 wait complete. 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.386+0000 7f65dc189640 1 Processor -- start 2023-09-30T13:55:31.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.386+0000 7f65dc189640 1 -- start start 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 0x7f65d40cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 0x7f65d40cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40c94f0 con 0x7f65d415cbc0 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40cb7c0 con 0x7f65d40cd8c0 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65dc189640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40cba70 con 0x7f65d40b8760 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65da726640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65da726640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58268/0 (socket says 172.21.15.62:58268) 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.387+0000 7f65da726640 1 -- 172.21.15.62:0/2388260716 learned_addr learned my addr 172.21.15.62:0/2388260716 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d9f25640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 0x7f65d40cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d9724640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 0x7f65d40cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 -- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 msgr2=0x7f65d40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 0x7f65d40cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 -- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 msgr2=0x7f65d40cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 0x7f65d40cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 -- 172.21.15.62:0/2388260716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc009400 con 0x7f65d415cbc0 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d9f25640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 0x7f65d40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d9724640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 0x7f65d40cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:31.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65da726640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c7e0 tx=0x7f65c400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400a640 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400a7c0 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40cbd50 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c400ab70 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.388+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40cc310 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.389+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d404e0d0 con 0x7f65d415cbc0 2023-09-30T13:55:31.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.390+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f65c400acd0 con 0x7f65d415cbc0 2023-09-30T13:55:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.390+0000 7f65d27fc640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 0x7f65c006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.390+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65c4088dd0 con 0x7f65d415cbc0 2023-09-30T13:55:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.390+0000 7f65d9f25640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 0x7f65c006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.391+0000 7f65d9f25640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 0x7f65c006d020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65cc036000 tx=0x7f65cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.394+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f65c4053c60 con 0x7f65d415cbc0 2023-09-30T13:55:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.573+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65d40cd650 con 0x7f65d415cbc0 2023-09-30T13:55:31.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.574+0000 7f65d27fc640 1 -- 172.21.15.62:0/2388260716 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65c4018020 con 0x7f65d415cbc0 2023-09-30T13:55:31.573 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 msgr2=0x7f65c006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 0x7f65c006d020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65cc036000 tx=0x7f65cc008030 comp rx=0 tx=0).stop 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 msgr2=0x7f65d415f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c7e0 tx=0x7f65c400cca0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 shutdown_connections 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f65c006ab60 0x7f65c006d020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d415cbc0 0x7f65d415f020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65d40cd8c0 0x7f65d40cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 --2- 172.21.15.62:0/2388260716 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f65d40b8760 0x7f65d40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 >> 172.21.15.62:0/2388260716 conn(0x7f65d40718a0 msgr2=0x7f65d415bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 shutdown_connections 2023-09-30T13:55:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.576+0000 7f65dc189640 1 -- 172.21.15.62:0/2388260716 wait complete. 2023-09-30T13:55:31.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.698+0000 7f7fd5061640 1 Processor -- start 2023-09-30T13:55:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.698+0000 7f7fd5061640 1 -- start start 2023-09-30T13:55:31.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fd5061640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fd015cb00 0x7f7fd0071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fd5061640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7fd00ae300 0x7f7fd006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fd5061640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd006d740 con 0x7f7fd015cee0 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fd5061640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd006da20 con 0x7f7fd015cb00 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fd5061640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd006dd00 con 0x7f7fd00ae300 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fd015cb00 0x7f7fd0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fd015cb00 0x7f7fd0071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58280/0 (socket says 172.21.15.62:58280) 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 -- 172.21.15.62:0/2524251732 learned_addr learned my addr 172.21.15.62:0/2524251732 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fcf59e640 1 --2- 172.21.15.62:0/2524251732 >> v2:172.21.15.135:3300/0 conn(0x7f7fd00ae300 0x7f7fd006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 -- 172.21.15.62:0/2524251732 >> v2:172.21.15.135:3300/0 conn(0x7f7fd00ae300 msgr2=0x7f7fd006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 --2- 172.21.15.62:0/2524251732 >> v2:172.21.15.135:3300/0 conn(0x7f7fd00ae300 0x7f7fd006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 -- 172.21.15.62:0/2524251732 >> v1:172.21.15.135:6789/0 conn(0x7f7fd015cee0 legacy=0x7f7fd00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:31.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.699+0000 7f7fced9d640 1 -- 172.21.15.62:0/2524251732 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd006dfe0 con 0x7f7fd015cb00 2023-09-30T13:55:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.700+0000 7f7fced9d640 1 --2- 172.21.15.62:0/2524251732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cb00 0x7f7fd0071860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00b1ac0 tx=0x7f7fc002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdc2479344e1c72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.700+0000 7f7fcdd9b640 1 -- 172.21.15.62:0/2524251732 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc002ca80 con 0x7f7fd015cb00 2023-09-30T13:55:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.700+0000 7f7fcdd9b640 1 -- 172.21.15.62:0/2524251732 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc002cbe0 con 0x7f7fd015cb00 2023-09-30T13:55:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.700+0000 7f7fcdd9b640 1 -- 172.21.15.62:0/2524251732 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00343f0 con 0x7f7fd015cb00 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 -- 172.21.15.62:0/2524251732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cb00 msgr2=0x7f7fd0071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2524251732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cb00 0x7f7fd0071860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00b1ac0 tx=0x7f7fc002bee0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 -- 172.21.15.62:0/2524251732 shutdown_connections 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2524251732 >> v2:172.21.15.135:3300/0 conn(0x7f7fd00ae300 0x7f7fd006ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2524251732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cb00 0x7f7fd0071860 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 -- 172.21.15.62:0/2524251732 >> 172.21.15.62:0/2524251732 conn(0x7f7fd0070970 msgr2=0x7f7fd0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 -- 172.21.15.62:0/2524251732 shutdown_connections 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.701+0000 7f7fd5061640 1 -- 172.21.15.62:0/2524251732 wait complete. 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.702+0000 7f7fd5061640 1 Processor -- start 2023-09-30T13:55:31.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.702+0000 7f7fd5061640 1 -- start start 2023-09-30T13:55:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fd00ae300 0x7f7fd0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 0x7f7fd00afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c87b0 con 0x7f7fd015cee0 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c5760 con 0x7f7fd00ae300 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fd5061640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c7b30 con 0x7f7fd015cb00 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fcf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fcf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58284/0 (socket says 172.21.15.62:58284) 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fcf59e640 1 -- 172.21.15.62:0/2131194352 learned_addr learned my addr 172.21.15.62:0/2131194352 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fced9d640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fd00ae300 0x7f7fd0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.703+0000 7f7fce59c640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 0x7f7fd00afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 -- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 msgr2=0x7f7fd00afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 0x7f7fd00afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 -- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fd00ae300 msgr2=0x7f7fd0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fd00ae300 0x7f7fd0151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 -- 172.21.15.62:0/2131194352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0009b30 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fce59c640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 0x7f7fd00afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fcf59e640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d550 tx=0x7f7fc800da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80125f0 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8012750 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd00c7e10 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8012b00 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.704+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd00c83d0 con 0x7f7fd015cee0 2023-09-30T13:55:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.705+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd00666d0 con 0x7f7fd015cee0 2023-09-30T13:55:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.705+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7fc8012c60 con 0x7f7fd015cee0 2023-09-30T13:55:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.706+0000 7f7fc77fe640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 0x7f7fb006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.706+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7fc80898a0 con 0x7f7fd015cee0 2023-09-30T13:55:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.706+0000 7f7fced9d640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 0x7f7fb006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.706+0000 7f7fced9d640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 0x7f7fb006cff0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0035000 tx=0x7f7fc0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:31.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.710+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7fc80547c0 con 0x7f7fd015cee0 2023-09-30T13:55:31.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.887+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7fd00c88f0 con 0x7f7fd015cee0 2023-09-30T13:55:31.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.888+0000 7f7fc77fe640 1 -- 172.21.15.62:0/2131194352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7fc8057de0 con 0x7f7fd015cee0 2023-09-30T13:55:31.887 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:31.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.889+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 msgr2=0x7f7fb006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.889+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 0x7f7fb006cff0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0035000 tx=0x7f7fc0030000 comp rx=0 tx=0).stop 2023-09-30T13:55:31.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.889+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 msgr2=0x7f7fd00b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.889+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d550 tx=0x7f7fc800da10 comp rx=0 tx=0).stop 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 shutdown_connections 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7fb006ab30 0x7f7fb006cff0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd015cee0 0x7f7fd00b0200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7fd015cb00 0x7f7fd00afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 --2- 172.21.15.62:0/2131194352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fd00ae300 0x7f7fd0151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 >> 172.21.15.62:0/2131194352 conn(0x7f7fd0070970 msgr2=0x7f7fd00abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 shutdown_connections 2023-09-30T13:55:31.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:31.890+0000 7f7fd5061640 1 -- 172.21.15.62:0/2131194352 wait complete. 2023-09-30T13:55:31.919 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2023-09-30T13:55:31.919 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:55:31.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.028+0000 7fa46b056640 1 Processor -- start 2023-09-30T13:55:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.028+0000 7fa46b056640 1 -- start start 2023-09-30T13:55:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa46b056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa46b056640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4640ab250 0x7fa4640ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa46b056640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4640cf3d0 con 0x7fa4640cdc20 2023-09-30T13:55:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa46b056640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4640b2e50 con 0x7fa4640ab250 2023-09-30T13:55:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa46b056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640ac2d0 con 0x7fa4640cea30 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa463fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa4695f3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4640ab250 0x7fa4640ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa463fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:32880/0 (socket says 172.21.15.62:32880) 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.029+0000 7fa463fff640 1 -- 172.21.15.62:0/1656111479 learned_addr learned my addr 172.21.15.62:0/1656111479 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa4695f3640 1 -- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 msgr2=0x7fa4640cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa4695f3640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa4695f3640 1 -- 172.21.15.62:0/1656111479 >> v1:172.21.15.135:6789/0 conn(0x7fa4640cdc20 legacy=0x7fa4640b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa4695f3640 1 -- 172.21.15.62:0/1656111479 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4640cc340 con 0x7fa4640ab250 2023-09-30T13:55:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa463fff640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.030+0000 7fa4695f3640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640ab250 0x7fa4640ab6e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d90 tx=0x7fa45c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675bd0e95c73509d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa4637fe640 1 -- 172.21.15.62:0/1656111479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c02cbc0 con 0x7fa4640ab250 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa4637fe640 1 -- 172.21.15.62:0/1656111479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c02cd20 con 0x7fa4640ab250 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa4637fe640 1 -- 172.21.15.62:0/1656111479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c034660 con 0x7fa4640ab250 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 -- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640ab250 msgr2=0x7fa4640ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640ab250 0x7fa4640ab6e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d90 tx=0x7fa45c02be10 comp rx=0 tx=0).stop 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 -- 172.21.15.62:0/1656111479 shutdown_connections 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640cea30 0x7fa4640cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 --2- 172.21.15.62:0/1656111479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640ab250 0x7fa4640ab6e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 -- 172.21.15.62:0/1656111479 >> 172.21.15.62:0/1656111479 conn(0x7fa46406a170 msgr2=0x7fa46406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 -- 172.21.15.62:0/1656111479 shutdown_connections 2023-09-30T13:55:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.031+0000 7fa46b056640 1 -- 172.21.15.62:0/1656111479 wait complete. 2023-09-30T13:55:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.032+0000 7fa46b056640 1 Processor -- start 2023-09-30T13:55:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.032+0000 7fa46b056640 1 -- start start 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640ab250 0x7fa4641577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640cea30 0x7fa464159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640c77e0 con 0x7fa4640cdc20 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46415bd20 con 0x7fa4640cea30 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa46b056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640c7500 con 0x7fa4640ab250 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa463fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa463fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58300/0 (socket says 172.21.15.62:58300) 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.033+0000 7fa463fff640 1 -- 172.21.15.62:0/267651162 learned_addr learned my addr 172.21.15.62:0/267651162 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa468df2640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640ab250 0x7fa4641577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa4695f3640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640cea30 0x7fa464159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 -- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640ab250 msgr2=0x7fa4641577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640ab250 0x7fa4641577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 -- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640cea30 msgr2=0x7fa464159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640cea30 0x7fa464159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 -- 172.21.15.62:0/267651162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580094d0 con 0x7fa4640cdc20 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa463fff640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa45800ea00 tx=0x7fa45800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ca60 con 0x7fa4640cdc20 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800cbc0 con 0x7fa4640cdc20 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c009a70 con 0x7fa4640cdc20 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458013470 con 0x7fa4640cdc20 2023-09-30T13:55:32.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.034+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46406c230 con 0x7fa4640cdc20 2023-09-30T13:55:32.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.035+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46404e0d0 con 0x7fa4640cdc20 2023-09-30T13:55:32.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.035+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa4580135d0 con 0x7fa4640cdc20 2023-09-30T13:55:32.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.036+0000 7fa4617fa640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 0x7fa45006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.036+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa458089800 con 0x7fa4640cdc20 2023-09-30T13:55:32.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.036+0000 7fa468df2640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 0x7fa45006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.037+0000 7fa468df2640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 0x7fa45006d020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4540016d0 tx=0x7fa454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.040+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa458054720 con 0x7fa4640cdc20 2023-09-30T13:55:32.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.216+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46406de10 con 0x7fa4640cdc20 2023-09-30T13:55:32.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.217+0000 7fa4617fa640 1 -- 172.21.15.62:0/267651162 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fa458057d40 con 0x7fa4640cdc20 2023-09-30T13:55:32.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:32.217 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 msgr2=0x7fa45006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 0x7fa45006d020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4540016d0 tx=0x7fa454009040 comp rx=0 tx=0).stop 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 msgr2=0x7fa464159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa45800ea00 tx=0x7fa45800eec0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 shutdown_connections 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa45006ab60 0x7fa45006d020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4640cea30 0x7fa464159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4640cdc20 0x7fa464159450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 --2- 172.21.15.62:0/267651162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4640ab250 0x7fa4641577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 >> 172.21.15.62:0/267651162 conn(0x7fa46406a170 msgr2=0x7fa4640ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 shutdown_connections 2023-09-30T13:55:32.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.219+0000 7fa46b056640 1 -- 172.21.15.62:0/267651162 wait complete. 2023-09-30T13:55:32.229 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:32.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.339+0000 7f3dbf29b640 1 Processor -- start 2023-09-30T13:55:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 -- start start 2023-09-30T13:55:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3db80b8760 0x7f3db80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80cd8c0 0x7f3db80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80d1410 con 0x7f3db815cbc0 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db80ce290 con 0x7f3db80b8760 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbf29b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80d16f0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbc836640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3db80b8760 0x7f3db80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbc836640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3db80b8760 0x7f3db80d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58310/0 (socket says 172.21.15.62:58310) 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.340+0000 7f3dbc836640 1 -- 172.21.15.62:0/567001367 learned_addr learned my addr 172.21.15.62:0/567001367 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.341+0000 7f3dbd838640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80cd8c0 0x7f3db80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.341+0000 7f3dbc836640 1 -- 172.21.15.62:0/567001367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80cd8c0 msgr2=0x7f3db80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.341+0000 7f3dbc836640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80cd8c0 0x7f3db80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.341+0000 7f3dbc836640 1 -- 172.21.15.62:0/567001367 >> v1:172.21.15.135:6789/0 conn(0x7f3db815cbc0 legacy=0x7f3db80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.341+0000 7f3dbc836640 1 -- 172.21.15.62:0/567001367 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80d19d0 con 0x7f3db80b8760 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbc836640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80b8760 0x7f3db80d24b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffba28b42ec2a59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3db7fff640 1 -- 172.21.15.62:0/567001367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031640 con 0x7f3db80b8760 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3db7fff640 1 -- 172.21.15.62:0/567001367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0317a0 con 0x7f3db80b8760 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3db7fff640 1 -- 172.21.15.62:0/567001367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031b30 con 0x7f3db80b8760 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 -- 172.21.15.62:0/567001367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80b8760 msgr2=0x7f3db80d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80b8760 0x7f3db80d24b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac02b8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 -- 172.21.15.62:0/567001367 shutdown_connections 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80cd8c0 0x7f3db80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/567001367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80b8760 0x7f3db80d24b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 -- 172.21.15.62:0/567001367 >> 172.21.15.62:0/567001367 conn(0x7f3db80718a0 msgr2=0x7f3db8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 -- 172.21.15.62:0/567001367 shutdown_connections 2023-09-30T13:55:32.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.342+0000 7f3dbf29b640 1 -- 172.21.15.62:0/567001367 wait complete. 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 Processor -- start 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 -- start start 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 0x7f3db8152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3db815cbc0 0x7f3db80b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80cc3e0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80cb760 con 0x7f3db815cbc0 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbf29b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80cba40 con 0x7f3db80b8760 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbc836640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbc836640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58320/0 (socket says 172.21.15.62:58320) 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.344+0000 7f3dbc836640 1 -- 172.21.15.62:0/2283692844 learned_addr learned my addr 172.21.15.62:0/2283692844 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbd037640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 0x7f3db8152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 -- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 msgr2=0x7f3db8152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 0x7f3db8152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbd838640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3db815cbc0 0x7f3db80b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 -- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3db815cbc0 msgr2=0x7f3db80b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3db815cbc0 0x7f3db80b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 -- 172.21.15.62:0/2283692844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0094d0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbd037640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 0x7f3db8152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbc836640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac03ac60 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac03adc0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac044630 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db80cbd20 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.345+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db80cb330 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.346+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db804e0d0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.347+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3dac02f050 con 0x7f3db80cd8c0 2023-09-30T13:55:32.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.347+0000 7f3db5ffb640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 0x7f3da406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.347+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3dac0ab3d0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.347+0000 7f3dbd037640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 0x7f3da406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.348+0000 7f3dbd037640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 0x7f3da406d020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3db000a830 tx=0x7f3db0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.352+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3dac0762f0 con 0x7f3db80cd8c0 2023-09-30T13:55:32.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.525+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3db8071d90 con 0x7f3db80cd8c0 2023-09-30T13:55:32.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.526+0000 7f3db5ffb640 1 -- 172.21.15.62:0/2283692844 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dac031e60 con 0x7f3db80cd8c0 2023-09-30T13:55:32.525 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 msgr2=0x7f3da406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 0x7f3da406d020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3db000a830 tx=0x7f3db0008040 comp rx=0 tx=0).stop 2023-09-30T13:55:32.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 msgr2=0x7f3db80cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009870 tx=0x7f3dac0046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 shutdown_connections 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3da406ab60 0x7f3da406d020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3db815cbc0 0x7f3db80b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3db80cd8c0 0x7f3db80cadf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 --2- 172.21.15.62:0/2283692844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3db80b8760 0x7f3db8152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 >> 172.21.15.62:0/2283692844 conn(0x7f3db80718a0 msgr2=0x7f3db80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 shutdown_connections 2023-09-30T13:55:32.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.527+0000 7f3dbf29b640 1 -- 172.21.15.62:0/2283692844 wait complete. 2023-09-30T13:55:32.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.647+0000 7f332e4bb640 1 Processor -- start 2023-09-30T13:55:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.647+0000 7f332e4bb640 1 -- start start 2023-09-30T13:55:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f332e4bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33280b8760 0x7f33280d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f332e4bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33280cd8c0 0x7f33280cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f332e4bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280ce250 con 0x7f332815cbc0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f332e4bb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280d1410 con 0x7f33280b8760 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f332e4bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280d16f0 con 0x7f33280cd8c0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f3327fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f332815cbc0 0x7f33280d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33158/0 (socket says 172.21.15.62:33158) 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f3327fff640 1 -- 172.21.15.62:0/1749931458 learned_addr learned my addr 172.21.15.62:0/1749931458 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.648+0000 7f33277fe640 1 --2- 172.21.15.62:0/1749931458 >> v2:172.21.15.62:3300/0 conn(0x7f33280b8760 0x7f33280d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f332ca58640 1 --2- 172.21.15.62:0/1749931458 >> v2:172.21.15.135:3300/0 conn(0x7f33280cd8c0 0x7f33280cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f3326ffd640 1 -- 172.21.15.62:0/1749931458 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497961827 0 0) 0x7f3318001110 con 0x7f332815cbc0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f3326ffd640 1 -- 172.21.15.62:0/1749931458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3310003520 con 0x7f332815cbc0 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f33277fe640 1 -- 172.21.15.62:0/1749931458 >> v2:172.21.15.135:3300/0 conn(0x7f33280cd8c0 msgr2=0x7f33280cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f33277fe640 1 --2- 172.21.15.62:0/1749931458 >> v2:172.21.15.135:3300/0 conn(0x7f33280cd8c0 0x7f33280cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f33277fe640 1 -- 172.21.15.62:0/1749931458 >> v1:172.21.15.62:6789/0 conn(0x7f332815cbc0 legacy=0x7f33280d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.649+0000 7f33277fe640 1 -- 172.21.15.62:0/1749931458 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280d19d0 con 0x7f33280b8760 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f33277fe640 1 --2- 172.21.15.62:0/1749931458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280d24b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f33280cd0b0 tx=0x7f331c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc4ce11c68c1ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f3326ffd640 1 -- 172.21.15.62:0/1749931458 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c031830 con 0x7f33280b8760 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f3326ffd640 1 -- 172.21.15.62:0/1749931458 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c031990 con 0x7f33280b8760 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f3326ffd640 1 -- 172.21.15.62:0/1749931458 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c031d00 con 0x7f33280b8760 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 -- 172.21.15.62:0/1749931458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 msgr2=0x7f33280d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 --2- 172.21.15.62:0/1749931458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280d24b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f33280cd0b0 tx=0x7f331c02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 -- 172.21.15.62:0/1749931458 shutdown_connections 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 --2- 172.21.15.62:0/1749931458 >> v2:172.21.15.135:3300/0 conn(0x7f33280cd8c0 0x7f33280cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 --2- 172.21.15.62:0/1749931458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280d24b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 -- 172.21.15.62:0/1749931458 >> 172.21.15.62:0/1749931458 conn(0x7f33280718a0 msgr2=0x7f3328071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 -- 172.21.15.62:0/1749931458 shutdown_connections 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.650+0000 7f332e4bb640 1 -- 172.21.15.62:0/1749931458 wait complete. 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.651+0000 7f332e4bb640 1 Processor -- start 2023-09-30T13:55:32.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 -- start start 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 0x7f332815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 0x7f33280b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33280c6ab0 con 0x7f33280b8760 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33280c6d90 con 0x7f332815cbc0 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.652+0000 7f332e4bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33280c7070 con 0x7f33280cd8c0 2023-09-30T13:55:32.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58330/0 (socket says 172.21.15.62:58330) 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 -- 172.21.15.62:0/2831339228 learned_addr learned my addr 172.21.15.62:0/2831339228 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f332ca58640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 0x7f33280b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f33277fe640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 0x7f332815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 -- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 msgr2=0x7f332815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 0x7f332815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 -- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 msgr2=0x7f33280b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 0x7f33280b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 -- 172.21.15.62:0/2831339228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c009400 con 0x7f33280b8760 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f332ca58640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 0x7f33280b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f33277fe640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 0x7f332815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:32.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3327fff640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f331800c390 tx=0x7f331800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318005ce0 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318005e60 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318007310 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33280c7350 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.653+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33280caab0 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.654+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332804e0d0 con 0x7f33280b8760 2023-09-30T13:55:32.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.655+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3318007470 con 0x7f33280b8760 2023-09-30T13:55:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.655+0000 7f3324ff9640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 0x7f331406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.655+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3318088990 con 0x7f33280b8760 2023-09-30T13:55:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.655+0000 7f33277fe640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 0x7f331406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.656+0000 7f33277fe640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 0x7f331406cff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f331c036000 tx=0x7f331c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.659+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f33180538b0 con 0x7f33280b8760 2023-09-30T13:55:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.836+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33280ce250 con 0x7f33280b8760 2023-09-30T13:55:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.836+0000 7f3324ff9640 1 -- 172.21.15.62:0/2831339228 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3318017020 con 0x7f33280b8760 2023-09-30T13:55:32.836 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 msgr2=0x7f331406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 0x7f331406cff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f331c036000 tx=0x7f331c008030 comp rx=0 tx=0).stop 2023-09-30T13:55:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 msgr2=0x7f33280ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f331800c390 tx=0x7f331800c850 comp rx=0 tx=0).stop 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 shutdown_connections 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f331406ab30 0x7f331406cff0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f332815cbc0 0x7f33280b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33280cd8c0 0x7f332815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 --2- 172.21.15.62:0/2831339228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33280b8760 0x7f33280ca570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 >> 172.21.15.62:0/2831339228 conn(0x7f33280718a0 msgr2=0x7f33280d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 shutdown_connections 2023-09-30T13:55:32.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.838+0000 7f332e4bb640 1 -- 172.21.15.62:0/2831339228 wait complete. 2023-09-30T13:55:32.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:32.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.957+0000 7f13609ce640 1 Processor -- start 2023-09-30T13:55:32.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.957+0000 7f13609ce640 1 -- start start 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.958+0000 7f13609ce640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f135c15cbc0 0x7f135c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.958+0000 7f13609ce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c0d1410 con 0x7f135c0cd8c0 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.958+0000 7f13609ce640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c0d16f0 con 0x7f135c0b8760 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.958+0000 7f13609ce640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c0d19d0 con 0x7f135c15cbc0 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f135c0cd8c0 0x7f135c0b5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33174/0 (socket says 172.21.15.62:33174) 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135ad9d640 1 -- 172.21.15.62:0/1976546071 learned_addr learned my addr 172.21.15.62:0/1976546071 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:32.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049983106 0 0) 0x7f135c0d1410 con 0x7f135c0cd8c0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1344003520 con 0x7f135c0cd8c0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135a59c640 1 --2- 172.21.15.62:0/1976546071 >> v2:172.21.15.135:3300/0 conn(0x7f135c15cbc0 0x7f135c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2211860821 0 0) 0x7f1344003520 con 0x7f135c0cd8c0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 >> v2:172.21.15.135:3300/0 conn(0x7f135c15cbc0 msgr2=0x7f135c0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 --2- 172.21.15.62:0/1976546071 >> v2:172.21.15.135:3300/0 conn(0x7f135c15cbc0 0x7f135c0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 >> v1:172.21.15.135:6789/0 conn(0x7f135c0b8760 legacy=0x7f135c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0d1cb0 con 0x7f135c0cd8c0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f13540019f0 con 0x7f135c0cd8c0 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 >> v1:172.21.15.62:6789/0 conn(0x7f135c0cd8c0 legacy=0x7f135c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1344003970 0x7f1344003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 0x7f1344004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1344005180 0x7f134400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0d19d0 con 0x7f13440047c0 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134400c020 con 0x7f1344003970 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134400c1e0 con 0x7f1344005180 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f1359d9b640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 0x7f1344004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135a59c640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1344003970 0x7f1344003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.959+0000 7f135ad9d640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1344005180 0x7f134400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 -- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1344005180 msgr2=0x7f134400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1344005180 0x7f134400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 -- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1344003970 msgr2=0x7f1344003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1344003970 0x7f1344003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 -- 172.21.15.62:0/1976546071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344003520 con 0x7f13440047c0 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f135ad9d640 1 -- 172.21.15.62:0/1976546071 reap_dead start 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f1359d9b640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 0x7f1344004c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1350001750 tx=0x7f13440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941576b5c9f5d60d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500052d0 con 0x7f13440047c0 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135002e050 con 0x7f13440047c0 2023-09-30T13:55:32.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.960+0000 7f135959a640 1 -- 172.21.15.62:0/1976546071 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350003830 con 0x7f13440047c0 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 -- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 msgr2=0x7f1344004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 0x7f1344004c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1350001750 tx=0x7f13440057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 -- 172.21.15.62:0/1976546071 shutdown_connections 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 --2- 172.21.15.62:0/1976546071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13440047c0 0x7f1344004c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 -- 172.21.15.62:0/1976546071 >> 172.21.15.62:0/1976546071 conn(0x7f135c0718a0 msgr2=0x7f135c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 -- 172.21.15.62:0/1976546071 shutdown_connections 2023-09-30T13:55:32.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.961+0000 7f13609ce640 1 -- 172.21.15.62:0/1976546071 wait complete. 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.962+0000 7f13609ce640 1 Processor -- start 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.962+0000 7f13609ce640 1 -- start start 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13440047c0 0x7f135c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f135c0b5be0 0x7f135c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c1587b0 con 0x7f135c0b6060 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b6610 con 0x7f13440047c0 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f13609ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b68f0 con 0x7f135c0b5be0 2023-09-30T13:55:32.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f135ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f135ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58352/0 (socket says 172.21.15.62:58352) 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.963+0000 7f135ad9d640 1 -- 172.21.15.62:0/3220416907 learned_addr learned my addr 172.21.15.62:0/3220416907 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135a59c640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13440047c0 0x7f135c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f1359d9b640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f135c0b5be0 0x7f135c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 -- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f135c0b5be0 msgr2=0x7f135c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f135c0b5be0 0x7f135c159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 -- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13440047c0 msgr2=0x7f135c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13440047c0 0x7f135c158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 -- 172.21.15.62:0/3220416907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0b6bd0 con 0x7f135c0b6060 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f135ad9d640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f135c0cf1e0 tx=0x7f1354007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400ea80 con 0x7f135c0b6060 2023-09-30T13:55:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400ec20 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354013420 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0b6eb0 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.964+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c0b76b0 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.965+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c0b73d0 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.965+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1354013580 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.966+0000 7f134affd640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 0x7f133c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.966+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f13540898f0 con 0x7f135c0b6060 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.966+0000 7f135a59c640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 0x7f133c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.966+0000 7f135a59c640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 0x7f133c06cff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f134c009a60 tx=0x7f134c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:32.970+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f135c0b73d0 con 0x7f135c0b6060 2023-09-30T13:55:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.144+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f135c0b73d0 con 0x7f135c0b6060 2023-09-30T13:55:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.144+0000 7f134affd640 1 -- 172.21.15.62:0/3220416907 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f135c0b73d0 con 0x7f135c0b6060 2023-09-30T13:55:33.144 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:33.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.146+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 msgr2=0x7f133c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.146+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 0x7f133c06cff0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f134c009a60 tx=0x7f134c008040 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 msgr2=0x7f135c15a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f135c0cf1e0 tx=0x7f1354007bc0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 shutdown_connections 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f133c06ab30 0x7f133c06cff0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f135c0b6060 0x7f135c15a430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f135c0b5be0 0x7f135c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 --2- 172.21.15.62:0/3220416907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13440047c0 0x7f135c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 >> 172.21.15.62:0/3220416907 conn(0x7f135c0718a0 msgr2=0x7f135c15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 shutdown_connections 2023-09-30T13:55:33.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.147+0000 7f13609ce640 1 -- 172.21.15.62:0/3220416907 wait complete. 2023-09-30T13:55:33.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.266+0000 7f33a4290640 1 Processor -- start 2023-09-30T13:55:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.266+0000 7f33a4290640 1 -- start start 2023-09-30T13:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.267+0000 7f33a4290640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f339c070770 0x7f339c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.267+0000 7f33a4290640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.267+0000 7f33a4290640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c15a3e0 con 0x7f339c156b20 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.267+0000 7f33a4290640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c06de80 con 0x7f339c070770 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.267+0000 7f33a4290640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c159e30 con 0x7f339c159480 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f339c070770 0x7f339c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f339c070770 0x7f339c06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58360/0 (socket says 172.21.15.62:58360) 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 -- 172.21.15.62:0/577990076 learned_addr learned my addr 172.21.15.62:0/577990076 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 -- 172.21.15.62:0/577990076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 msgr2=0x7f339c1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 --2- 172.21.15.62:0/577990076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 -- 172.21.15.62:0/577990076 >> v1:172.21.15.135:6789/0 conn(0x7f339c156b20 legacy=0x7f339c070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.268+0000 7f33a182b640 1 -- 172.21.15.62:0/577990076 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c15a100 con 0x7f339c070770 2023-09-30T13:55:33.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a182b640 1 --2- 172.21.15.62:0/577990076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c06ce00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f339c0afa30 tx=0x7f338c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68904a458fb8bc17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a102a640 1 -- 172.21.15.62:0/577990076 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0317c0 con 0x7f339c070770 2023-09-30T13:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a102a640 1 -- 172.21.15.62:0/577990076 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c031920 con 0x7f339c070770 2023-09-30T13:55:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a102a640 1 -- 172.21.15.62:0/577990076 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c031cb0 con 0x7f339c070770 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 -- 172.21.15.62:0/577990076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 msgr2=0x7f339c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 --2- 172.21.15.62:0/577990076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c06ce00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f339c0afa30 tx=0x7f338c02b860 comp rx=0 tx=0).stop 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 -- 172.21.15.62:0/577990076 shutdown_connections 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 --2- 172.21.15.62:0/577990076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 --2- 172.21.15.62:0/577990076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c06ce00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 -- 172.21.15.62:0/577990076 >> 172.21.15.62:0/577990076 conn(0x7f339c0cb720 msgr2=0x7f339c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 -- 172.21.15.62:0/577990076 shutdown_connections 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.269+0000 7f33a4290640 1 -- 172.21.15.62:0/577990076 wait complete. 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.270+0000 7f33a4290640 1 Processor -- start 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 -- start start 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f339c156b20 0x7f339c147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0a8940 con 0x7f339c070770 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c1e3b30 con 0x7f339c156b20 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a4290640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c1e2ca0 con 0x7f339c159480 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a202c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a202c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58370/0 (socket says 172.21.15.62:58370) 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.271+0000 7f33a202c640 1 -- 172.21.15.62:0/3400386619 learned_addr learned my addr 172.21.15.62:0/3400386619 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a282d640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a182b640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f339c156b20 0x7f339c147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 -- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 msgr2=0x7f339c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 -- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f339c156b20 msgr2=0x7f339c147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f339c156b20 0x7f339c147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 -- 172.21.15.62:0/3400386619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0094d0 con 0x7f339c070770 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a202c640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f339800c410 tx=0x7f339800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33980035f0 con 0x7f339c070770 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398003750 con 0x7f339c070770 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398003b40 con 0x7f339c070770 2023-09-30T13:55:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c1484f0 con 0x7f339c070770 2023-09-30T13:55:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.272+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c1e3200 con 0x7f339c070770 2023-09-30T13:55:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.273+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c15c5a0 con 0x7f339c070770 2023-09-30T13:55:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.273+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3398003ca0 con 0x7f339c070770 2023-09-30T13:55:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.274+0000 7f3392ffd640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 0x7f338006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.274+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f33980887d0 con 0x7f339c070770 2023-09-30T13:55:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.274+0000 7f33a182b640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 0x7f338006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.275+0000 7f33a182b640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 0x7f338006d020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f338c036000 tx=0x7f338c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.278+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3398053660 con 0x7f339c070770 2023-09-30T13:55:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.455+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f339c06c5d0 con 0x7f339c070770 2023-09-30T13:55:33.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.455+0000 7f3392ffd640 1 -- 172.21.15.62:0/3400386619 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3398056c80 con 0x7f339c070770 2023-09-30T13:55:33.455 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 msgr2=0x7f338006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 0x7f338006d020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f338c036000 tx=0x7f338c03d040 comp rx=0 tx=0).stop 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 msgr2=0x7f339c1e2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f339800c410 tx=0x7f339800c8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 shutdown_connections 2023-09-30T13:55:33.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f338006ab60 0x7f338006d020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f339c159480 0x7f339c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f339c156b20 0x7f339c147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 --2- 172.21.15.62:0/3400386619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f339c070770 0x7f339c1e2760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 >> 172.21.15.62:0/3400386619 conn(0x7f339c0cb720 msgr2=0x7f339c1560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 shutdown_connections 2023-09-30T13:55:33.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.457+0000 7f33a4290640 1 -- 172.21.15.62:0/3400386619 wait complete. 2023-09-30T13:55:33.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2023-09-30T13:55:33.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.574+0000 7fdb38761640 1 Processor -- start 2023-09-30T13:55:33.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.574+0000 7fdb38761640 1 -- start start 2023-09-30T13:55:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb38761640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb300cf140 0x7fdb300ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb38761640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb300c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb38761640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300b1e20 con 0x7fdb301598c0 2023-09-30T13:55:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb38761640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300b1530 con 0x7fdb300cf140 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb38761640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300b17d0 con 0x7fdb300c8c90 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb35cfc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb300cf140 0x7fdb300ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb364fd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdb301598c0 0x7fdb300cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33188/0 (socket says 172.21.15.62:33188) 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb364fd640 1 -- 172.21.15.62:0/3807158466 learned_addr learned my addr 172.21.15.62:0/3807158466 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.575+0000 7fdb36cfe640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb300c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb35cfc640 1 -- 172.21.15.62:0/3807158466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 msgr2=0x7fdb300c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb35cfc640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb300c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb35cfc640 1 -- 172.21.15.62:0/3807158466 >> v1:172.21.15.62:6789/0 conn(0x7fdb301598c0 legacy=0x7fdb300cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb35cfc640 1 -- 172.21.15.62:0/3807158466 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300b1ab0 con 0x7fdb300cf140 2023-09-30T13:55:33.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb354fb640 1 -- 172.21.15.62:0/3807158466 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388963524 0 0) 0x7fdb300b1e20 con 0x7fdb301598c0 2023-09-30T13:55:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.576+0000 7fdb35cfc640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb300ccc20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097d0 tx=0x7fdb2002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75c6156c6877804 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb354fb640 1 -- 172.21.15.62:0/3807158466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20031800 con 0x7fdb300cf140 2023-09-30T13:55:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb354fb640 1 -- 172.21.15.62:0/3807158466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20031960 con 0x7fdb300cf140 2023-09-30T13:55:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb354fb640 1 -- 172.21.15.62:0/3807158466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20031cf0 con 0x7fdb300cf140 2023-09-30T13:55:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 -- 172.21.15.62:0/3807158466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 msgr2=0x7fdb300ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb300ccc20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb200097d0 tx=0x7fdb2002b8a0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 -- 172.21.15.62:0/3807158466 shutdown_connections 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb300c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 --2- 172.21.15.62:0/3807158466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb300ccc20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 -- 172.21.15.62:0/3807158466 >> 172.21.15.62:0/3807158466 conn(0x7fdb3006a170 msgr2=0x7fdb3006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 -- 172.21.15.62:0/3807158466 shutdown_connections 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.577+0000 7fdb38761640 1 -- 172.21.15.62:0/3807158466 wait complete. 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.578+0000 7fdb38761640 1 Processor -- start 2023-09-30T13:55:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.578+0000 7fdb38761640 1 -- start start 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb301f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 0x7fdb301582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30157520 con 0x7fdb300cf140 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301f33c0 con 0x7fdb301598c0 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb38761640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301569a0 con 0x7fdb300c8c90 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb35cfc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb35cfc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58394/0 (socket says 172.21.15.62:58394) 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.579+0000 7fdb35cfc640 1 -- 172.21.15.62:0/2849833571 learned_addr learned my addr 172.21.15.62:0/2849833571 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb36cfe640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 0x7fdb301582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb364fd640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb301f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 -- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 msgr2=0x7fdb301f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb301f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 -- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 msgr2=0x7fdb301582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 0x7fdb301582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 -- 172.21.15.62:0/2849833571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb20009400 con 0x7fdb300cf140 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb36cfe640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 0x7fdb301582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb364fd640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb301f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb35cfc640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb2002beb0 tx=0x7fdb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2003cc80 con 0x7fdb300cf140 2023-09-30T13:55:33.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2003cde0 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb30156c80 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20004230 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.580+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30157240 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.581+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3004e0d0 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.582+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdb20004390 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.582+0000 7fdb26ffd640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 0x7fdb1406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.582+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb2002e070 con 0x7fdb300cf140 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.582+0000 7fdb364fd640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 0x7fdb1406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.583+0000 7fdb364fd640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 0x7fdb1406cff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001d50 tx=0x7fdb2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:33.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.586+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fdb20076c90 con 0x7fdb300cf140 2023-09-30T13:55:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:33.829+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) v1 -- 0x7fdb300b3410 con 0x7fdb300cf140 2023-09-30T13:55:34.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.597+0000 7fdb26ffd640 1 -- 172.21.15.62:0/2849833571 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v67) v1 ==== 168+0+0 (secure 0 0 0) 0x7fdb200350e0 con 0x7fdb300cf140 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 msgr2=0x7fdb1406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 0x7fdb1406cff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001d50 tx=0x7fdb2c009040 comp rx=0 tx=0).stop 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 msgr2=0x7fdb30157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb2002beb0 tx=0x7fdb200046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 shutdown_connections 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdb1406ab30 0x7fdb1406cff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb301598c0 0x7fdb301582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb300cf140 0x7fdb30157d70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 --2- 172.21.15.62:0/2849833571 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb300c8c90 0x7fdb301f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 >> 172.21.15.62:0/2849833571 conn(0x7fdb3006a170 msgr2=0x7fdb30070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 shutdown_connections 2023-09-30T13:55:34.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.599+0000 7fdb38761640 1 -- 172.21.15.62:0/2849833571 wait complete. 2023-09-30T13:55:34.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T13:55:34.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.724+0000 7ffab1490640 1 Processor -- start 2023-09-30T13:55:34.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.724+0000 7ffab1490640 1 -- start start 2023-09-30T13:55:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffab1490640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffaac15cbc0 0x7ffaac0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffab1490640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac0d1410 con 0x7ffaac0b8760 2023-09-30T13:55:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffab1490640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac0d16f0 con 0x7ffaac0cd8c0 2023-09-30T13:55:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffab1490640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac0d19d0 con 0x7ffaac15cbc0 2023-09-30T13:55:34.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaa3fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffaac0b8760 0x7ffaac0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33198/0 (socket says 172.21.15.62:33198) 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaa3fff640 1 -- 172.21.15.62:0/1347452824 learned_addr learned my addr 172.21.15.62:0/1347452824 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaaffd640 1 --2- 172.21.15.62:0/1347452824 >> v2:172.21.15.135:3300/0 conn(0x7ffaac15cbc0 0x7ffaac0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338091743 0 0) 0x7ffaac0d1410 con 0x7ffaac0b8760 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa98003520 con 0x7ffaac0b8760 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819418492 0 0) 0x7ffa98003520 con 0x7ffaac0b8760 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 >> v2:172.21.15.135:3300/0 conn(0x7ffaac15cbc0 msgr2=0x7ffaac0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 --2- 172.21.15.62:0/1347452824 >> v2:172.21.15.135:3300/0 conn(0x7ffaac15cbc0 0x7ffaac0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 >> v1:172.21.15.135:6789/0 conn(0x7ffaac0cd8c0 legacy=0x7ffaac0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0d1cb0 con 0x7ffaac0b8760 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7ffa94001670 con 0x7ffaac0b8760 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 >> v1:172.21.15.62:6789/0 conn(0x7ffaac0b8760 legacy=0x7ffaac0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa98003970 0x7ffa98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa980047c0 0x7ffa98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffa9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0d19d0 con 0x7ffa98005180 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9800c020 con 0x7ffa98003970 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.725+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9800c1e0 con 0x7ffa980047c0 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffa9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaa3fff640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa980047c0 0x7ffa98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaaaffd640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa98003970 0x7ffa98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 -- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa980047c0 msgr2=0x7ffa98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa980047c0 0x7ffa98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 -- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa98003970 msgr2=0x7ffa98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa98003970 0x7ffa98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 -- 172.21.15.62:0/1347452824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98003520 con 0x7ffa98005180 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.726+0000 7ffaab7fe640 1 -- 172.21.15.62:0/1347452824 reap_dead start 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffaab7fe640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffa9800b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4001e50 tx=0x7ffa980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e062f1a97e470e26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4003b70 con 0x7ffa98005180 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4003d10 con 0x7ffa98005180 2023-09-30T13:55:34.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffaaa7fc640 1 -- 172.21.15.62:0/1347452824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4005310 con 0x7ffa98005180 2023-09-30T13:55:34.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 -- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 msgr2=0x7ffa9800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffa9800b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4001e50 tx=0x7ffa980057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 -- 172.21.15.62:0/1347452824 shutdown_connections 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 --2- 172.21.15.62:0/1347452824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffa9800b980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 -- 172.21.15.62:0/1347452824 >> 172.21.15.62:0/1347452824 conn(0x7ffaac0718a0 msgr2=0x7ffaac071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 -- 172.21.15.62:0/1347452824 shutdown_connections 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.727+0000 7ffab1490640 1 -- 172.21.15.62:0/1347452824 wait complete. 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.728+0000 7ffab1490640 1 Processor -- start 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 -- start start 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaac0b2060 0x7ffaac15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffaac159960 0x7ffaac0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0b3660 con 0x7ffa98005180 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac15e7e0 con 0x7ffaac0b2060 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffab1490640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0b2640 con 0x7ffaac159960 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58422/0 (socket says 172.21.15.62:58422) 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.729+0000 7ffaaaffd640 1 -- 172.21.15.62:0/1862820695 learned_addr learned my addr 172.21.15.62:0/1862820695 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 -- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffaac159960 msgr2=0x7ffaac0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffaac159960 0x7ffaac0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 -- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaac0b2060 msgr2=0x7ffaac15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaac0b2060 0x7ffaac15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 -- 172.21.15.62:0/1862820695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0b2920 con 0x7ffa98005180 2023-09-30T13:55:34.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaaaffd640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0118e0 tx=0x7ffa9c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00faf0 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00fc50 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac0b2c00 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c014440 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.730+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac15e480 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.731+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac04e0d0 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.732+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ffa9c0145a0 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.732+0000 7ffaa37fe640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 0x7ffa8c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.732+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa9c089ec0 con 0x7ffa98005180 2023-09-30T13:55:34.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.732+0000 7ffaa3fff640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 0x7ffa8c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:34.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.733+0000 7ffaa3fff640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 0x7ffa8c06d020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:34.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.736+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ffa9c054d50 con 0x7ffa98005180 2023-09-30T13:55:34.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.912+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffaac0b2d90 con 0x7ffa98005180 2023-09-30T13:55:34.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.915+0000 7ffaa37fe640 1 -- 172.21.15.62:0/1862820695 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffa9c058370 con 0x7ffa98005180 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 msgr2=0x7ffa8c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 0x7ffa8c06d020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94000ed0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 msgr2=0x7ffaac0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0118e0 tx=0x7ffa9c011da0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 shutdown_connections 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffa8c06ab60 0x7ffa8c06d020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffaac159960 0x7ffaac0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaac0b2060 0x7ffaac15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 --2- 172.21.15.62:0/1862820695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa98005180 0x7ffaac0b3120 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 >> 172.21.15.62:0/1862820695 conn(0x7ffaac0718a0 msgr2=0x7ffaac0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 shutdown_connections 2023-09-30T13:55:34.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:34.917+0000 7ffab1490640 1 -- 172.21.15.62:0/1862820695 wait complete. 2023-09-30T13:55:34.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T13:55:34.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:55:34.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:55:35.024 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T13:55:35.025 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:35.025 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:35.040 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:35.040 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:35.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.242+0000 7ff9c13a9640 1 Processor -- start 2023-09-30T13:55:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.242+0000 7ff9c13a9640 1 -- start start 2023-09-30T13:55:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9c13a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9bc158c20 0x7ff9bc0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9c13a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 0x7ff9bc159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9c13a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc159540 con 0x7ff9bc0caea0 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9c13a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0b1ea0 con 0x7ff9bc158c20 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9c13a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc06ddf0 con 0x7ff9bc0cc210 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9baffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9bc158c20 0x7ff9bc0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9baffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9bc158c20 0x7ff9bc0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58430/0 (socket says 172.21.15.62:58430) 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.243+0000 7ff9baffd640 1 -- 172.21.15.62:0/2153846890 learned_addr learned my addr 172.21.15.62:0/2153846890 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9ba7fc640 1 --2- 172.21.15.62:0/2153846890 >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 0x7ff9bc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9baffd640 1 -- 172.21.15.62:0/2153846890 >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 msgr2=0x7ff9bc159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9baffd640 1 --2- 172.21.15.62:0/2153846890 >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 0x7ff9bc159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9baffd640 1 -- 172.21.15.62:0/2153846890 >> v1:172.21.15.135:6789/0 conn(0x7ff9bc0caea0 legacy=0x7ff9bc0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9baffd640 1 -- 172.21.15.62:0/2153846890 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0cdf30 con 0x7ff9bc158c20 2023-09-30T13:55:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9ba7fc640 1 --2- 172.21.15.62:0/2153846890 >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 0x7ff9bc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9baffd640 1 --2- 172.21.15.62:0/2153846890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc0b22f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06e490 tx=0x7ff9ac02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e372d2878102e72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.244+0000 7ff9b9ffb640 1 -- 172.21.15.62:0/2153846890 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02caa0 con 0x7ff9bc158c20 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9b9ffb640 1 -- 172.21.15.62:0/2153846890 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac02cc00 con 0x7ff9bc158c20 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9b9ffb640 1 -- 172.21.15.62:0/2153846890 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0343f0 con 0x7ff9bc158c20 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 -- 172.21.15.62:0/2153846890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 msgr2=0x7ff9bc0b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/2153846890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc0b22f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06e490 tx=0x7ff9ac02bf00 comp rx=0 tx=0).stop 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 -- 172.21.15.62:0/2153846890 shutdown_connections 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/2153846890 >> v2:172.21.15.135:3300/0 conn(0x7ff9bc0cc210 0x7ff9bc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/2153846890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc0b22f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 -- 172.21.15.62:0/2153846890 >> 172.21.15.62:0/2153846890 conn(0x7ff9bc06a170 msgr2=0x7ff9bc06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:35.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 -- 172.21.15.62:0/2153846890 shutdown_connections 2023-09-30T13:55:35.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.245+0000 7ff9c13a9640 1 -- 172.21.15.62:0/2153846890 wait complete. 2023-09-30T13:55:35.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.246+0000 7ff9c13a9640 1 Processor -- start 2023-09-30T13:55:35.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.246+0000 7ff9c13a9640 1 -- start start 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9bc0caea0 0x7ff9bc0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9bc0cc210 0x7ff9bc1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0c6d50 con 0x7ff9bc158c20 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0c57b0 con 0x7ff9bc0cc210 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9c13a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0c5a50 con 0x7ff9bc0caea0 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9bb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9bb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58432/0 (socket says 172.21.15.62:58432) 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9bb7fe640 1 -- 172.21.15.62:0/3648028789 learned_addr learned my addr 172.21.15.62:0/3648028789 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9ba7fc640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9bc0cc210 0x7ff9bc1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.247+0000 7ff9baffd640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9bc0caea0 0x7ff9bc0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 -- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9bc0caea0 msgr2=0x7ff9bc0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9bc0caea0 0x7ff9bc0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 -- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9bc0cc210 msgr2=0x7ff9bc1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9bc0cc210 0x7ff9bc1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 -- 172.21.15.62:0/3648028789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009b30 con 0x7ff9bc158c20 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9bb7fe640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c410 tx=0x7ff9b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4011790 con 0x7ff9bc158c20 2023-09-30T13:55:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40118f0 con 0x7ff9bc158c20 2023-09-30T13:55:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0c5d30 con 0x7ff9bc158c20 2023-09-30T13:55:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4011ce0 con 0x7ff9bc158c20 2023-09-30T13:55:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.248+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc0c62f0 con 0x7ff9bc158c20 2023-09-30T13:55:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.249+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0c6510 con 0x7ff9bc158c20 2023-09-30T13:55:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.249+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff9b401c460 con 0x7ff9bc158c20 2023-09-30T13:55:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.250+0000 7ff9b37fe640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 0x7ff99c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.250+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9b40892c0 con 0x7ff9bc158c20 2023-09-30T13:55:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.250+0000 7ff9baffd640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 0x7ff99c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.251+0000 7ff9baffd640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 0x7ff99c06cff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac035000 tx=0x7ff9ac030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.254+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff9b4054150 con 0x7ff9bc158c20 2023-09-30T13:55:35.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.429+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9bc04e0d0 con 0x7ff9bc158c20 2023-09-30T13:55:35.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.431+0000 7ff9b37fe640 1 -- 172.21.15.62:0/3648028789 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7ff9b4057770 con 0x7ff9bc158c20 2023-09-30T13:55:35.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:35.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.432+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 msgr2=0x7ff99c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 0x7ff99c06cff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac035000 tx=0x7ff9ac030000 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 msgr2=0x7ff9bc070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c410 tx=0x7ff9b400c8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 shutdown_connections 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff99c06ab30 0x7ff99c06cff0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9bc158c20 0x7ff9bc070540 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9bc0cc210 0x7ff9bc1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 --2- 172.21.15.62:0/3648028789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9bc0caea0 0x7ff9bc0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 >> 172.21.15.62:0/3648028789 conn(0x7ff9bc06a170 msgr2=0x7ff9bc071300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 shutdown_connections 2023-09-30T13:55:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.433+0000 7ff9c13a9640 1 -- 172.21.15.62:0/3648028789 wait complete. 2023-09-30T13:55:35.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:35.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.553+0000 7fa50bc26640 1 Processor -- start 2023-09-30T13:55:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.553+0000 7fa50bc26640 1 -- start start 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50bc26640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa504159b90 0x7fa50406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50bc26640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50415a3e0 con 0x7fa504156b20 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50bc26640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50415a100 con 0x7fa504070770 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50bc26640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50406de80 con 0x7fa504159b90 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50a1c3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa504159b90 0x7fa50406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa5099c2640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa504156b20 0x7fa504070060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33212/0 (socket says 172.21.15.62:33212) 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50a1c3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa504159b90 0x7fa50406ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58434/0 (socket says 172.21.15.62:58434) 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa5099c2640 1 -- 172.21.15.62:0/1112930979 learned_addr learned my addr 172.21.15.62:0/1112930979 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50a1c3640 1 -- 172.21.15.62:0/1112930979 >> v1:172.21.15.135:6789/0 conn(0x7fa504070770 legacy=0x7fa504159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50a1c3640 1 -- 172.21.15.62:0/1112930979 >> v1:172.21.15.62:6789/0 conn(0x7fa504156b20 legacy=0x7fa504070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.554+0000 7fa50a1c3640 1 -- 172.21.15.62:0/1112930979 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50406c320 con 0x7fa504159b90 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.555+0000 7fa50a1c3640 1 --2- 172.21.15.62:0/1112930979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50406ce00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00bfa0 tx=0x7fa4fc02e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5beeb11f37a3b681 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.555+0000 7fa5089c0640 1 -- 172.21.15.62:0/1112930979 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc02ede0 con 0x7fa504159b90 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.555+0000 7fa5089c0640 1 -- 172.21.15.62:0/1112930979 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc032070 con 0x7fa504159b90 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.555+0000 7fa5089c0640 1 -- 172.21.15.62:0/1112930979 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc038620 con 0x7fa504159b90 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 -- 172.21.15.62:0/1112930979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 msgr2=0x7fa50406ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 --2- 172.21.15.62:0/1112930979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50406ce00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00bfa0 tx=0x7fa4fc02e030 comp rx=0 tx=0).stop 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 -- 172.21.15.62:0/1112930979 shutdown_connections 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 --2- 172.21.15.62:0/1112930979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50406ce00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 -- 172.21.15.62:0/1112930979 >> 172.21.15.62:0/1112930979 conn(0x7fa5040cb720 msgr2=0x7fa5040ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 -- 172.21.15.62:0/1112930979 shutdown_connections 2023-09-30T13:55:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.556+0000 7fa50bc26640 1 -- 172.21.15.62:0/1112930979 wait complete. 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.557+0000 7fa50bc26640 1 Processor -- start 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.557+0000 7fa50bc26640 1 -- start start 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 0x7fa5040b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 0x7fa504151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041e1820 con 0x7fa504159b90 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041e1b00 con 0x7fa504156b20 2023-09-30T13:55:35.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50bc26640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041e1de0 con 0x7fa504070770 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58444/0 (socket says 172.21.15.62:58444) 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 -- 172.21.15.62:0/311942561 learned_addr learned my addr 172.21.15.62:0/311942561 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 -- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 msgr2=0x7fa5040b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa5099c2640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 0x7fa5040b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa5091c1640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 0x7fa504151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 0x7fa5040b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 -- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 msgr2=0x7fa504151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 0x7fa504151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 -- 172.21.15.62:0/311942561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc00bc80 con 0x7fa504159b90 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa5099c2640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 0x7fa5040b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa5091c1640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 0x7fa504151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa50a1c3640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc02e070 tx=0x7fa4fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc043640 con 0x7fa504159b90 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.558+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0437a0 con 0x7fa504159b90 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.559+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5041e20c0 con 0x7fa504159b90 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.559+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc043b50 con 0x7fa504159b90 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.559+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50414e430 con 0x7fa504159b90 2023-09-30T13:55:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.560+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5041e25e0 con 0x7fa504159b90 2023-09-30T13:55:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.560+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa4fc043cb0 con 0x7fa504159b90 2023-09-30T13:55:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.560+0000 7fa4fa7fc640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 0x7fa4e806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.560+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4fc0adfa0 con 0x7fa504159b90 2023-09-30T13:55:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.561+0000 7fa5099c2640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 0x7fa4e806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.561+0000 7fa5099c2640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 0x7fa4e806d020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa500005880 tx=0x7fa500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.565+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa4fc0e0ad0 con 0x7fa504159b90 2023-09-30T13:55:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.740+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa50415c5a0 con 0x7fa504159b90 2023-09-30T13:55:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.741+0000 7fa4fa7fc640 1 -- 172.21.15.62:0/311942561 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5041e25e0 con 0x7fa504159b90 2023-09-30T13:55:35.740 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 msgr2=0x7fa4e806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 0x7fa4e806d020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa500005880 tx=0x7fa500009040 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 msgr2=0x7fa50414f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc02e070 tx=0x7fa4fc004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 shutdown_connections 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa4e806ab60 0x7fa4e806d020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa504159b90 0x7fa50414f3f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa504156b20 0x7fa504151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 --2- 172.21.15.62:0/311942561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa504070770 0x7fa5040b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 >> 172.21.15.62:0/311942561 conn(0x7fa5040cb720 msgr2=0x7fa5041560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:35.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 shutdown_connections 2023-09-30T13:55:35.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.743+0000 7fa50bc26640 1 -- 172.21.15.62:0/311942561 wait complete. 2023-09-30T13:55:35.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:35.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.862+0000 7f5c81705640 1 Processor -- start 2023-09-30T13:55:35.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.862+0000 7f5c81705640 1 -- start start 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c81705640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c81705640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0af960 con 0x7f5c7c159610 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c81705640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c06c390 con 0x7f5c7c1599f0 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c81705640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c06c670 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58456/0 (socket says 172.21.15.62:58456) 2023-09-30T13:55:35.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/3466448357 learned_addr learned my addr 172.21.15.62:0/3466448357 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:35.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/3466448357 >> v1:172.21.15.135:6789/0 conn(0x7f5c7c1599f0 legacy=0x7f5c7c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:35.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/3466448357 >> v1:172.21.15.62:6789/0 conn(0x7f5c7c159610 legacy=0x7f5c7c0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.863+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/3466448357 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c06c950 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.864+0000 7f5c7b7fe640 1 --2- 172.21.15.62:0/3466448357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009e50 tx=0x7f5c7402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44de19008effc8e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.864+0000 7f5c7a7fc640 1 -- 172.21.15.62:0/3466448357 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7402ca80 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.864+0000 7f5c7a7fc640 1 -- 172.21.15.62:0/3466448357 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7402cbe0 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.864+0000 7f5c7a7fc640 1 -- 172.21.15.62:0/3466448357 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740343f0 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 -- 172.21.15.62:0/3466448357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c0b09d0 msgr2=0x7f5c7c0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 --2- 172.21.15.62:0/3466448357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009e50 tx=0x7f5c7402bee0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 -- 172.21.15.62:0/3466448357 shutdown_connections 2023-09-30T13:55:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 --2- 172.21.15.62:0/3466448357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c0b09d0 0x7f5c7c0b29a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 -- 172.21.15.62:0/3466448357 >> 172.21.15.62:0/3466448357 conn(0x7f5c7c0cb720 msgr2=0x7f5c7c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 -- 172.21.15.62:0/3466448357 shutdown_connections 2023-09-30T13:55:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.865+0000 7f5c81705640 1 -- 172.21.15.62:0/3466448357 wait complete. 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.866+0000 7f5c81705640 1 Processor -- start 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.866+0000 7f5c81705640 1 -- start start 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c7c0b09d0 0x7f5c7c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c159610 0x7f5c7c142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c142590 con 0x7f5c7c1599f0 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c158d40 con 0x7f5c7c159610 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c81705640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c14d5e0 con 0x7f5c7c0b09d0 2023-09-30T13:55:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58470/0 (socket says 172.21.15.62:58470) 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/2854754667 learned_addr learned my addr 172.21.15.62:0/2854754667 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c73fff640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c159610 0x7f5c7c142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c7c0b09d0 msgr2=0x7f5c7c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c7c0b09d0 0x7f5c7c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c159610 msgr2=0x7f5c7c142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c159610 0x7f5c7c142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 -- 172.21.15.62:0/2854754667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74009b30 con 0x7f5c7c1599f0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c7b7fe640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c74036040 tx=0x7f5c74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7403e450 con 0x7f5c7c1599f0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.867+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7403e5d0 con 0x7f5c7c1599f0 2023-09-30T13:55:35.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.868+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7403e980 con 0x7f5c7c1599f0 2023-09-30T13:55:35.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.868+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c14d8c0 con 0x7f5c7c1599f0 2023-09-30T13:55:35.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.868+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c14de80 con 0x7f5c7c1599f0 2023-09-30T13:55:35.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.868+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c0cac90 con 0x7f5c7c1599f0 2023-09-30T13:55:35.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.869+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5c7402cd50 con 0x7f5c7c1599f0 2023-09-30T13:55:35.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.869+0000 7f5c737fe640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 0x7f5c5c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:35.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.870+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c740ac200 con 0x7f5c7c1599f0 2023-09-30T13:55:35.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.870+0000 7f5c7affd640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 0x7f5c5c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:35.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.870+0000 7f5c7affd640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 0x7f5c5c06cff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000f60 tx=0x7f5c6c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:35.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:35.874+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5c74077260 con 0x7f5c7c1599f0 2023-09-30T13:55:36.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.051+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c7c04e0d0 con 0x7f5c7c1599f0 2023-09-30T13:55:36.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.051+0000 7f5c737fe640 1 -- 172.21.15.62:0/2854754667 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c7407a880 con 0x7f5c7c1599f0 2023-09-30T13:55:36.051 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 msgr2=0x7f5c5c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 0x7f5c5c06cff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000f60 tx=0x7f5c6c0079b0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 msgr2=0x7f5c7c14e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c74036040 tx=0x7f5c74004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 shutdown_connections 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5c5c06ab30 0x7f5c5c06cff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c7c1599f0 0x7f5c7c14e3a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c159610 0x7f5c7c142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.053+0000 7f5c81705640 1 --2- 172.21.15.62:0/2854754667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c7c0b09d0 0x7f5c7c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.054+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 >> 172.21.15.62:0/2854754667 conn(0x7f5c7c0cb720 msgr2=0x7f5c7c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.054+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 shutdown_connections 2023-09-30T13:55:36.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.054+0000 7f5c81705640 1 -- 172.21.15.62:0/2854754667 wait complete. 2023-09-30T13:55:36.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:36.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.173+0000 7f519b294640 1 Processor -- start 2023-09-30T13:55:36.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.173+0000 7f519b294640 1 -- start start 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f519b294640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5194153d20 0x7f51940ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f519b294640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f519415d9f0 0x7f519406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f519b294640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519406c540 con 0x7f51940aeb00 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f519b294640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940b29c0 con 0x7f519415d9f0 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f519b294640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5194154100 con 0x7f5194153d20 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f519415d9f0 0x7f519406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f519415d9f0 0x7f519406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58474/0 (socket says 172.21.15.62:58474) 2023-09-30T13:55:36.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 -- 172.21.15.62:0/1655029549 learned_addr learned my addr 172.21.15.62:0/1655029549 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199030640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5194153d20 0x7f51940ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 -- 172.21.15.62:0/1655029549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5194153d20 msgr2=0x7f51940ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5194153d20 0x7f51940ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 -- 172.21.15.62:0/1655029549 >> v1:172.21.15.62:6789/0 conn(0x7f51940aeb00 legacy=0x7f519415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.174+0000 7f5199831640 1 -- 172.21.15.62:0/1655029549 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519406c1f0 con 0x7f519415d9f0 2023-09-30T13:55:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.175+0000 7f5199831640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f519415d9f0 0x7f519406c9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f518c00d150 tx=0x7f518c02e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527cb13a26bd43f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.175+0000 7f518bfff640 1 -- 172.21.15.62:0/1655029549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00b0d0 con 0x7f519415d9f0 2023-09-30T13:55:36.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.175+0000 7f518bfff640 1 -- 172.21.15.62:0/1655029549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c00b230 con 0x7f519415d9f0 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.175+0000 7f518bfff640 1 -- 172.21.15.62:0/1655029549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c009600 con 0x7f519415d9f0 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 -- 172.21.15.62:0/1655029549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f519415d9f0 msgr2=0x7f519406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f519415d9f0 0x7f519406c9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f518c00d150 tx=0x7f518c02e160 comp rx=0 tx=0).stop 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 -- 172.21.15.62:0/1655029549 shutdown_connections 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f519415d9f0 0x7f519406c9d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 --2- 172.21.15.62:0/1655029549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5194153d20 0x7f51940ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 -- 172.21.15.62:0/1655029549 >> 172.21.15.62:0/1655029549 conn(0x7f51940cb720 msgr2=0x7f51940ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 -- 172.21.15.62:0/1655029549 shutdown_connections 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.176+0000 7f519b294640 1 -- 172.21.15.62:0/1655029549 wait complete. 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.177+0000 7f519b294640 1 Processor -- start 2023-09-30T13:55:36.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.177+0000 7f519b294640 1 -- start start 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194153d20 0x7f51941514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f519415d9f0 0x7f519414bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941506d0 con 0x7f51940aeb00 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194151030 con 0x7f5194153d20 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519b294640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5194150030 con 0x7f519415d9f0 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58478/0 (socket says 172.21.15.62:58478) 2023-09-30T13:55:36.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 -- 172.21.15.62:0/2797713763 learned_addr learned my addr 172.21.15.62:0/2797713763 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199831640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f519415d9f0 0x7f519414bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f519882f640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194153d20 0x7f51941514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 -- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f519415d9f0 msgr2=0x7f519414bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f519415d9f0 0x7f519414bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 -- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194153d20 msgr2=0x7f51941514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194153d20 0x7f51941514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 -- 172.21.15.62:0/2797713763 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c00bd40 con 0x7f51940aeb00 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5199030640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f519000d800 tx=0x7f519000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.178+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000b6c0 con 0x7f51940aeb00 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.179+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000b820 con 0x7f51940aeb00 2023-09-30T13:55:36.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.179+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51941eea40 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.179+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000bbb0 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.179+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51941519f0 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.180+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5194150940 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.180+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f519000bd10 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.180+0000 7f5189ffb640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 0x7f517806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.180+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5190089c20 con 0x7f51940aeb00 2023-09-30T13:55:36.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.181+0000 7f519882f640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 0x7f517806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.181+0000 7f519882f640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 0x7f517806cff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51940b4a90 tx=0x7f5184009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.185+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5190054a20 con 0x7f51940aeb00 2023-09-30T13:55:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.359+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5194151bb0 con 0x7f51940aeb00 2023-09-30T13:55:36.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.359+0000 7f5189ffb640 1 -- 172.21.15.62:0/2797713763 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5190058040 con 0x7f51940aeb00 2023-09-30T13:55:36.359 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 msgr2=0x7f517806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 0x7f517806cff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51940b4a90 tx=0x7f5184009040 comp rx=0 tx=0).stop 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 msgr2=0x7f5194150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f519000d800 tx=0x7f519000dcc0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 shutdown_connections 2023-09-30T13:55:36.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f517806ab30 0x7f517806cff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f519415d9f0 0x7f519414bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5194153d20 0x7f51941514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 --2- 172.21.15.62:0/2797713763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51940aeb00 0x7f5194150af0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 >> 172.21.15.62:0/2797713763 conn(0x7f51940cb720 msgr2=0x7f519406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 shutdown_connections 2023-09-30T13:55:36.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.361+0000 7f519b294640 1 -- 172.21.15.62:0/2797713763 wait complete. 2023-09-30T13:55:36.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.480+0000 7fe6e50bb640 1 Processor -- start 2023-09-30T13:55:36.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.480+0000 7fe6e50bb640 1 -- start start 2023-09-30T13:55:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6e50bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6e015cbc0 0x7fe6e00d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6e50bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6e00cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6e50bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e00d1410 con 0x7fe6e00b8760 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6e50bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e00ce290 con 0x7fe6e015cbc0 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6e50bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00d16f0 con 0x7fe6e00cd8c0 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6de59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe6e00b8760 0x7fe6e00d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33234/0 (socket says 172.21.15.62:33234) 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.481+0000 7fe6de59c640 1 -- 172.21.15.62:0/4245063113 learned_addr learned my addr 172.21.15.62:0/4245063113 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6df59e640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6e00cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/4245063113 >> v2:172.21.15.135:3300/0 conn(0x7fe6e015cbc0 0x7fe6e00d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350733888 0 0) 0x7fe6e00d1410 con 0x7fe6e00b8760 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c8003520 con 0x7fe6e00b8760 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672255841 0 0) 0x7fe6c8003520 con 0x7fe6e00b8760 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 msgr2=0x7fe6e00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6e00cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 >> v2:172.21.15.135:3300/0 conn(0x7fe6e015cbc0 msgr2=0x7fe6e00d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 --2- 172.21.15.62:0/4245063113 >> v2:172.21.15.135:3300/0 conn(0x7fe6e015cbc0 0x7fe6e00d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00d19d0 con 0x7fe6e00b8760 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fe6d4001670 con 0x7fe6e00b8760 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 >> v1:172.21.15.62:6789/0 conn(0x7fe6e00b8760 legacy=0x7fe6e00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6c8003970 0x7fe6c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c8004d00 0x7fe6c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00ce290 con 0x7fe6c8003970 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00d16f0 con 0x7fe6c8004d00 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c800b980 con 0x7fe6e00cd8c0 2023-09-30T13:55:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6c8003970 0x7fe6c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6de59c640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6df59e640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c8004d00 0x7fe6c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 -- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 msgr2=0x7fe6c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e00cd8c0 0x7fe6c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 -- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c8004d00 msgr2=0x7fe6c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c8004d00 0x7fe6c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6ded9d640 1 -- 172.21.15.62:0/4245063113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8003520 con 0x7fe6c8003970 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.482+0000 7fe6df59e640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c8004d00 0x7fe6c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.483+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6c8003970 0x7fe6c8003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009ac0 tx=0x7fe6c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53357de66d1acff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.483+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d802c710 con 0x7fe6c8003970 2023-09-30T13:55:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.483+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d802c870 con 0x7fe6c8003970 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.483+0000 7fe6ddd9b640 1 -- 172.21.15.62:0/4245063113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d802cc00 con 0x7fe6c8003970 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 -- 172.21.15.62:0/4245063113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6c8003970 msgr2=0x7fe6c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/4245063113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6c8003970 0x7fe6c8003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009ac0 tx=0x7fe6c80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6df59e640 1 -- 172.21.15.62:0/4245063113 reap_dead start 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 -- 172.21.15.62:0/4245063113 shutdown_connections 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 -- 172.21.15.62:0/4245063113 >> 172.21.15.62:0/4245063113 conn(0x7fe6e00718a0 msgr2=0x7fe6e0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 -- 172.21.15.62:0/4245063113 shutdown_connections 2023-09-30T13:55:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.484+0000 7fe6e50bb640 1 -- 172.21.15.62:0/4245063113 wait complete. 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.485+0000 7fe6e50bb640 1 Processor -- start 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.485+0000 7fe6e50bb640 1 -- start start 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 0x7fe6e00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 0x7fe6e00b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00cc530 con 0x7fe6e015a540 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00b7730 con 0x7fe6e00b6d60 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6e50bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00c8aa0 con 0x7fe6c8003970 2023-09-30T13:55:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58490/0 (socket says 172.21.15.62:58490) 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 -- 172.21.15.62:0/2607462752 learned_addr learned my addr 172.21.15.62:0/2607462752 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 0x7fe6e00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6df59e640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 0x7fe6e00b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 -- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 msgr2=0x7fe6e00c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 0x7fe6e00c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 -- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 msgr2=0x7fe6e00b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 0x7fe6e00b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6de59c640 1 -- 172.21.15.62:0/2607462752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00cbf70 con 0x7fe6e015a540 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6df59e640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 0x7fe6e00b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.486+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 0x7fe6e00c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6de59c640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4004f60 tx=0x7fe6d4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400f7b0 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400f910 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e00cc250 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400fcc0 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.487+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e00b29d0 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.488+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e00b2550 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.488+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe6d401d460 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.489+0000 7fe6c77fe640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 0x7fe6cc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.489+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6d4089990 con 0x7fe6e015a540 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.489+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 0x7fe6cc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.490+0000 7fe6ded9d640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 0x7fe6cc06cff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8036000 tx=0x7fe6d8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.493+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe6e00b2550 con 0x7fe6e015a540 2023-09-30T13:55:36.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.671+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe6e00b2550 con 0x7fe6e015a540 2023-09-30T13:55:36.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.671+0000 7fe6c77fe640 1 -- 172.21.15.62:0/2607462752 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe6e00b2550 con 0x7fe6e015a540 2023-09-30T13:55:36.671 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:36.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 msgr2=0x7fe6cc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 0x7fe6cc06cff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8036000 tx=0x7fe6d8030000 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 msgr2=0x7fe6e00cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4004f60 tx=0x7fe6d4004f90 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 shutdown_connections 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6cc06ab30 0x7fe6cc06cff0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e00b6d60 0x7fe6e00b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e015a540 0x7fe6e00cb5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 --2- 172.21.15.62:0/2607462752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c8003970 0x7fe6e00c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 >> 172.21.15.62:0/2607462752 conn(0x7fe6e00718a0 msgr2=0x7fe6e00d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 shutdown_connections 2023-09-30T13:55:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.674+0000 7fe6e50bb640 1 -- 172.21.15.62:0/2607462752 wait complete. 2023-09-30T13:55:36.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.792+0000 7f4000807640 1 Processor -- start 2023-09-30T13:55:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.792+0000 7f4000807640 1 -- start start 2023-09-30T13:55:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f4000807640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3ffc160160 0x7f3ffc0d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f4000807640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0cda60 con 0x7f3ffc0d3600 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f4000807640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0d18a0 con 0x7f3ffc0cdef0 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f4000807640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc160540 con 0x7f3ffc160160 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f3ff9d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3ffc0d3600 0x7f3ffc0b5790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33248/0 (socket says 172.21.15.62:33248) 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f3ff9d9b640 1 -- 172.21.15.62:0/111587198 learned_addr learned my addr 172.21.15.62:0/111587198 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200797351 0 0) 0x7f3ffc0cda60 con 0x7f3ffc0d3600 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.793+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe8003520 con 0x7f3ffc0d3600 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/111587198 >> v2:172.21.15.135:3300/0 conn(0x7f3ffc160160 0x7f3ffc0d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286006552 0 0) 0x7f3fe8003520 con 0x7f3ffc0d3600 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 >> v2:172.21.15.135:3300/0 conn(0x7f3ffc160160 msgr2=0x7f3ffc0d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 --2- 172.21.15.62:0/111587198 >> v2:172.21.15.135:3300/0 conn(0x7f3ffc160160 0x7f3ffc0d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 >> v1:172.21.15.135:6789/0 conn(0x7f3ffc0cdef0 legacy=0x7f3ffc0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0cd450 con 0x7f3ffc0d3600 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f3fe4001670 con 0x7f3ffc0d3600 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 >> v1:172.21.15.62:6789/0 conn(0x7f3ffc0d3600 legacy=0x7f3ffc0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8003970 0x7f3fe8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe80047c0 0x7f3fe8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 0x7f3fe800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc160540 con 0x7f3fe8005180 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe800c0b0 con 0x7f3fe80047c0 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe800c270 con 0x7f3fe8003970 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 0x7f3fe800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8003970 0x7f3fe8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff9d9b640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe80047c0 0x7f3fe8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 -- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8003970 msgr2=0x7f3fe8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8003970 0x7f3fe8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 -- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe80047c0 msgr2=0x7f3fe8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe80047c0 0x7f3fe8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffad9d640 1 -- 172.21.15.62:0/111587198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8003520 con 0x7f3fe8005180 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ff9d9b640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fe80047c0 0x7f3fe8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.794+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8003970 0x7f3fe8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.795+0000 7f3ffad9d640 1 -- 172.21.15.62:0/111587198 reap_dead start 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.795+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 0x7f3fe800b980 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3fec001e50 tx=0x7f3fe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3653f212ac2ced server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.795+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec003b70 con 0x7f3fe8005180 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.795+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec003d10 con 0x7f3fe8005180 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.795+0000 7f3ff959a640 1 -- 172.21.15.62:0/111587198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec005310 con 0x7f3fe8005180 2023-09-30T13:55:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 -- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 msgr2=0x7f3fe800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 0x7f3fe800b980 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3fec001e50 tx=0x7f3fe80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 -- 172.21.15.62:0/111587198 shutdown_connections 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 --2- 172.21.15.62:0/111587198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe8005180 0x7f3fe800b980 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 -- 172.21.15.62:0/111587198 >> 172.21.15.62:0/111587198 conn(0x7f3ffc089fe0 msgr2=0x7f3ffc0d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 -- 172.21.15.62:0/111587198 shutdown_connections 2023-09-30T13:55:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.796+0000 7f4000807640 1 -- 172.21.15.62:0/111587198 wait complete. 2023-09-30T13:55:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.797+0000 7f4000807640 1 Processor -- start 2023-09-30T13:55:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.797+0000 7f4000807640 1 -- start start 2023-09-30T13:55:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 0x7f3ffc09d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ffc09c700 0x7f3ffc15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15d010 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15d2b0 con 0x7f3ffc09c700 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f4000807640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15d590 con 0x7f3fe8005180 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58508/0 (socket says 172.21.15.62:58508) 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 -- 172.21.15.62:0/2403370196 learned_addr learned my addr 172.21.15.62:0/2403370196 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 0x7f3ffc09d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 -- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 msgr2=0x7f3ffc09d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 0x7f3ffc09d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 -- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ffc09c700 msgr2=0x7f3ffc15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ffc09c700 0x7f3ffc15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 -- 172.21.15.62:0/2403370196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc15d870 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 0x7f3ffc09d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.798+0000 7f3ffad9d640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3fec001f70 tx=0x7f3fec0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec006d50 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec039480 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec039870 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc15db50 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc15abc0 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.799+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc073e70 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.800+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3fec0399d0 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.800+0000 7f3ff2ffd640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 0x7f3fdc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.801+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3fec0ab480 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.801+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 0x7f3fdc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.801+0000 7f3ffa59c640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 0x7f3fdc06cff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4006fd0 tx=0x7f3ff4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.805+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3fec0763a0 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.994+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ffc15d010 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.994+0000 7f3ff2ffd640 1 -- 172.21.15.62:0/2403370196 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3fec0799c0 con 0x7f3ffc15e5b0 2023-09-30T13:55:36.994 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 msgr2=0x7f3fdc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 0x7f3fdc06cff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4006fd0 tx=0x7f3ff4008040 comp rx=0 tx=0).stop 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 msgr2=0x7f3ffc1f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3fec001f70 tx=0x7f3fec0014a0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 shutdown_connections 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3fdc06ab30 0x7f3fdc06cff0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ffc15e5b0 0x7f3ffc1f5900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ffc09c700 0x7f3ffc15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 --2- 172.21.15.62:0/2403370196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3fe8005180 0x7f3ffc09d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 >> 172.21.15.62:0/2403370196 conn(0x7f3ffc089fe0 msgr2=0x7f3ffc0b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 shutdown_connections 2023-09-30T13:55:36.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:36.996+0000 7f4000807640 1 -- 172.21.15.62:0/2403370196 wait complete. 2023-09-30T13:55:37.007 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:37.007 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:37.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:37.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.169+0000 7fbcb3d1d640 1 Processor -- start 2023-09-30T13:55:37.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.169+0000 7fbcb3d1d640 1 -- start start 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac15d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbcac06cb40 0x7fbcac069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcac06dcd0 0x7fbcac06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac06e6a0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac06d0b0 con 0x7fbcac06cb40 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb3d1d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac06d390 con 0x7fbcac15a8c0 2023-09-30T13:55:37.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcac06dcd0 0x7fbcac06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbcac06dcd0 0x7fbcac06e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58512/0 (socket says 172.21.15.62:58512) 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 -- 172.21.15.62:0/1691436666 learned_addr learned my addr 172.21.15.62:0/1691436666 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb1ab9640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb12b8640 1 --2- 172.21.15.62:0/1691436666 >> v2:172.21.15.135:3300/0 conn(0x7fbcac06cb40 0x7fbcac069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 -- 172.21.15.62:0/1691436666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 msgr2=0x7fbcac15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 -- 172.21.15.62:0/1691436666 >> v2:172.21.15.135:3300/0 conn(0x7fbcac06cb40 msgr2=0x7fbcac069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 --2- 172.21.15.62:0/1691436666 >> v2:172.21.15.135:3300/0 conn(0x7fbcac06cb40 0x7fbcac069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.170+0000 7fbcb22ba640 1 -- 172.21.15.62:0/1691436666 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac06d670 con 0x7fbcac06dcd0 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.171+0000 7fbcb22ba640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac06e160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcac06fd20 tx=0x7fbc9c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e1abdf8230bfe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.171+0000 7fbcb0ab7640 1 -- 172.21.15.62:0/1691436666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c02c9e0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.171+0000 7fbcb0ab7640 1 -- 172.21.15.62:0/1691436666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c02cb40 con 0x7fbcac06dcd0 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.171+0000 7fbcb0ab7640 1 -- 172.21.15.62:0/1691436666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0343f0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1691436666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 msgr2=0x7fbcac06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac06e160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcac06fd20 tx=0x7fbc9c02be40 comp rx=0 tx=0).stop 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1691436666 shutdown_connections 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac06e160 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1691436666 >> v2:172.21.15.135:3300/0 conn(0x7fbcac06cb40 0x7fbcac069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1691436666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1691436666 >> 172.21.15.62:0/1691436666 conn(0x7fbcac0b0b50 msgr2=0x7fbcac0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1691436666 shutdown_connections 2023-09-30T13:55:37.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.172+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1691436666 wait complete. 2023-09-30T13:55:37.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.173+0000 7fbcb3d1d640 1 Processor -- start 2023-09-30T13:55:37.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.173+0000 7fbcb3d1d640 1 -- start start 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcac06cb40 0x7fbcac09f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac0c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac14cb00 con 0x7fbcac06dcd0 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac09f790 con 0x7fbcac06cb40 2023-09-30T13:55:37.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb3d1d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac09fa70 con 0x7fbcac15a8c0 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58518/0 (socket says 172.21.15.62:58518) 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 -- 172.21.15.62:0/1495047086 learned_addr learned my addr 172.21.15.62:0/1495047086 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb22ba640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac0c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb1ab9640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcac06cb40 0x7fbcac09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 -- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 msgr2=0x7fbcac0c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac0c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 -- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcac06cb40 msgr2=0x7fbcac09f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcac06cb40 0x7fbcac09f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.174+0000 7fbcb12b8640 1 -- 172.21.15.62:0/1495047086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c009b30 con 0x7fbcac06dcd0 2023-09-30T13:55:37.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcb12b8640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbca000d800 tx=0x7fbca000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00096a0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0009800 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac09fd50 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0009b90 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.175+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0a0310 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.176+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac04e0d0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.176+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbca0009cf0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.177+0000 7fbcaa7fc640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 0x7fbc9806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.177+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbca00898f0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.177+0000 7fbcb1ab9640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 0x7fbc9806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.177+0000 7fbcb1ab9640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 0x7fbc9806cff0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009aa0 tx=0x7fbca4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.181+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbca00548c0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.357+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcac0ccdb0 con 0x7fbcac06dcd0 2023-09-30T13:55:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.358+0000 7fbcaa7fc640 1 -- 172.21.15.62:0/1495047086 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fbca000b440 con 0x7fbcac06dcd0 2023-09-30T13:55:37.358 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:37.359 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 msgr2=0x7fbc9806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 0x7fbc9806cff0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009aa0 tx=0x7fbca4009190 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 msgr2=0x7fbcac14c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbca000d800 tx=0x7fbca000dcc0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 shutdown_connections 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbc9806ab30 0x7fbc9806cff0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbcac15a8c0 0x7fbcac0c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcac06dcd0 0x7fbcac14c5c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 --2- 172.21.15.62:0/1495047086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcac06cb40 0x7fbcac09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.360+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 >> 172.21.15.62:0/1495047086 conn(0x7fbcac0b0b50 msgr2=0x7fbcac0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.361+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 shutdown_connections 2023-09-30T13:55:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.361+0000 7fbcb3d1d640 1 -- 172.21.15.62:0/1495047086 wait complete. 2023-09-30T13:55:37.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:37.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:37.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.482+0000 7f79ccd5a640 1 Processor -- start 2023-09-30T13:55:37.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.482+0000 7f79ccd5a640 1 -- start start 2023-09-30T13:55:37.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79ccd5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79c806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79ccd5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79c80b18a0 0x7f79c806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79ccd5a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c80d0050 con 0x7f79c806b070 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79ccd5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c80cdd40 con 0x7f79c80b18a0 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79ccd5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c806b500 con 0x7f79c80cd960 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79c5d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f79c806b070 0x7f79c81609f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33262/0 (socket says 172.21.15.62:33262) 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.483+0000 7f79c5d9b640 1 -- 172.21.15.62:0/4208187820 learned_addr learned my addr 172.21.15.62:0/4208187820 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936414917 0 0) 0x7f79c80d0050 con 0x7f79c806b070 2023-09-30T13:55:37.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79c806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b4003520 con 0x7f79c806b070 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/4208187820 >> v2:172.21.15.135:3300/0 conn(0x7f79c80b18a0 0x7f79c806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734365568 0 0) 0x7f79b4003520 con 0x7f79c806b070 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 msgr2=0x7f79c806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79c806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 >> v2:172.21.15.135:3300/0 conn(0x7f79c80b18a0 msgr2=0x7f79c806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 --2- 172.21.15.62:0/4208187820 >> v2:172.21.15.135:3300/0 conn(0x7f79c80b18a0 0x7f79c806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80cf720 con 0x7f79c806b070 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f79b0001670 con 0x7f79c806b070 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 >> v1:172.21.15.62:6789/0 conn(0x7f79c806b070 legacy=0x7f79c81609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79b4003970 0x7f79b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b40047c0 0x7f79b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c806b500 con 0x7f79b4003970 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b400b980 con 0x7f79b40047c0 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b400bac0 con 0x7f79c80cd960 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79b4003970 0x7f79b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c5d9b640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b40047c0 0x7f79b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 -- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 msgr2=0x7f79b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 -- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b40047c0 msgr2=0x7f79b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b40047c0 0x7f79b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c659c640 1 -- 172.21.15.62:0/4208187820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4003520 con 0x7f79b4003970 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.484+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79c80cd960 0x7f79b4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.485+0000 7f79c659c640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79b4003970 0x7f79b4003d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009ac0 tx=0x7f79b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d9256876eba2a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.485+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c002c6b0 con 0x7f79b4003970 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.485+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c002c810 con 0x7f79b4003970 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.485+0000 7f79c559a640 1 -- 172.21.15.62:0/4208187820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c002cba0 con 0x7f79b4003970 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 -- 172.21.15.62:0/4208187820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79b4003970 msgr2=0x7f79b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/4208187820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79b4003970 0x7f79b4003d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009ac0 tx=0x7f79b40057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79c6d9d640 1 -- 172.21.15.62:0/4208187820 reap_dead start 2023-09-30T13:55:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 -- 172.21.15.62:0/4208187820 shutdown_connections 2023-09-30T13:55:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 -- 172.21.15.62:0/4208187820 >> 172.21.15.62:0/4208187820 conn(0x7f79c80d08e0 msgr2=0x7f79c80d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 -- 172.21.15.62:0/4208187820 shutdown_connections 2023-09-30T13:55:37.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.486+0000 7f79ccd5a640 1 -- 172.21.15.62:0/4208187820 wait complete. 2023-09-30T13:55:37.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.487+0000 7f79ccd5a640 1 Processor -- start 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.487+0000 7f79ccd5a640 1 -- start start 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 0x7f79c81f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c81554e0 0x7f79c80c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c815ba30 con 0x7f79c80c6e80 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c62b0 con 0x7f79c81554e0 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79ccd5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c5730 con 0x7f79b4003970 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58542/0 (socket says 172.21.15.62:58542) 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 -- 172.21.15.62:0/2385426852 learned_addr learned my addr 172.21.15.62:0/2385426852 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c5d9b640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c81554e0 0x7f79c80c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c659c640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 0x7f79c81f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 -- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 msgr2=0x7f79c81f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 0x7f79c81f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 -- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c81554e0 msgr2=0x7f79c80c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c81554e0 0x7f79c80c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c6d9d640 1 -- 172.21.15.62:0/2385426852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80c5a10 con 0x7f79c80c6e80 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.488+0000 7f79c659c640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 0x7f79c81f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79c6d9d640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f79c8070cf0 tx=0x7f79b800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8017400 con 0x7f79c80c6e80 2023-09-30T13:55:37.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8011040 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8017780 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c80c5cf0 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.489+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c81f3a20 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.490+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c80cf9e0 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.490+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f79b80203b0 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.491+0000 7f79beffd640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 0x7f79a806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.491+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79b80896b0 con 0x7f79c80c6e80 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.491+0000 7f79c659c640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 0x7f79a806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.492+0000 7f79c659c640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 0x7f79a806cff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79c0036000 tx=0x7f79c0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.495+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f79c80cf9e0 con 0x7f79c80c6e80 2023-09-30T13:55:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.674+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79c80cf9e0 con 0x7f79c80c6e80 2023-09-30T13:55:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.675+0000 7f79beffd640 1 -- 172.21.15.62:0/2385426852 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79c80cf9e0 con 0x7f79c80c6e80 2023-09-30T13:55:37.675 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:37.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 msgr2=0x7f79a806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 0x7f79a806cff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79c0036000 tx=0x7f79c0030000 comp rx=0 tx=0).stop 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 msgr2=0x7f79c806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f79c8070cf0 tx=0x7f79b800f4a0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 shutdown_connections 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f79a806ab30 0x7f79a806cff0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79c80c6e80 0x7f79c806e430 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c81554e0 0x7f79c80c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 --2- 172.21.15.62:0/2385426852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b4003970 0x7f79c81f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 >> 172.21.15.62:0/2385426852 conn(0x7f79c80d08e0 msgr2=0x7f79c806f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 shutdown_connections 2023-09-30T13:55:37.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.677+0000 7f79ccd5a640 1 -- 172.21.15.62:0/2385426852 wait complete. 2023-09-30T13:55:37.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:37.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.796+0000 7f8a7f1b0640 1 Processor -- start 2023-09-30T13:55:37.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.796+0000 7f8a7f1b0640 1 -- start start 2023-09-30T13:55:37.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a7815dc60 0x7f8a7806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780cca40 0x7f8a780b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 0x7f8a780cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a780cdb30 con 0x7f8a7815dc60 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a780ccf20 con 0x7f8a780b2240 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7f1b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780cd200 con 0x7f8a780cca40 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7cf4c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a7815dc60 0x7f8a7806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7cf4c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a7815dc60 0x7f8a7806db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60050/0 (socket says 172.21.15.62:60050) 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7cf4c640 1 -- 172.21.15.62:0/2414046771 learned_addr learned my addr 172.21.15.62:0/2414046771 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a7cf4c640 1 -- 172.21.15.62:0/2414046771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780cca40 msgr2=0x7f8a780b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.797+0000 7f8a77fff640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780cca40 0x7f8a780b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780cca40 0x7f8a780b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7d74d640 1 --2- 172.21.15.62:0/2414046771 >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 0x7f8a780cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7cf4c640 1 -- 172.21.15.62:0/2414046771 >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 msgr2=0x7f8a780cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:37.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/2414046771 >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 0x7f8a780cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7cf4c640 1 -- 172.21.15.62:0/2414046771 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a780cd4e0 con 0x7f8a7815dc60 2023-09-30T13:55:37.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7d74d640 1 --2- 172.21.15.62:0/2414046771 >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 0x7f8a780cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.798+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7815dc60 0x7f8a7806db70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a78071dd0 tx=0x7f8a7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634ed9068ddabd7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a777fe640 1 -- 172.21.15.62:0/2414046771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700317e0 con 0x7f8a7815dc60 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a777fe640 1 -- 172.21.15.62:0/2414046771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70031940 con 0x7f8a7815dc60 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a777fe640 1 -- 172.21.15.62:0/2414046771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70031cd0 con 0x7f8a7815dc60 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/2414046771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7815dc60 msgr2=0x7f8a7806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7815dc60 0x7f8a7806db70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a78071dd0 tx=0x7f8a7002b880 comp rx=0 tx=0).stop 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/2414046771 shutdown_connections 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/2414046771 >> v2:172.21.15.135:3300/0 conn(0x7f8a780b2240 0x7f8a780cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780cca40 0x7f8a780b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/2414046771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7815dc60 0x7f8a7806db70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/2414046771 >> 172.21.15.62:0/2414046771 conn(0x7f8a78070970 msgr2=0x7f8a78070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/2414046771 shutdown_connections 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.799+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/2414046771 wait complete. 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.800+0000 7f8a7f1b0640 1 Processor -- start 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.800+0000 7f8a7f1b0640 1 -- start start 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780b2240 0x7f8a780b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 0x7f8a780b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780b3ca0 con 0x7f8a780cca40 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78149d40 con 0x7f8a7815dc60 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a7f1b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780b3020 con 0x7f8a780b2240 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60064/0 (socket says 172.21.15.62:60064) 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.801+0000 7f8a77fff640 1 -- 172.21.15.62:0/1849530530 learned_addr learned my addr 172.21.15.62:0/1849530530 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780b2240 0x7f8a780b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a7d74d640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 0x7f8a780b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 -- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780b2240 msgr2=0x7f8a780b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780b2240 0x7f8a780b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 -- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 msgr2=0x7f8a780b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 0x7f8a780b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 -- 172.21.15.62:0/1849530530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700094d0 con 0x7f8a780cca40 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a7d74d640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 0x7f8a780b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a77fff640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800ce10 tx=0x7f8a6800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68003b90 con 0x7f8a780cca40 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68003cf0 con 0x7f8a780cca40 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68003ea0 con 0x7f8a780cca40 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a780b3300 con 0x7f8a780cca40 2023-09-30T13:55:37.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.802+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a780b38c0 con 0x7f8a780cca40 2023-09-30T13:55:37.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.803+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a780666d0 con 0x7f8a780cca40 2023-09-30T13:55:37.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.804+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8a68004240 con 0x7f8a780cca40 2023-09-30T13:55:37.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.804+0000 7f8a757fa640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 0x7f8a5806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:37.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.804+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a68012070 con 0x7f8a780cca40 2023-09-30T13:55:37.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.804+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 0x7f8a5806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:37.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.805+0000 7f8a7cf4c640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 0x7f8a5806cff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a70036000 tx=0x7f8a7003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:37.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.808+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8a68054e10 con 0x7f8a780cca40 2023-09-30T13:55:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.982+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a7804e0d0 con 0x7f8a780cca40 2023-09-30T13:55:37.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.983+0000 7f8a757fa640 1 -- 172.21.15.62:0/1849530530 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a68058430 con 0x7f8a780cca40 2023-09-30T13:55:37.983 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 msgr2=0x7f8a5806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 0x7f8a5806cff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a70036000 tx=0x7f8a7003d040 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 msgr2=0x7f8a781f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800ce10 tx=0x7f8a6800a660 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 shutdown_connections 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a5806ab30 0x7f8a5806cff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7815dc60 0x7f8a780b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a780cca40 0x7f8a781f18c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 --2- 172.21.15.62:0/1849530530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a780b2240 0x7f8a780b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:37.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 >> 172.21.15.62:0/1849530530 conn(0x7f8a78070970 msgr2=0x7f8a780afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 shutdown_connections 2023-09-30T13:55:37.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:37.985+0000 7f8a7f1b0640 1 -- 172.21.15.62:0/1849530530 wait complete. 2023-09-30T13:55:37.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.104+0000 7f22b9bb0640 1 Processor -- start 2023-09-30T13:55:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.104+0000 7f22b9bb0640 1 -- start start 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b9bb0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 0x7f22b40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b9bb0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22b40b0e60 0x7f22b40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b9bb0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40af960 con 0x7f22b41599f0 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b9bb0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b406c390 con 0x7f22b40b0e60 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b9bb0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b406c670 con 0x7f22b4159610 2023-09-30T13:55:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22b40b0e60 0x7f22b40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f22b40b0e60 0x7f22b40b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60078/0 (socket says 172.21.15.62:60078) 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 -- 172.21.15.62:0/3597020318 learned_addr learned my addr 172.21.15.62:0/3597020318 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b37fe640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 0x7f22b40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 -- 172.21.15.62:0/3597020318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 msgr2=0x7f22b40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 0x7f22b40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 -- 172.21.15.62:0/3597020318 >> v1:172.21.15.135:6789/0 conn(0x7f22b41599f0 legacy=0x7f22b40af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b3fff640 1 -- 172.21.15.62:0/3597020318 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b406c950 con 0x7f22b40b0e60 2023-09-30T13:55:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.105+0000 7f22b37fe640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 0x7f22b40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.106+0000 7f22b3fff640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b40b0e60 0x7f22b40b02c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e50 tx=0x7f22ac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab473ed8f7f7bfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.106+0000 7f22b27fc640 1 -- 172.21.15.62:0/3597020318 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac02c9e0 con 0x7f22b40b0e60 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.106+0000 7f22b27fc640 1 -- 172.21.15.62:0/3597020318 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac02cb40 con 0x7f22b40b0e60 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.106+0000 7f22b27fc640 1 -- 172.21.15.62:0/3597020318 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0343f0 con 0x7f22b40b0e60 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 -- 172.21.15.62:0/3597020318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b40b0e60 msgr2=0x7f22b40b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b40b0e60 0x7f22b40b02c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e50 tx=0x7f22ac02be40 comp rx=0 tx=0).stop 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 -- 172.21.15.62:0/3597020318 shutdown_connections 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b40b0e60 0x7f22b40b02c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/3597020318 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b4159610 0x7f22b40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 -- 172.21.15.62:0/3597020318 >> 172.21.15.62:0/3597020318 conn(0x7f22b40cb720 msgr2=0x7f22b40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 -- 172.21.15.62:0/3597020318 shutdown_connections 2023-09-30T13:55:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.107+0000 7f22b9bb0640 1 -- 172.21.15.62:0/3597020318 wait complete. 2023-09-30T13:55:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.108+0000 7f22b9bb0640 1 Processor -- start 2023-09-30T13:55:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.108+0000 7f22b9bb0640 1 -- start start 2023-09-30T13:55:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b40b0e60 0x7f22b415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 0x7f22b415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4158a70 con 0x7f22b4159610 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415b610 con 0x7f22b41599f0 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b9bb0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40b3740 con 0x7f22b40b0e60 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60092/0 (socket says 172.21.15.62:60092) 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 -- 172.21.15.62:0/600497210 learned_addr learned my addr 172.21.15.62:0/600497210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b37fe640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b40b0e60 0x7f22b415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b3fff640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 0x7f22b415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 -- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b40b0e60 msgr2=0x7f22b415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b40b0e60 0x7f22b415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 -- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 msgr2=0x7f22b415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 0x7f22b415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 -- 172.21.15.62:0/600497210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009b30 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b3fff640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 0x7f22b415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.109+0000 7f22b2ffd640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c400 tx=0x7f22a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.110+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011790 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.110+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8011930 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.110+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b4158790 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.110+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011ce0 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.110+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40b3380 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.111+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b40b3510 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.111+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f22a801c460 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.111+0000 7f229bfff640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 0x7f22a006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.112+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22a80894f0 con 0x7f22b4159610 2023-09-30T13:55:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.112+0000 7f22b37fe640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 0x7f22a006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.112+0000 7f22b37fe640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 0x7f22a006cff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22b406ae40 tx=0x7f22a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.116+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f22a8054410 con 0x7f22b4159610 2023-09-30T13:55:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.291+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22b415baf0 con 0x7f22b4159610 2023-09-30T13:55:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.292+0000 7f229bfff640 1 -- 172.21.15.62:0/600497210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22b415baf0 con 0x7f22b4159610 2023-09-30T13:55:38.291 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 msgr2=0x7f22a006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 0x7f22a006cff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22b406ae40 tx=0x7f22a4008040 comp rx=0 tx=0).stop 2023-09-30T13:55:38.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 msgr2=0x7f22b4152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c400 tx=0x7f22a800c8c0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 shutdown_connections 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f22a006ab30 0x7f22a006cff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22b41599f0 0x7f22b415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4159610 0x7f22b4152cf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 --2- 172.21.15.62:0/600497210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22b40b0e60 0x7f22b415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.293+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 >> 172.21.15.62:0/600497210 conn(0x7f22b40cb720 msgr2=0x7f22b406ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.294+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 shutdown_connections 2023-09-30T13:55:38.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.294+0000 7f22b9bb0640 1 -- 172.21.15.62:0/600497210 wait complete. 2023-09-30T13:55:38.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.413+0000 7fe3bdfc9640 1 Processor -- start 2023-09-30T13:55:38.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.413+0000 7fe3bdfc9640 1 -- start start 2023-09-30T13:55:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3bdfc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3b815cbc0 0x7fe3b80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3bdfc9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80d1410 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3bdfc9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80d16f0 con 0x7fe3b80b8760 2023-09-30T13:55:38.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3bdfc9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b80d19d0 con 0x7fe3b815cbc0 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3b77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3b815cbc0 0x7fe3b80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3b77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3b815cbc0 0x7fe3b80d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60094/0 (socket says 172.21.15.62:60094) 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.414+0000 7fe3b77fe640 1 -- 172.21.15.62:0/3515824449 learned_addr learned my addr 172.21.15.62:0/3515824449 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.415+0000 7fe3b77fe640 1 -- 172.21.15.62:0/3515824449 >> v1:172.21.15.135:6789/0 conn(0x7fe3b80b8760 legacy=0x7fe3b80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.415+0000 7fe3b77fe640 1 -- 172.21.15.62:0/3515824449 >> v1:172.21.15.62:6789/0 conn(0x7fe3b80cd8c0 legacy=0x7fe3b80b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.415+0000 7fe3b77fe640 1 -- 172.21.15.62:0/3515824449 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80d1cb0 con 0x7fe3b815cbc0 2023-09-30T13:55:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3b77fe640 1 --2- 172.21.15.62:0/3515824449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b815cbc0 0x7fe3b80d24b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009870 tx=0x7fe3a802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb6108c4b1c8585 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3b67fc640 1 -- 172.21.15.62:0/3515824449 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a802f840 con 0x7fe3b815cbc0 2023-09-30T13:55:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3b67fc640 1 -- 172.21.15.62:0/3515824449 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a802f9a0 con 0x7fe3b815cbc0 2023-09-30T13:55:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3b67fc640 1 -- 172.21.15.62:0/3515824449 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a802fd30 con 0x7fe3b815cbc0 2023-09-30T13:55:38.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/3515824449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b815cbc0 msgr2=0x7fe3b80d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/3515824449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b815cbc0 0x7fe3b80d24b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009870 tx=0x7fe3a802ba20 comp rx=0 tx=0).stop 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/3515824449 shutdown_connections 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/3515824449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b815cbc0 0x7fe3b80d24b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/3515824449 >> 172.21.15.62:0/3515824449 conn(0x7fe3b80718a0 msgr2=0x7fe3b8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/3515824449 shutdown_connections 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.416+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/3515824449 wait complete. 2023-09-30T13:55:38.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.418+0000 7fe3bdfc9640 1 Processor -- start 2023-09-30T13:55:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.418+0000 7fe3bdfc9640 1 -- start start 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b80b8760 0x7fe3b8154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b815cbc0 0x7fe3b81f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b81487b0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80ccaa0 con 0x7fe3b815cbc0 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b81f2210 con 0x7fe3b80b8760 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60104/0 (socket says 172.21.15.62:60104) 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 -- 172.21.15.62:0/4272087268 learned_addr learned my addr 172.21.15.62:0/4272087268 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b77fe640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b80b8760 0x7fe3b8154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b7fff640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b815cbc0 0x7fe3b81f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 -- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b80b8760 msgr2=0x7fe3b8154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b80b8760 0x7fe3b8154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 -- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b815cbc0 msgr2=0x7fe3b81f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b815cbc0 0x7fe3b81f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 -- 172.21.15.62:0/4272087268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a80094d0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3b6ffd640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c430 tx=0x7fe3ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0052d0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac005430 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b8154dd0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003830 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.419+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b80c9cf0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.420+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b804e0d0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.421+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe3ac003990 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.421+0000 7fe39ffff640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 0x7fe3a406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.421+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3ac088a10 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.421+0000 7fe3b77fe640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 0x7fe3a406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.422+0000 7fe3b77fe640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 0x7fe3a406cff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036000 tx=0x7fe3a8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.426+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe3ac0539e0 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.605+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe3b815c390 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.605+0000 7fe39ffff640 1 -- 172.21.15.62:0/4272087268 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe3ac017020 con 0x7fe3b80cd8c0 2023-09-30T13:55:38.605 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.607+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 msgr2=0x7fe3a406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.607+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 0x7fe3a406cff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8036000 tx=0x7fe3a8008030 comp rx=0 tx=0).stop 2023-09-30T13:55:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.607+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 msgr2=0x7fe3b80cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.607+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c430 tx=0x7fe3ac00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 shutdown_connections 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe3a406ab30 0x7fe3a406cff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3b815cbc0 0x7fe3b81f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3b80cd8c0 0x7fe3b80cc560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 --2- 172.21.15.62:0/4272087268 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3b80b8760 0x7fe3b8154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 >> 172.21.15.62:0/4272087268 conn(0x7fe3b80718a0 msgr2=0x7fe3b80d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 shutdown_connections 2023-09-30T13:55:38.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.608+0000 7fe3bdfc9640 1 -- 172.21.15.62:0/4272087268 wait complete. 2023-09-30T13:55:38.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:38.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.726+0000 7f88e0461640 1 Processor -- start 2023-09-30T13:55:38.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.726+0000 7f88e0461640 1 -- start start 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88e0461640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88d81568d0 0x7f88d80ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88e0461640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 0x7f88d80c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88e0461640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d8159890 con 0x7f88d80ca070 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88e0461640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d806cee0 con 0x7f88d81568d0 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88e0461640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d8159b70 con 0x7f88d8156cb0 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88d81568d0 0x7f88d80ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88d81568d0 0x7f88d80ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60120/0 (socket says 172.21.15.62:60120) 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 -- 172.21.15.62:0/1971400364 learned_addr learned my addr 172.21.15.62:0/1971400364 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88dd9fc640 1 --2- 172.21.15.62:0/1971400364 >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 0x7f88d80c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 -- 172.21.15.62:0/1971400364 >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 msgr2=0x7f88d80c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 --2- 172.21.15.62:0/1971400364 >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 0x7f88d80c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 -- 172.21.15.62:0/1971400364 >> v1:172.21.15.135:6789/0 conn(0x7f88d80ca070 legacy=0x7f88d806c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88de1fd640 1 -- 172.21.15.62:0/1971400364 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8159e50 con 0x7f88d81568d0 2023-09-30T13:55:38.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.727+0000 7f88dd9fc640 1 --2- 172.21.15.62:0/1971400364 >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 0x7f88d80c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:38.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.728+0000 7f88de1fd640 1 --2- 172.21.15.62:0/1971400364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80ccdf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f88d80cd330 tx=0x7f88d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb0d3009d16efc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.728+0000 7f88dd1fb640 1 -- 172.21.15.62:0/1971400364 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4030860 con 0x7f88d81568d0 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.728+0000 7f88dd1fb640 1 -- 172.21.15.62:0/1971400364 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40309c0 con 0x7f88d81568d0 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.728+0000 7f88dd1fb640 1 -- 172.21.15.62:0/1971400364 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4030d50 con 0x7f88d81568d0 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 -- 172.21.15.62:0/1971400364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 msgr2=0x7f88d80ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 --2- 172.21.15.62:0/1971400364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80ccdf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f88d80cd330 tx=0x7f88d402b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 -- 172.21.15.62:0/1971400364 shutdown_connections 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 --2- 172.21.15.62:0/1971400364 >> v2:172.21.15.135:3300/0 conn(0x7f88d8156cb0 0x7f88d80c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 --2- 172.21.15.62:0/1971400364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80ccdf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 -- 172.21.15.62:0/1971400364 >> 172.21.15.62:0/1971400364 conn(0x7f88d806a430 msgr2=0x7f88d806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 -- 172.21.15.62:0/1971400364 shutdown_connections 2023-09-30T13:55:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.729+0000 7f88e0461640 1 -- 172.21.15.62:0/1971400364 wait complete. 2023-09-30T13:55:38.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.730+0000 7f88e0461640 1 Processor -- start 2023-09-30T13:55:38.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.730+0000 7f88e0461640 1 -- start start 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 0x7f88d80c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8156cb0 0x7f88d8154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d81f12f0 con 0x7f88d81568d0 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80b41c0 con 0x7f88d8156cb0 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88e0461640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d81f0670 con 0x7f88d80ca070 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60136/0 (socket says 172.21.15.62:60136) 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 -- 172.21.15.62:0/3660203641 learned_addr learned my addr 172.21.15.62:0/3660203641 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88de9fe640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8156cb0 0x7f88d8154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88de1fd640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 0x7f88d80c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 -- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 msgr2=0x7f88d80c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 0x7f88d80c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 -- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8156cb0 msgr2=0x7f88d8154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8156cb0 0x7f88d8154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 -- 172.21.15.62:0/3660203641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d40094d0 con 0x7f88d81568d0 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88de1fd640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 0x7f88d80c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.731+0000 7f88dd9fc640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88c800d7d0 tx=0x7f88c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8004030 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c8004190 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8004520 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d81f0950 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d81f0f10 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.732+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8073e70 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.733+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f88c800b6c0 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.733+0000 7f88ceffd640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 0x7f88bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.733+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f88c8089610 con 0x7f88d81568d0 2023-09-30T13:55:38.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.734+0000 7f88de1fd640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 0x7f88bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:38.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.734+0000 7f88de1fd640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 0x7f88bc06cff0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88d4036000 tx=0x7f88d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:38.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.738+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f88c8054530 con 0x7f88d81568d0 2023-09-30T13:55:38.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.926+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88d80b4460 con 0x7f88d81568d0 2023-09-30T13:55:38.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.926+0000 7f88ceffd640 1 -- 172.21.15.62:0/3660203641 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88c8057b50 con 0x7f88d81568d0 2023-09-30T13:55:38.926 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:38.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 msgr2=0x7f88bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 0x7f88bc06cff0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88d4036000 tx=0x7f88d4008030 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 msgr2=0x7f88d80b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88c800d7d0 tx=0x7f88c800dc90 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 shutdown_connections 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88bc06ab30 0x7f88bc06cff0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8156cb0 0x7f88d8154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88d81568d0 0x7f88d80b3c80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 --2- 172.21.15.62:0/3660203641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88d80ca070 0x7f88d80c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 >> 172.21.15.62:0/3660203641 conn(0x7f88d806a430 msgr2=0x7f88d8151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 shutdown_connections 2023-09-30T13:55:38.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:38.928+0000 7f88e0461640 1 -- 172.21.15.62:0/3660203641 wait complete. 2023-09-30T13:55:38.938 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:55:38.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:38.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T13:55:38.969 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:38.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:55:38.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:38.969 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T13:55:39.025 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:39.025 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:39.044 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:39.044 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:39.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:39.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.209+0000 7f9e888bb640 1 Processor -- start 2023-09-30T13:55:39.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.209+0000 7f9e888bb640 1 -- start start 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e888bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e840b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e888bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8415b9a0 con 0x7f9e840b31c0 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e888bb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840cc950 con 0x7f9e840ace50 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e888bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b2e50 con 0x7f9e840cf140 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e82d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9e840b31c0 0x7f9e840ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45882/0 (socket says 172.21.15.62:45882) 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e82d9d640 1 -- 172.21.15.62:0/774753330 learned_addr learned my addr 172.21.15.62:0/774753330 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e81d9b640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e840b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402781574 0 0) 0x7f9e8415b9a0 con 0x7f9e840b31c0 2023-09-30T13:55:39.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c003520 con 0x7f9e840b31c0 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716619761 0 0) 0x7f9e6c003520 con 0x7f9e840b31c0 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 msgr2=0x7f9e840b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e840b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 >> v1:172.21.15.135:6789/0 conn(0x7f9e840ace50 legacy=0x7f9e840cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8415add0 con 0x7f9e840b31c0 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f9e7c0019f0 con 0x7f9e840b31c0 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.210+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 >> v1:172.21.15.62:6789/0 conn(0x7f9e840b31c0 legacy=0x7f9e840ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0039a0 0x7f9e6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b2e50 con 0x7f9e6c004d00 2023-09-30T13:55:39.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00bab0 con 0x7f9e6c0039a0 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00bc70 con 0x7f9e840cf140 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e8259c640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0039a0 0x7f9e6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e81d9b640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 -- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 msgr2=0x7f9e6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 -- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0039a0 msgr2=0x7f9e6c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0039a0 0x7f9e6c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e82d9d640 1 -- 172.21.15.62:0/774753330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c003520 con 0x7f9e6c004d00 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.211+0000 7f9e81d9b640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840cf140 0x7f9e6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:39.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00a7f0 tx=0x7f9e6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3fcf62af9303eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0072d0 con 0x7f9e6c004d00 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c02f070 con 0x7f9e6c004d00 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e8159a640 1 -- 172.21.15.62:0/774753330 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0076b0 con 0x7f9e6c004d00 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 -- 172.21.15.62:0/774753330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e6c004d00 msgr2=0x7f9e6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 --2- 172.21.15.62:0/774753330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00a7f0 tx=0x7f9e6c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e82d9d640 1 -- 172.21.15.62:0/774753330 reap_dead start 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 -- 172.21.15.62:0/774753330 shutdown_connections 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 -- 172.21.15.62:0/774753330 >> 172.21.15.62:0/774753330 conn(0x7f9e8406a170 msgr2=0x7f9e8406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 -- 172.21.15.62:0/774753330 shutdown_connections 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.212+0000 7f9e888bb640 1 -- 172.21.15.62:0/774753330 wait complete. 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 Processor -- start 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 -- start start 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c004d00 0x7f9e8409bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840b0700 0x7f9e840b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e841f0a40 con 0x7f9e841f0080 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840b0270 con 0x7f9e6c004d00 2023-09-30T13:55:39.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.214+0000 7f9e888bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840af660 con 0x7f9e840b0700 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60154/0 (socket says 172.21.15.62:60154) 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 -- 172.21.15.62:0/5783109 learned_addr learned my addr 172.21.15.62:0/5783109 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e8259c640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c004d00 0x7f9e8409bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 -- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840b0700 msgr2=0x7f9e840b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840b0700 0x7f9e840b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 -- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c004d00 msgr2=0x7f9e8409bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c004d00 0x7f9e8409bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 -- 172.21.15.62:0/5783109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840af940 con 0x7f9e841f0080 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e82d9d640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00a7f0 tx=0x7f9e840cc8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c004d60 con 0x7f9e841f0080 2023-09-30T13:55:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c001250 con 0x7f9e841f0080 2023-09-30T13:55:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0072d0 con 0x7f9e841f0080 2023-09-30T13:55:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840afc20 con 0x7f9e841f0080 2023-09-30T13:55:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.215+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8409c100 con 0x7f9e841f0080 2023-09-30T13:55:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.216+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840b0400 con 0x7f9e841f0080 2023-09-30T13:55:39.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.217+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9e7c031030 con 0x7f9e841f0080 2023-09-30T13:55:39.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.217+0000 7f9e72ffd640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 0x7f9e6406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.217+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e7c0aa6f0 con 0x7f9e841f0080 2023-09-30T13:55:39.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.217+0000 7f9e8259c640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 0x7f9e6406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.218+0000 7f9e8259c640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 0x7f9e6406cff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.221+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9e7c075610 con 0x7f9e841f0080 2023-09-30T13:55:39.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.399+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e840b0400 con 0x7f9e841f0080 2023-09-30T13:55:39.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.401+0000 7f9e72ffd640 1 -- 172.21.15.62:0/5783109 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f9e7c078c30 con 0x7f9e841f0080 2023-09-30T13:55:39.401 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:39.401 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:39.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 msgr2=0x7f9e6406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 0x7f9e6406cff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 msgr2=0x7f9e841f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00a7f0 tx=0x7f9e840cc8c0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 shutdown_connections 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e6406ab30 0x7f9e6406cff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e841f0080 0x7f9e841f0500 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e840b0700 0x7f9e840b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 --2- 172.21.15.62:0/5783109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c004d00 0x7f9e8409bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 >> 172.21.15.62:0/5783109 conn(0x7f9e8406a170 msgr2=0x7f9e840b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:39.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 shutdown_connections 2023-09-30T13:55:39.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.403+0000 7f9e888bb640 1 -- 172.21.15.62:0/5783109 wait complete. 2023-09-30T13:55:39.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:39.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:39.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.524+0000 7f9e72b05640 1 Processor -- start 2023-09-30T13:55:39.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.524+0000 7f9e72b05640 1 -- start start 2023-09-30T13:55:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e72b05640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9e6c1599f0 0x7f9e6c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e72b05640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0af960 con 0x7f9e6c159610 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e72b05640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c06c390 con 0x7f9e6c0b0e60 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e72b05640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c06c670 con 0x7f9e6c1599f0 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e708a1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9e6c159610 0x7f9e6c0af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45884/0 (socket says 172.21.15.62:45884) 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e708a1640 1 -- 172.21.15.62:0/4186647187 learned_addr learned my addr 172.21.15.62:0/4186647187 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.525+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243035793 0 0) 0x7f9e6c0af960 con 0x7f9e6c159610 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e5c003520 con 0x7f9e6c159610 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/4186647187 >> v2:172.21.15.135:3300/0 conn(0x7f9e6c1599f0 0x7f9e6c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3484953717 0 0) 0x7f9e5c003520 con 0x7f9e6c159610 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 >> v2:172.21.15.135:3300/0 conn(0x7f9e6c1599f0 msgr2=0x7f9e6c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 --2- 172.21.15.62:0/4186647187 >> v2:172.21.15.135:3300/0 conn(0x7f9e6c1599f0 0x7f9e6c0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 >> v1:172.21.15.135:6789/0 conn(0x7f9e6c0b0e60 legacy=0x7f9e6c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c06c950 con 0x7f9e6c159610 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f9e60001670 con 0x7f9e6c159610 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 >> v1:172.21.15.62:6789/0 conn(0x7f9e6c159610 legacy=0x7f9e6c0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e5c003970 0x7f9e5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e5c005180 0x7f9e5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c06c670 con 0x7f9e5c0047c0 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c00c120 con 0x7f9e5c005180 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c00c2e0 con 0x7f9e5c003970 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e708a1640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e5c003970 0x7f9e5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e710a2640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e5c005180 0x7f9e5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 -- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e5c003970 msgr2=0x7f9e5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e5c003970 0x7f9e5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 -- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e5c005180 msgr2=0x7f9e5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e5c005180 0x7f9e5c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e710a2640 1 -- 172.21.15.62:0/4186647187 reap_dead start 2023-09-30T13:55:39.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.526+0000 7f9e6bfff640 1 -- 172.21.15.62:0/4186647187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c003520 con 0x7f9e5c0047c0 2023-09-30T13:55:39.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e5c004c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009ac0 tx=0x7f9e5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b265053442e022db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5802c6b0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5802c810 con 0x7f9e5c0047c0 2023-09-30T13:55:39.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e6b7fe640 1 -- 172.21.15.62:0/4186647187 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5802cba0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 -- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 msgr2=0x7f9e5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e5c004c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009ac0 tx=0x7f9e5c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 -- 172.21.15.62:0/4186647187 shutdown_connections 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 --2- 172.21.15.62:0/4186647187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e5c004c40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 -- 172.21.15.62:0/4186647187 >> 172.21.15.62:0/4186647187 conn(0x7f9e6c0cb720 msgr2=0x7f9e6c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 -- 172.21.15.62:0/4186647187 shutdown_connections 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.528+0000 7f9e72b05640 1 -- 172.21.15.62:0/4186647187 wait complete. 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 Processor -- start 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 -- start start 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e6c15c2e0 0x7f9e6c0703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0ab8c0 0x7f9e6c0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15d790 con 0x7f9e5c0047c0 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15cb10 con 0x7f9e6c0ab8c0 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.530+0000 7f9e72b05640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15cdf0 con 0x7f9e6c15c2e0 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60166/0 (socket says 172.21.15.62:60166) 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 -- 172.21.15.62:0/1203405548 learned_addr learned my addr 172.21.15.62:0/1203405548 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 -- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e6c15c2e0 msgr2=0x7f9e6c0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e6c15c2e0 0x7f9e6c0703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 -- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0ab8c0 msgr2=0x7f9e6c0abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0ab8c0 0x7f9e6c0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 -- 172.21.15.62:0/1203405548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c15d0d0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e708a1640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007290 tx=0x7f9e60007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000f980 con 0x7f9e5c0047c0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000fb00 con 0x7f9e5c0047c0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c15d3b0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000feb0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.531+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c0708f0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.532+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c04e0d0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.533+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9e6001d460 con 0x7f9e5c0047c0 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.533+0000 7f9e697fa640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 0x7f9e5006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.533+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e60089810 con 0x7f9e5c0047c0 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.534+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 0x7f9e5006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.534+0000 7f9e6bfff640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 0x7f9e5006d020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e58036000 tx=0x7f9e5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.537+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9e60054730 con 0x7f9e5c0047c0 2023-09-30T13:55:39.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.713+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e6c15dab0 con 0x7f9e5c0047c0 2023-09-30T13:55:39.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.714+0000 7f9e697fa640 1 -- 172.21.15.62:0/1203405548 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e60057d50 con 0x7f9e5c0047c0 2023-09-30T13:55:39.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 msgr2=0x7f9e5006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 0x7f9e5006d020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e58036000 tx=0x7f9e5802e000 comp rx=0 tx=0).stop 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 msgr2=0x7f9e6c157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007290 tx=0x7f9e60007690 comp rx=0 tx=0).stop 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 shutdown_connections 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e5006ab60 0x7f9e5006d020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e6c0ab8c0 0x7f9e6c0abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e6c15c2e0 0x7f9e6c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 --2- 172.21.15.62:0/1203405548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e5c0047c0 0x7f9e6c157680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 >> 172.21.15.62:0/1203405548 conn(0x7f9e6c0cb720 msgr2=0x7f9e6c1562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 shutdown_connections 2023-09-30T13:55:39.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.716+0000 7f9e72b05640 1 -- 172.21.15.62:0/1203405548 wait complete. 2023-09-30T13:55:39.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:39.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.838+0000 7f6a59861640 1 Processor -- start 2023-09-30T13:55:39.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.838+0000 7f6a59861640 1 -- start start 2023-09-30T13:55:39.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a59861640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a5415ade0 0x7f6a54071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a59861640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5406a640 con 0x7f6a5406bae0 2023-09-30T13:55:39.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a59861640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5415b1c0 con 0x7f6a5406ed30 2023-09-30T13:55:39.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a59861640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5415f6d0 con 0x7f6a5415ade0 2023-09-30T13:55:39.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a537fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6a5406bae0 0x7f6a5415efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45896/0 (socket says 172.21.15.62:45896) 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a537fe640 1 -- 172.21.15.62:0/477914683 learned_addr learned my addr 172.21.15.62:0/477914683 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a52ffd640 1 --2- 172.21.15.62:0/477914683 >> v2:172.21.15.135:3300/0 conn(0x7f6a5415ade0 0x7f6a54071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188950471 0 0) 0x7f6a5406a640 con 0x7f6a5406bae0 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.839+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a40003520 con 0x7f6a5406bae0 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.840+0000 7f6a52ffd640 1 -- 172.21.15.62:0/477914683 >> v1:172.21.15.135:6789/0 conn(0x7f6a5406ed30 legacy=0x7f6a5415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.840+0000 7f6a52ffd640 1 -- 172.21.15.62:0/477914683 >> v1:172.21.15.62:6789/0 conn(0x7f6a5406bae0 legacy=0x7f6a5415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.840+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967411551 0 0) 0x7f6a5415b1c0 con 0x7f6a5406ed30 2023-09-30T13:55:39.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.840+0000 7f6a52ffd640 1 -- 172.21.15.62:0/477914683 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540ca540 con 0x7f6a5415ade0 2023-09-30T13:55:39.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.841+0000 7f6a52ffd640 1 --2- 172.21.15.62:0/477914683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5415ade0 0x7f6a54071b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86df46cf3dc8bab9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.841+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44030610 con 0x7f6a5415ade0 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.841+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44030770 con 0x7f6a5415ade0 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.841+0000 7f6a527fc640 1 -- 172.21.15.62:0/477914683 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44030b00 con 0x7f6a5415ade0 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 -- 172.21.15.62:0/477914683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5415ade0 msgr2=0x7f6a54071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 --2- 172.21.15.62:0/477914683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5415ade0 0x7f6a54071b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097a0 tx=0x7f6a4402b960 comp rx=0 tx=0).stop 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 -- 172.21.15.62:0/477914683 shutdown_connections 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 --2- 172.21.15.62:0/477914683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5415ade0 0x7f6a54071b80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 -- 172.21.15.62:0/477914683 >> 172.21.15.62:0/477914683 conn(0x7f6a540cc180 msgr2=0x7f6a540cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 -- 172.21.15.62:0/477914683 shutdown_connections 2023-09-30T13:55:39.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.842+0000 7f6a59861640 1 -- 172.21.15.62:0/477914683 wait complete. 2023-09-30T13:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.844+0000 7f6a59861640 1 Processor -- start 2023-09-30T13:55:39.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.844+0000 7f6a59861640 1 -- start start 2023-09-30T13:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5406bae0 0x7f6a54146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a5415ade0 0x7f6a540c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540c8180 con 0x7f6a5406ed30 2023-09-30T13:55:39.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54146a60 con 0x7f6a5406bae0 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a59861640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541f6ab0 con 0x7f6a5415ade0 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60176/0 (socket says 172.21.15.62:60176) 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 -- 172.21.15.62:0/589155373 learned_addr learned my addr 172.21.15.62:0/589155373 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a52ffd640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5406bae0 0x7f6a54146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a537fe640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a5415ade0 0x7f6a540c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 -- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a5415ade0 msgr2=0x7f6a540c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a5415ade0 0x7f6a540c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 -- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5406bae0 msgr2=0x7f6a54146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5406bae0 0x7f6a54146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:39.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 -- 172.21.15.62:0/589155373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44009400 con 0x7f6a5406ed30 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.845+0000 7f6a4a7fc640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c410 tx=0x7f6a3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.846+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0035f0 con 0x7f6a5406ed30 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.846+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c003770 con 0x7f6a5406ed30 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.846+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a540ae1c0 con 0x7f6a5406ed30 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.846+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c003b20 con 0x7f6a5406ed30 2023-09-30T13:55:39.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.846+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a540adeb0 con 0x7f6a5406ed30 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.847+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540c7ee0 con 0x7f6a5406ed30 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.847+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6a3c003c80 con 0x7f6a5406ed30 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.848+0000 7f6a50ff9640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 0x7f6a3406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.848+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a3c088b60 con 0x7f6a5406ed30 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.848+0000 7f6a52ffd640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 0x7f6a3406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:39.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.849+0000 7f6a52ffd640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 0x7f6a3406cff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a44036000 tx=0x7f6a44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:39.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:39.852+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6a540c7ee0 con 0x7f6a5406ed30 2023-09-30T13:55:40.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.029+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a540c82c0 con 0x7f6a5406ed30 2023-09-30T13:55:40.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.029+0000 7f6a50ff9640 1 -- 172.21.15.62:0/589155373 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a540c82c0 con 0x7f6a5406ed30 2023-09-30T13:55:40.029 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:40.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 msgr2=0x7f6a3406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 0x7f6a3406cff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a44036000 tx=0x7f6a44008030 comp rx=0 tx=0).stop 2023-09-30T13:55:40.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 msgr2=0x7f6a540b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c410 tx=0x7f6a3c00c8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 shutdown_connections 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6a3406ab30 0x7f6a3406cff0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a5415ade0 0x7f6a540c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5406ed30 0x7f6a540b4460 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 --2- 172.21.15.62:0/589155373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a5406bae0 0x7f6a54146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 >> 172.21.15.62:0/589155373 conn(0x7f6a540cc180 msgr2=0x7f6a540cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.031+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 shutdown_connections 2023-09-30T13:55:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.032+0000 7f6a59861640 1 -- 172.21.15.62:0/589155373 wait complete. 2023-09-30T13:55:40.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.153+0000 7f46ee189640 1 Processor -- start 2023-09-30T13:55:40.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.153+0000 7f46ee189640 1 -- start start 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46ee189640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46e80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46ee189640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e80b2bf0 con 0x7f46e8158fe0 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46ee189640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e81593c0 con 0x7f46e80adb70 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46ee189640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e815d9f0 con 0x7f46e8070770 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46e77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f46e8158fe0 0x7f46e8070060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45902/0 (socket says 172.21.15.62:45902) 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.154+0000 7f46e77fe640 1 -- 172.21.15.62:0/1299734103 learned_addr learned my addr 172.21.15.62:0/1299734103 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e7fff640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46e80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034952242 0 0) 0x7f46e80b2bf0 con 0x7f46e8158fe0 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d4005730 con 0x7f46e8158fe0 2023-09-30T13:55:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058316434 0 0) 0x7f46d4005730 con 0x7f46e8158fe0 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 msgr2=0x7f46e80b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46e80b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 >> v1:172.21.15.135:6789/0 conn(0x7f46e80adb70 legacy=0x7f46e80b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80b22c0 con 0x7f46e8158fe0 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f46d0001670 con 0x7f46e8158fe0 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 >> v1:172.21.15.62:6789/0 conn(0x7f46e8158fe0 legacy=0x7f46e8070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46d4005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46d40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4006f10 0x7f46d4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e815d9f0 con 0x7f46d40060f0 2023-09-30T13:55:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400dbf0 con 0x7f46d4006f10 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400ddb0 con 0x7f46e8070770 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46d40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e77fe640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46d4005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.155+0000 7f46e7fff640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4006f10 0x7f46d4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.156+0000 7f46e6ffd640 1 -- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 msgr2=0x7f46d4005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.156+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8070770 0x7f46d4005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.156+0000 7f46e6ffd640 1 -- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4006f10 msgr2=0x7f46d4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.156+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4006f10 0x7f46d4007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.156+0000 7f46e6ffd640 1 -- 172.21.15.62:0/1299734103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4005730 con 0x7f46d40060f0 2023-09-30T13:55:40.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46d40069d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001910 tx=0x7f46d4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56621397a861d125 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8032600 con 0x7f46d40060f0 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d802e050 con 0x7f46d40060f0 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46e67fc640 1 -- 172.21.15.62:0/1299734103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80329c0 con 0x7f46d40060f0 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46ee189640 1 -- 172.21.15.62:0/1299734103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 msgr2=0x7f46d40069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46ee189640 1 --2- 172.21.15.62:0/1299734103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46d40069d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001910 tx=0x7f46d4007a00 comp rx=0 tx=0).stop 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46e7fff640 1 -- 172.21.15.62:0/1299734103 reap_dead start 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46ee189640 1 -- 172.21.15.62:0/1299734103 shutdown_connections 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.157+0000 7f46ee189640 1 -- 172.21.15.62:0/1299734103 >> 172.21.15.62:0/1299734103 conn(0x7f46e80cb720 msgr2=0x7f46e80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.158+0000 7f46ee189640 1 -- 172.21.15.62:0/1299734103 shutdown_connections 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.158+0000 7f46ee189640 1 -- 172.21.15.62:0/1299734103 wait complete. 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.159+0000 7f46ee189640 1 Processor -- start 2023-09-30T13:55:40.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.160+0000 7f46ee189640 1 -- start start 2023-09-30T13:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46e80ae960 0x7f46e81f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8156e50 0x7f46e81572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81551a0 con 0x7f46d40060f0 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8157810 con 0x7f46e80ae960 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46ee189640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80af1f0 con 0x7f46e8156e50 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60196/0 (socket says 172.21.15.62:60196) 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 -- 172.21.15.62:0/3642826217 learned_addr learned my addr 172.21.15.62:0/3642826217 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e7fff640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8156e50 0x7f46e81572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 -- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8156e50 msgr2=0x7f46e81572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8156e50 0x7f46e81572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 -- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46e80ae960 msgr2=0x7f46e81f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46e80ae960 0x7f46e81f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46e80ae960 0x7f46e81f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 -- 172.21.15.62:0/3642826217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80af4d0 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46e77fe640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46d00011e0 tx=0x7f46d0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.161+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000f960 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.162+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000fb00 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.162+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80af7b0 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.162+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000feb0 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.162+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e81f1ae0 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.163+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e81f1ca0 con 0x7f46d40060f0 2023-09-30T13:55:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.163+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f46d001d460 con 0x7f46d40060f0 2023-09-30T13:55:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.164+0000 7f46dffff640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 0x7f46c806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.164+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46d00897f0 con 0x7f46d40060f0 2023-09-30T13:55:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.164+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 0x7f46c806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.164+0000 7f46e6ffd640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 0x7f46c806cff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46d8034000 tx=0x7f46d8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.168+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f46d00545f0 con 0x7f46d40060f0 2023-09-30T13:55:40.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.346+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46e804e0d0 con 0x7f46d40060f0 2023-09-30T13:55:40.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.347+0000 7f46dffff640 1 -- 172.21.15.62:0/3642826217 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46d0057c10 con 0x7f46d40060f0 2023-09-30T13:55:40.347 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 msgr2=0x7f46c806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 0x7f46c806cff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46d8034000 tx=0x7f46d8009030 comp rx=0 tx=0).stop 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 msgr2=0x7f46e814a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46d00011e0 tx=0x7f46d0007720 comp rx=0 tx=0).stop 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 shutdown_connections 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f46c806ab30 0x7f46c806cff0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46e8156e50 0x7f46e81572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46e80ae960 0x7f46e81f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 --2- 172.21.15.62:0/3642826217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46d40060f0 0x7f46e814a100 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 >> 172.21.15.62:0/3642826217 conn(0x7f46e80cb720 msgr2=0x7f46e80b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 shutdown_connections 2023-09-30T13:55:40.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.349+0000 7f46ee189640 1 -- 172.21.15.62:0/3642826217 wait complete. 2023-09-30T13:55:40.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.469+0000 7f4bb3244640 1 Processor -- start 2023-09-30T13:55:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.469+0000 7f4bb3244640 1 -- start start 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4bac15cbc0 0x7f4bac0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0ce290 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0d1410 con 0x7f4bac15cbc0 2023-09-30T13:55:40.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb3244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0d16f0 con 0x7f4bac0b8760 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60210/0 (socket says 172.21.15.62:60210) 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 -- 172.21.15.62:0/1629571095 learned_addr learned my addr 172.21.15.62:0/1629571095 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb0fe0640 1 --2- 172.21.15.62:0/1629571095 >> v2:172.21.15.135:3300/0 conn(0x7f4bac15cbc0 0x7f4bac0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4ba3fff640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 -- 172.21.15.62:0/1629571095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 msgr2=0x7f4bac0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 -- 172.21.15.62:0/1629571095 >> v2:172.21.15.135:3300/0 conn(0x7f4bac15cbc0 msgr2=0x7f4bac0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 --2- 172.21.15.62:0/1629571095 >> v2:172.21.15.135:3300/0 conn(0x7f4bac15cbc0 0x7f4bac0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4bb17e1640 1 -- 172.21.15.62:0/1629571095 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0d19d0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.470+0000 7f4ba3fff640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.471+0000 7f4bb17e1640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06c070 tx=0x7f4ba402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8f86bed17381e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.471+0000 7f4ba37fe640 1 -- 172.21.15.62:0/1629571095 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba402ca70 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.471+0000 7f4ba37fe640 1 -- 172.21.15.62:0/1629571095 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba402cbd0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.471+0000 7f4ba37fe640 1 -- 172.21.15.62:0/1629571095 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40343f0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 -- 172.21.15.62:0/1629571095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 msgr2=0x7f4bac0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06c070 tx=0x7f4ba402bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 -- 172.21.15.62:0/1629571095 shutdown_connections 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0cdd50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 --2- 172.21.15.62:0/1629571095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 --2- 172.21.15.62:0/1629571095 >> v2:172.21.15.135:3300/0 conn(0x7f4bac15cbc0 0x7f4bac0d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 -- 172.21.15.62:0/1629571095 >> 172.21.15.62:0/1629571095 conn(0x7f4bac0718a0 msgr2=0x7f4bac071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 -- 172.21.15.62:0/1629571095 shutdown_connections 2023-09-30T13:55:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.472+0000 7f4bb3244640 1 -- 172.21.15.62:0/1629571095 wait complete. 2023-09-30T13:55:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.473+0000 7f4bb3244640 1 Processor -- start 2023-09-30T13:55:40.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.473+0000 7f4bb3244640 1 -- start start 2023-09-30T13:55:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 0x7f4bac0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0b26f0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15e490 con 0x7f4bac15cbc0 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb3244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15dbf0 con 0x7f4bac0b8760 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60222/0 (socket says 172.21.15.62:60222) 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4ba3fff640 1 -- 172.21.15.62:0/2691377138 learned_addr learned my addr 172.21.15.62:0/2691377138 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb0fe0640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.474+0000 7f4bb17e1640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 0x7f4bac0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 -- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 msgr2=0x7f4bac153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 -- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 msgr2=0x7f4bac0b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 0x7f4bac0b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 -- 172.21.15.62:0/2691377138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009b30 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4bb17e1640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 0x7f4bac0b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba3fff640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e810 tx=0x7f4b9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004030 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c004190 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac15ded0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004520 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.475+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac153540 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.476+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac153700 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.477+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4b9c00c6d0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.477+0000 7f4ba17fa640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 0x7f4b9806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.477+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b9c089000 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.477+0000 7f4bb0fe0640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 0x7f4b9806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.478+0000 7f4bb0fe0640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 0x7f4b9806cff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009aa0 tx=0x7f4ba8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.481+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4b9c053fd0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.657+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4bac04e0d0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.657+0000 7f4ba17fa640 1 -- 172.21.15.62:0/2691377138 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4b9c0575f0 con 0x7f4bac0cd8c0 2023-09-30T13:55:40.657 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 msgr2=0x7f4b9806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 0x7f4b9806cff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009aa0 tx=0x7f4ba8009190 comp rx=0 tx=0).stop 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 msgr2=0x7f4bac0b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e810 tx=0x7f4b9c00ecd0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 shutdown_connections 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4b9806ab30 0x7f4b9806cff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bac15cbc0 0x7f4bac0b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bac0cd8c0 0x7f4bac0b4330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 --2- 172.21.15.62:0/2691377138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bac0b8760 0x7f4bac153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 >> 172.21.15.62:0/2691377138 conn(0x7f4bac0718a0 msgr2=0x7f4bac158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 shutdown_connections 2023-09-30T13:55:40.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.659+0000 7f4bb3244640 1 -- 172.21.15.62:0/2691377138 wait complete. 2023-09-30T13:55:40.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.777+0000 7f0ec506f640 1 Processor -- start 2023-09-30T13:55:40.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.777+0000 7f0ec506f640 1 -- start start 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ec506f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec01605a0 0x7f0ec00d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ec506f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00cf520 con 0x7f0ec01601c0 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ec506f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00caf00 con 0x7f0ec006b780 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ec506f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00ce500 con 0x7f0ec01605a0 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebed9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0ec01601c0 0x7f0ec006b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45918/0 (socket says 172.21.15.62:45918) 2023-09-30T13:55:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebed9d640 1 -- 172.21.15.62:0/3980373168 learned_addr learned my addr 172.21.15.62:0/3980373168 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0eb7fff640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec01605a0 0x7f0ec00d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058152907 0 0) 0x7f0ec00cf520 con 0x7f0ec01601c0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac003520 con 0x7f0ec01601c0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865047358 0 0) 0x7f0eac003520 con 0x7f0ec01601c0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec01605a0 msgr2=0x7f0ec00d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec01605a0 0x7f0ec00d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 >> v1:172.21.15.135:6789/0 conn(0x7f0ec006b780 legacy=0x7f0ec00cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00cf770 con 0x7f0ec01601c0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f0eb0001670 con 0x7f0ec01601c0 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.778+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 >> v1:172.21.15.62:6789/0 conn(0x7f0ec01601c0 legacy=0x7f0ec006b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0eac0039a0 0x7f0eac003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0eac004350 0x7f0eac0047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eac004f40 0x7f0eac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00ce500 con 0x7f0eac004f40 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac005690 con 0x7f0eac0039a0 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac00bf40 con 0x7f0eac004350 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eac004f40 0x7f0eac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebed9d640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0eac0039a0 0x7f0eac003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0eb7fff640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0eac004350 0x7f0eac0047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 -- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0eac004350 msgr2=0x7f0eac0047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0eac004350 0x7f0eac0047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 -- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0eac0039a0 msgr2=0x7f0eac003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0eac0039a0 0x7f0eac003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.779+0000 7f0ebf59e640 1 -- 172.21.15.62:0/3980373168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac003520 con 0x7f0eac004f40 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eac004f40 0x7f0eac00b980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8001f60 tx=0x7f0eac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c32af33767a6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb802d6f0 con 0x7f0eac004f40 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb802d870 con 0x7f0eac004f40 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ebe59c640 1 -- 172.21.15.62:0/3980373168 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb802dc20 con 0x7f0eac004f40 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 -- 172.21.15.62:0/3980373168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eac004f40 msgr2=0x7f0eac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 --2- 172.21.15.62:0/3980373168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0eac004f40 0x7f0eac00b980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8001f60 tx=0x7f0eac0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ebf59e640 1 -- 172.21.15.62:0/3980373168 reap_dead start 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 -- 172.21.15.62:0/3980373168 shutdown_connections 2023-09-30T13:55:40.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 -- 172.21.15.62:0/3980373168 >> 172.21.15.62:0/3980373168 conn(0x7f0ec00d0810 msgr2=0x7f0ec00d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 -- 172.21.15.62:0/3980373168 shutdown_connections 2023-09-30T13:55:40.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.780+0000 7f0ec506f640 1 -- 172.21.15.62:0/3980373168 wait complete. 2023-09-30T13:55:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 Processor -- start 2023-09-30T13:55:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 -- start start 2023-09-30T13:55:40.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec00ca330 0x7f0ec0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec00ca710 0x7f0ec00cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c8210 con 0x7f0ec0157ea0 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0158340 con 0x7f0ec00ca330 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.782+0000 7f0ec506f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c78e0 con 0x7f0ec00ca710 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60250/0 (socket says 172.21.15.62:60250) 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 -- 172.21.15.62:0/2840575897 learned_addr learned my addr 172.21.15.62:0/2840575897 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebed9d640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec00ca330 0x7f0ec0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 -- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec00ca710 msgr2=0x7f0ec00cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec00ca710 0x7f0ec00cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 -- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec00ca330 msgr2=0x7f0ec0157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec00ca330 0x7f0ec0157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 -- 172.21.15.62:0/2840575897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00c7bc0 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ebf59e640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8037040 tx=0x7f0eb80015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb802dea0 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8003b70 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec00c7ea0 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8005070 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.783+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec0158f70 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.784+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec00c8380 con 0x7f0ec0157ea0 2023-09-30T13:55:40.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.785+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0eb80051d0 con 0x7f0ec0157ea0 2023-09-30T13:55:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.785+0000 7f0eb77fe640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 0x7f0ea006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.785+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0eb8031070 con 0x7f0ec0157ea0 2023-09-30T13:55:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.785+0000 7f0ebed9d640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 0x7f0ea006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.786+0000 7f0ebed9d640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 0x7f0ea006cff0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000c00 tx=0x7f0eb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:40.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.789+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0eb8075b40 con 0x7f0ec0157ea0 2023-09-30T13:55:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.976+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ec0073e70 con 0x7f0ec0157ea0 2023-09-30T13:55:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.977+0000 7f0eb77fe640 1 -- 172.21.15.62:0/2840575897 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0eb8045080 con 0x7f0ec0157ea0 2023-09-30T13:55:40.977 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:40.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 msgr2=0x7f0ea006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 0x7f0ea006cff0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000c00 tx=0x7f0eb0009040 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 msgr2=0x7f0ec00cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8037040 tx=0x7f0eb80015b0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 shutdown_connections 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0ea006ab30 0x7f0ea006cff0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ec0157ea0 0x7f0ec00cc650 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ec00ca710 0x7f0ec00cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 --2- 172.21.15.62:0/2840575897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ec00ca330 0x7f0ec0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 >> 172.21.15.62:0/2840575897 conn(0x7f0ec00d0810 msgr2=0x7f0ec015ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 shutdown_connections 2023-09-30T13:55:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:40.979+0000 7f0ec506f640 1 -- 172.21.15.62:0/2840575897 wait complete. 2023-09-30T13:55:40.989 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:40.989 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:41.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.115+0000 7fb7b4056640 1 Processor -- start 2023-09-30T13:55:41.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.115+0000 7fb7b4056640 1 -- start start 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.115+0000 7fb7b4056640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 0x7fb7ac0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b4056640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b4056640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0cb8a0 con 0x7fb7ac0ac720 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b4056640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0d06d0 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b4056640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0cbb80 con 0x7fb7ac15aab0 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60258/0 (socket says 172.21.15.62:60258) 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 -- 172.21.15.62:0/4257594627 learned_addr learned my addr 172.21.15.62:0/4257594627 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b1df2640 1 --2- 172.21.15.62:0/4257594627 >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 0x7fb7ac0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 -- 172.21.15.62:0/4257594627 >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 msgr2=0x7fb7ac0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 --2- 172.21.15.62:0/4257594627 >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 0x7fb7ac0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 -- 172.21.15.62:0/4257594627 >> v1:172.21.15.62:6789/0 conn(0x7fb7ac0ac720 legacy=0x7fb7ac069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b15f1640 1 -- 172.21.15.62:0/4257594627 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0cbe60 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.116+0000 7fb7b1df2640 1 --2- 172.21.15.62:0/4257594627 >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 0x7fb7ac0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b15f1640 1 --2- 172.21.15.62:0/4257594627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cd210 tx=0x7fb7a802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877b48debfef4254 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b0df0640 1 -- 172.21.15.62:0/4257594627 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8030880 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b0df0640 1 -- 172.21.15.62:0/4257594627 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a80309e0 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b0df0640 1 -- 172.21.15.62:0/4257594627 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8030d70 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b4056640 1 -- 172.21.15.62:0/4257594627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ac2b0 msgr2=0x7fb7ac0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b4056640 1 --2- 172.21.15.62:0/4257594627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0cd210 tx=0x7fb7a802b9c0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.117+0000 7fb7b4056640 1 -- 172.21.15.62:0/4257594627 shutdown_connections 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.118+0000 7fb7b4056640 1 --2- 172.21.15.62:0/4257594627 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0cc660 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.118+0000 7fb7b4056640 1 --2- 172.21.15.62:0/4257594627 >> v2:172.21.15.135:3300/0 conn(0x7fb7ac15aab0 0x7fb7ac0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.118+0000 7fb7b4056640 1 -- 172.21.15.62:0/4257594627 >> 172.21.15.62:0/4257594627 conn(0x7fb7ac098a50 msgr2=0x7fb7ac0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.118+0000 7fb7b4056640 1 -- 172.21.15.62:0/4257594627 shutdown_connections 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.118+0000 7fb7b4056640 1 -- 172.21.15.62:0/4257594627 wait complete. 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 Processor -- start 2023-09-30T13:55:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 -- start start 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ac0ac720 0x7fb7ac0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0c8fd0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0c38b0 con 0x7fb7ac0ac720 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.119+0000 7fb7b4056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac1535d0 con 0x7fb7ac0ac2b0 2023-09-30T13:55:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60274/0 (socket says 172.21.15.62:60274) 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 -- 172.21.15.62:0/3408583648 learned_addr learned my addr 172.21.15.62:0/3408583648 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b15f1640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ac0ac720 0x7fb7ac0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b1df2640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 -- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7ac0ac2b0 msgr2=0x7fb7ac0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 -- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ac0ac720 msgr2=0x7fb7ac0c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ac0ac720 0x7fb7ac0c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 -- 172.21.15.62:0/3408583648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80094d0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b25f3640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c7d0 tx=0x7fb7a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4003b70 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4003cf0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac0c83c0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400aa90 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.120+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac0c8980 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.121+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac04e0d0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.122+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb7a400abf0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.122+0000 7fb79e7fc640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 0x7fb79006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.122+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7a40893a0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.122+0000 7fb7b1df2640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 0x7fb79006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.123+0000 7fb7b1df2640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 0x7fb79006cff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.126+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb7a40542c0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.302+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7ac06e180 con 0x7fb7ac15aab0 2023-09-30T13:55:41.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.304+0000 7fb79e7fc640 1 -- 172.21.15.62:0/3408583648 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fb7a40578e0 con 0x7fb7ac15aab0 2023-09-30T13:55:41.303 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:41.304 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:41.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 msgr2=0x7fb79006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 0x7fb79006cff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).stop 2023-09-30T13:55:41.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 msgr2=0x7fb7ac153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c7d0 tx=0x7fb7a400cc90 comp rx=0 tx=0).stop 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 shutdown_connections 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb79006ab30 0x7fb79006cff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.305+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac15aab0 0x7fb7ac153090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.306+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ac0ac720 0x7fb7ac0c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.306+0000 7fb7b4056640 1 --2- 172.21.15.62:0/3408583648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7ac0ac2b0 0x7fb7ac0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.306+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 >> 172.21.15.62:0/3408583648 conn(0x7fb7ac098a50 msgr2=0x7fb7ac0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.306+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 shutdown_connections 2023-09-30T13:55:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.306+0000 7fb7b4056640 1 -- 172.21.15.62:0/3408583648 wait complete. 2023-09-30T13:55:41.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:41.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.425+0000 7fd0e38c9640 1 Processor -- start 2023-09-30T13:55:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 -- start start 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0dc15cbc0 0x7fd0dc0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0dc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0d1410 con 0x7fd0dc0b8760 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0ce290 con 0x7fd0dc15cbc0 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e38c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0d16f0 con 0x7fd0dc0cd8c0 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.426+0000 7fd0e0e64640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0dc0b8760 0x7fd0dc0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45924/0 (socket says 172.21.15.62:45924) 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e0e64640 1 -- 172.21.15.62:0/2924904052 learned_addr learned my addr 172.21.15.62:0/2924904052 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e1e66640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0dc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> v2:172.21.15.135:3300/0 conn(0x7fd0dc15cbc0 0x7fd0dc0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784603775 0 0) 0x7fd0dc0d1410 con 0x7fd0dc0b8760 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c8003520 con 0x7fd0dc0b8760 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024686107 0 0) 0x7fd0c8003520 con 0x7fd0dc0b8760 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 msgr2=0x7fd0dc0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0dc0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 >> v2:172.21.15.135:3300/0 conn(0x7fd0dc15cbc0 msgr2=0x7fd0dc0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 --2- 172.21.15.62:0/2924904052 >> v2:172.21.15.135:3300/0 conn(0x7fd0dc15cbc0 0x7fd0dc0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0d19d0 con 0x7fd0dc0b8760 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd0cc001670 con 0x7fd0dc0b8760 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> v2:172.21.15.135:3300/0 conn(0x7fd0dc15cbc0 0x7fd0dc0d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 >> v1:172.21.15.62:6789/0 conn(0x7fd0dc0b8760 legacy=0x7fd0dc0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c8003970 0x7fd0c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0c8004d00 0x7fd0c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0ce290 con 0x7fd0c8003970 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0d16f0 con 0x7fd0c8004d00 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c800b980 con 0x7fd0dc0cd8c0 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c8003970 0x7fd0c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e1e66640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0c8004d00 0x7fd0c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.427+0000 7fd0e0e64640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 -- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 msgr2=0x7fd0c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 -- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0c8004d00 msgr2=0x7fd0c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0c8004d00 0x7fd0c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 -- 172.21.15.62:0/2924904052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8003520 con 0x7fd0c8003970 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e0e64640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0dc0cd8c0 0x7fd0c80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0e1665640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c8003970 0x7fd0c8003d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80098d0 tx=0x7fd0c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfefb2f3a3df689a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8004230 con 0x7fd0c8003970 2023-09-30T13:55:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8004390 con 0x7fd0c8003970 2023-09-30T13:55:41.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.428+0000 7fd0d3fff640 1 -- 172.21.15.62:0/2924904052 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8003830 con 0x7fd0c8003970 2023-09-30T13:55:41.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 -- 172.21.15.62:0/2924904052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c8003970 msgr2=0x7fd0c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/2924904052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c8003970 0x7fd0c8003d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80098d0 tx=0x7fd0c80057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e1e66640 1 -- 172.21.15.62:0/2924904052 reap_dead start 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 -- 172.21.15.62:0/2924904052 shutdown_connections 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 -- 172.21.15.62:0/2924904052 >> 172.21.15.62:0/2924904052 conn(0x7fd0dc0718a0 msgr2=0x7fd0dc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 -- 172.21.15.62:0/2924904052 shutdown_connections 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.429+0000 7fd0e38c9640 1 -- 172.21.15.62:0/2924904052 wait complete. 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.430+0000 7fd0e38c9640 1 Processor -- start 2023-09-30T13:55:41.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.430+0000 7fd0e38c9640 1 -- start start 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 0x7fd0dc0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 0x7fd0dc15f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0d3450 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc160260 con 0x7fd0dc15eee0 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e38c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc145ac0 con 0x7fd0c8003970 2023-09-30T13:55:41.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60288/0 (socket says 172.21.15.62:60288) 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 -- 172.21.15.62:0/4040271526 learned_addr learned my addr 172.21.15.62:0/4040271526 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e0e64640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 0x7fd0dc15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1665640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 0x7fd0dc0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 -- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 msgr2=0x7fd0dc0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 0x7fd0dc0c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 -- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 msgr2=0x7fd0dc15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 0x7fd0dc15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1e66640 1 -- 172.21.15.62:0/4040271526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc15f9c0 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e0e64640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 0x7fd0dc15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.431+0000 7fd0e1665640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 0x7fd0dc0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0e1e66640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0cf1e0 tx=0x7fd0d400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400e040 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400f040 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc15fca0 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4015430 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.432+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0c8a30 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.433+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc145c70 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.433+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd0d4015590 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.434+0000 7fd0d1ffb640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 0x7fd0c006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.434+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0d4089ff0 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.434+0000 7fd0e1665640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 0x7fd0c006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.435+0000 7fd0e1665640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 0x7fd0c006cff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8035000 tx=0x7fd0d8039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.438+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd0dc145c70 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.611+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0dc145c30 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.612+0000 7fd0d1ffb640 1 -- 172.21.15.62:0/4040271526 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0d40589a0 con 0x7fd0dc0d2a80 2023-09-30T13:55:41.612 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 msgr2=0x7fd0c006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 0x7fd0c006cff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8035000 tx=0x7fd0d8039040 comp rx=0 tx=0).stop 2023-09-30T13:55:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 msgr2=0x7fd0dc0d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0cf1e0 tx=0x7fd0d400f580 comp rx=0 tx=0).stop 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 shutdown_connections 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd0c006ab30 0x7fd0c006cff0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d2a80 0x7fd0dc0d2f10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0dc15eee0 0x7fd0dc15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 --2- 172.21.15.62:0/4040271526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0c8003970 0x7fd0dc0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 >> 172.21.15.62:0/4040271526 conn(0x7fd0dc0718a0 msgr2=0x7fd0dc0b7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 shutdown_connections 2023-09-30T13:55:41.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.614+0000 7fd0e38c9640 1 -- 172.21.15.62:0/4040271526 wait complete. 2023-09-30T13:55:41.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.733+0000 7fe38290c640 1 Processor -- start 2023-09-30T13:55:41.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.733+0000 7fe38290c640 1 -- start start 2023-09-30T13:55:41.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe38290c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe38290c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 0x7fe37c06ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe38290c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c06f6c0 con 0x7fe37c06f270 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe38290c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0ce3f0 con 0x7fe37c06b420 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe38290c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c06a120 con 0x7fe37c15ce90 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe37bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe37b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 0x7fe37c06ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe37bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:41932/0 (socket says 172.21.15.62:41932) 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.734+0000 7fe37bfff640 1 -- 172.21.15.62:0/3558505045 learned_addr learned my addr 172.21.15.62:0/3558505045 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37bfff640 1 -- 172.21.15.62:0/3558505045 >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 msgr2=0x7fe37c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37bfff640 1 --2- 172.21.15.62:0/3558505045 >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 0x7fe37c06ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37bfff640 1 -- 172.21.15.62:0/3558505045 >> v1:172.21.15.135:6789/0 conn(0x7fe37c06f270 legacy=0x7fe37c0ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37bfff640 1 -- 172.21.15.62:0/3558505045 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c06a400 con 0x7fe37c15ce90 2023-09-30T13:55:41.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37b7fe640 1 --2- 172.21.15.62:0/3558505045 >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 0x7fe37c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.735+0000 7fe37bfff640 1 --2- 172.21.15.62:0/3558505045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe364009870 tx=0x7fe36402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebe485ec20e876 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe37affd640 1 -- 172.21.15.62:0/3558505045 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364030840 con 0x7fe37c15ce90 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe37affd640 1 -- 172.21.15.62:0/3558505045 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640309a0 con 0x7fe37c15ce90 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe37affd640 1 -- 172.21.15.62:0/3558505045 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364030d30 con 0x7fe37c15ce90 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 -- 172.21.15.62:0/3558505045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 msgr2=0x7fe37c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 --2- 172.21.15.62:0/3558505045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe364009870 tx=0x7fe36402b980 comp rx=0 tx=0).stop 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 -- 172.21.15.62:0/3558505045 shutdown_connections 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 --2- 172.21.15.62:0/3558505045 >> v2:172.21.15.135:3300/0 conn(0x7fe37c06b420 0x7fe37c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 --2- 172.21.15.62:0/3558505045 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c06aee0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 -- 172.21.15.62:0/3558505045 >> 172.21.15.62:0/3558505045 conn(0x7fe37c0cc180 msgr2=0x7fe37c0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 -- 172.21.15.62:0/3558505045 shutdown_connections 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.736+0000 7fe38290c640 1 -- 172.21.15.62:0/3558505045 wait complete. 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.737+0000 7fe38290c640 1 Processor -- start 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 -- start start 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c06f270 0x7fe37c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0b43a0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0b4680 con 0x7fe37c06f270 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe38290c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0b4960 con 0x7fe37c15ce90 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe380ea9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.738+0000 7fe380ea9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60300/0 (socket says 172.21.15.62:60300) 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 -- 172.21.15.62:0/1558635858 learned_addr learned my addr 172.21.15.62:0/1558635858 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe37b7fe640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe37bfff640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c06f270 0x7fe37c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 -- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 msgr2=0x7fe37c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 -- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c06f270 msgr2=0x7fe37c0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c06f270 0x7fe37c0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 -- 172.21.15.62:0/1558635858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009400 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe37b7fe640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe380ea9640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c7a0 tx=0x7fe37400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374003b70 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374003cf0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640094d0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374003ea0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.739+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0ae750 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.740+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c0b4e80 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.741+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe37400aa90 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.741+0000 7fe378ff9640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 0x7fe35c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:41.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.741+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3740891f0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.741+0000 7fe37bfff640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 0x7fe35c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:41.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.742+0000 7fe37bfff640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 0x7fe35c06cff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe364036000 tx=0x7fe36403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:41.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.745+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe374054110 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.924+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe37c06f6c0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.924+0000 7fe378ff9640 1 -- 172.21.15.62:0/1558635858 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe37c06f6c0 con 0x7fe37c0ae2a0 2023-09-30T13:55:41.924 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 msgr2=0x7fe35c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 0x7fe35c06cff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe364036000 tx=0x7fe36403b040 comp rx=0 tx=0).stop 2023-09-30T13:55:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 msgr2=0x7fe37c0c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c7a0 tx=0x7fe37400cc60 comp rx=0 tx=0).stop 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 shutdown_connections 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe35c06ab30 0x7fe35c06cff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe37c0ae2a0 0x7fe37c0c5710 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe37c15ce90 0x7fe37c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 --2- 172.21.15.62:0/1558635858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c06f270 0x7fe37c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 >> 172.21.15.62:0/1558635858 conn(0x7fe37c0cc180 msgr2=0x7fe37c0cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 shutdown_connections 2023-09-30T13:55:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:41.926+0000 7fe38290c640 1 -- 172.21.15.62:0/1558635858 wait complete. 2023-09-30T13:55:41.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:42.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.046+0000 7f2acdb5a640 1 Processor -- start 2023-09-30T13:55:42.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.046+0000 7f2acdb5a640 1 -- start start 2023-09-30T13:55:42.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ac80b2160 0x7f2ac80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2ac80b0a70 0x7f2ac80b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80b0f20 con 0x7f2ac80b2160 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac815afa0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2acdb5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac815b190 con 0x7f2ac80b4230 2023-09-30T13:55:42.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ac80b2160 0x7f2ac80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ac80b2160 0x7f2ac80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60314/0 (socket says 172.21.15.62:60314) 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 -- 172.21.15.62:0/249978302 learned_addr learned my addr 172.21.15.62:0/249978302 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac6ffd640 1 --2- 172.21.15.62:0/249978302 >> v2:172.21.15.135:3300/0 conn(0x7f2ac80b0a70 0x7f2ac80b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac7fff640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 -- 172.21.15.62:0/249978302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 msgr2=0x7f2ac815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 -- 172.21.15.62:0/249978302 >> v2:172.21.15.135:3300/0 conn(0x7f2ac80b0a70 msgr2=0x7f2ac80b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/249978302 >> v2:172.21.15.135:3300/0 conn(0x7f2ac80b0a70 0x7f2ac80b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac77fe640 1 -- 172.21.15.62:0/249978302 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac815b470 con 0x7f2ac80b2160 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.047+0000 7f2ac7fff640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b2160 0x7f2ac80b0530 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80cbe60 tx=0x7f2ab002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df16d0ff2997976 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2ac67fc640 1 -- 172.21.15.62:0/249978302 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0031870 con 0x7f2ac80b2160 2023-09-30T13:55:42.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2ac67fc640 1 -- 172.21.15.62:0/249978302 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00319d0 con 0x7f2ac80b2160 2023-09-30T13:55:42.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2ac67fc640 1 -- 172.21.15.62:0/249978302 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0031d60 con 0x7f2ac80b2160 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2acdb5a640 1 -- 172.21.15.62:0/249978302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b2160 msgr2=0x7f2ac80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.048+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b2160 0x7f2ac80b0530 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80cbe60 tx=0x7f2ab002b910 comp rx=0 tx=0).stop 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 -- 172.21.15.62:0/249978302 shutdown_connections 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/249978302 >> v2:172.21.15.135:3300/0 conn(0x7f2ac80b0a70 0x7f2ac80b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/249978302 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b2160 0x7f2ac80b0530 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 -- 172.21.15.62:0/249978302 >> 172.21.15.62:0/249978302 conn(0x7f2ac80cb720 msgr2=0x7f2ac80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 -- 172.21.15.62:0/249978302 shutdown_connections 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.049+0000 7f2acdb5a640 1 -- 172.21.15.62:0/249978302 wait complete. 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.050+0000 7f2acdb5a640 1 Processor -- start 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.050+0000 7f2acdb5a640 1 -- start start 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac80b2160 0x7f2ac80a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac81f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac813bc90 con 0x7f2ac80b0a70 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac813bf70 con 0x7f2ac80b2160 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2acdb5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac813c250 con 0x7f2ac80b4230 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60324/0 (socket says 172.21.15.62:60324) 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 -- 172.21.15.62:0/371346127 learned_addr learned my addr 172.21.15.62:0/371346127 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac6ffd640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac80b2160 0x7f2ac80a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac7fff640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac81f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 -- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 msgr2=0x7f2ac81f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac81f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 -- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac80b2160 msgr2=0x7f2ac80a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac80b2160 0x7f2ac80a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 -- 172.21.15.62:0/371346127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00094d0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.051+0000 7f2ac77fe640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ab002b950 tx=0x7f2ab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.052+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab003ad30 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.052+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00443f0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.052+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac813c530 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.052+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00447a0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.052+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac815a160 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.053+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac813ca50 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.053+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2ab004d450 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.053+0000 7f2abffff640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 0x7f2aa806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.054+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2ab002d040 con 0x7f2ac80b0a70 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.054+0000 7f2ac6ffd640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 0x7f2aa806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.054+0000 7f2ac6ffd640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 0x7f2aa806d020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ad650 tx=0x7f2ab8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.058+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2ab0076990 con 0x7f2ac80b0a70 2023-09-30T13:55:42.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.233+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ac804e0d0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.233+0000 7f2abffff640 1 -- 172.21.15.62:0/371346127 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ab00350a0 con 0x7f2ac80b0a70 2023-09-30T13:55:42.233 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 msgr2=0x7f2aa806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 0x7f2aa806d020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ad650 tx=0x7f2ab8008040 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 msgr2=0x7f2ac8159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ab002b950 tx=0x7f2ab00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 shutdown_connections 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2aa806ab60 0x7f2aa806d020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2ac80b4230 0x7f2ac81f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac80b2160 0x7f2ac80a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 --2- 172.21.15.62:0/371346127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ac80b0a70 0x7f2ac8159c20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 >> 172.21.15.62:0/371346127 conn(0x7f2ac80cb720 msgr2=0x7f2ac8070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 shutdown_connections 2023-09-30T13:55:42.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.235+0000 7f2acdb5a640 1 -- 172.21.15.62:0/371346127 wait complete. 2023-09-30T13:55:42.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:42.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 Processor -- start 2023-09-30T13:55:42.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 -- start start 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36d40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40af960 con 0x7f36d41599f0 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d406c390 con 0x7f36d4159610 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.355+0000 7f36d92a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d406c670 con 0x7f36d40b09d0 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d27fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f36d41599f0 0x7f36d40b02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45938/0 (socket says 172.21.15.62:45938) 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d27fc640 1 -- 172.21.15.62:0/3672095785 learned_addr learned my addr 172.21.15.62:0/3672095785 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:42.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d37fe640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36d40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616228831 0 0) 0x7f36d40af960 con 0x7f36d41599f0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c0005730 con 0x7f36d41599f0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188890923 0 0) 0x7f36c0005730 con 0x7f36d41599f0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 msgr2=0x7f36d40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36d40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 >> v1:172.21.15.135:6789/0 conn(0x7f36d4159610 legacy=0x7f36d40af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d406c950 con 0x7f36d41599f0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f36c4001670 con 0x7f36d41599f0 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 >> v1:172.21.15.62:6789/0 conn(0x7f36d41599f0 legacy=0x7f36d40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36c0005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36c00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c0006f10 0x7f36c0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d406c670 con 0x7f36c0005bb0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c000dc40 con 0x7f36c0006f10 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c000de00 con 0x7f36d40b09d0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36c0005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d27fc640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36c00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.356+0000 7f36d37fe640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c0006f10 0x7f36c0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 msgr2=0x7f36c00069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d40b09d0 0x7f36c00069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c0006f10 msgr2=0x7f36c0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36c0006f10 0x7f36c0007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3672095785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0005730 con 0x7f36c0005bb0 2023-09-30T13:55:42.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36c0005f90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f36bc001860 tx=0x7f36c0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcde2cf3493c67cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc033630 con 0x7f36c0005bb0 2023-09-30T13:55:42.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc0337b0 con 0x7f36c0005bb0 2023-09-30T13:55:42.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.357+0000 7f36d1ffb640 1 -- 172.21.15.62:0/3672095785 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc033b60 con 0x7f36c0005bb0 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 -- 172.21.15.62:0/3672095785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 msgr2=0x7f36c0005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3672095785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36c0005f90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f36bc001860 tx=0x7f36c0007a00 comp rx=0 tx=0).stop 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d37fe640 1 -- 172.21.15.62:0/3672095785 reap_dead start 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 -- 172.21.15.62:0/3672095785 shutdown_connections 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 -- 172.21.15.62:0/3672095785 >> 172.21.15.62:0/3672095785 conn(0x7f36d40cb720 msgr2=0x7f36d40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 -- 172.21.15.62:0/3672095785 shutdown_connections 2023-09-30T13:55:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.358+0000 7f36d92a2640 1 -- 172.21.15.62:0/3672095785 wait complete. 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.359+0000 7f36d92a2640 1 Processor -- start 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.359+0000 7f36d92a2640 1 -- start start 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d4152c10 0x7f36d415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 0x7f36d4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d415b2a0 con 0x7f36c0005bb0 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4141900 con 0x7f36d41423e0 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d92a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4141be0 con 0x7f36d4152c10 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60336/0 (socket says 172.21.15.62:60336) 2023-09-30T13:55:42.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3208585501 learned_addr learned my addr 172.21.15.62:0/3208585501 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d27fc640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d4152c10 0x7f36d415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.360+0000 7f36d37fe640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 0x7f36d4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d4152c10 msgr2=0x7f36d415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d4152c10 0x7f36d415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 msgr2=0x7f36d4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 0x7f36d4159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 -- 172.21.15.62:0/3208585501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4141ec0 con 0x7f36c0005bb0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d37fe640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 0x7f36d4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d2ffd640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f36bc008fd0 tx=0x7f36bc001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc007050 con 0x7f36c0005bb0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc0071b0 con 0x7f36c0005bb0 2023-09-30T13:55:42.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d41415f0 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc007520 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.361+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d415b580 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.362+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4142050 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.362+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f36bc0067d0 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.363+0000 7f36cb7fe640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 0x7f36b406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.363+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36bc0ab450 con 0x7f36c0005bb0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.363+0000 7f36d27fc640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 0x7f36b406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.364+0000 7f36d27fc640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 0x7f36b406d020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f36d415df70 tx=0x7f36c4000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.367+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f36bc076540 con 0x7f36c0005bb0 2023-09-30T13:55:42.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.545+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f36d404e0d0 con 0x7f36c0005bb0 2023-09-30T13:55:42.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.546+0000 7f36cb7fe640 1 -- 172.21.15.62:0/3208585501 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36bc079b60 con 0x7f36c0005bb0 2023-09-30T13:55:42.546 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 msgr2=0x7f36b406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 0x7f36b406d020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f36d415df70 tx=0x7f36c4000fe0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 msgr2=0x7f36d41410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f36bc008fd0 tx=0x7f36bc001230 comp rx=0 tx=0).stop 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 shutdown_connections 2023-09-30T13:55:42.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36b406ab60 0x7f36b406d020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d41423e0 0x7f36d4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36d4152c10 0x7f36d415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 --2- 172.21.15.62:0/3208585501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36c0005bb0 0x7f36d41410b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 >> 172.21.15.62:0/3208585501 conn(0x7f36d40cb720 msgr2=0x7f36d406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 shutdown_connections 2023-09-30T13:55:42.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.548+0000 7f36d92a2640 1 -- 172.21.15.62:0/3208585501 wait complete. 2023-09-30T13:55:42.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:42.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.668+0000 7f7df1244640 1 Processor -- start 2023-09-30T13:55:42.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.668+0000 7f7df1244640 1 -- start start 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dec160160 0x7f7dec0d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec0d3600 0x7f7dec0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7dec0b5cd0 0x7f7dec0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0cda60 con 0x7f7dec160160 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0d18a0 con 0x7f7dec0b5cd0 2023-09-30T13:55:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7df1244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec160540 con 0x7f7dec0d3600 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7dead9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dec160160 0x7f7dec0d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7dead9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7dec160160 0x7f7dec0d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60338/0 (socket says 172.21.15.62:60338) 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7dead9d640 1 -- 172.21.15.62:0/1077692046 learned_addr learned my addr 172.21.15.62:0/1077692046 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7dea59c640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec0d3600 0x7f7dec0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.669+0000 7f7deb59e640 1 --2- 172.21.15.62:0/1077692046 >> v2:172.21.15.135:3300/0 conn(0x7f7dec0b5cd0 0x7f7dec0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 -- 172.21.15.62:0/1077692046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec0d3600 msgr2=0x7f7dec0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec0d3600 0x7f7dec0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 -- 172.21.15.62:0/1077692046 >> v2:172.21.15.135:3300/0 conn(0x7f7dec0b5cd0 msgr2=0x7f7dec0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 --2- 172.21.15.62:0/1077692046 >> v2:172.21.15.135:3300/0 conn(0x7f7dec0b5cd0 0x7f7dec0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 -- 172.21.15.62:0/1077692046 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0cd450 con 0x7f7dec160160 2023-09-30T13:55:42.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.670+0000 7f7dead9d640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec160160 0x7f7dec0d30c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0cd9d0 tx=0x7f7de402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef23df9e7bf46d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7de9d9b640 1 -- 172.21.15.62:0/1077692046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4030860 con 0x7f7dec160160 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7de9d9b640 1 -- 172.21.15.62:0/1077692046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de40309c0 con 0x7f7dec160160 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7de9d9b640 1 -- 172.21.15.62:0/1077692046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4030d50 con 0x7f7dec160160 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 -- 172.21.15.62:0/1077692046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec160160 msgr2=0x7f7dec0d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec160160 0x7f7dec0d30c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0cd9d0 tx=0x7f7de402b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 -- 172.21.15.62:0/1077692046 shutdown_connections 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 --2- 172.21.15.62:0/1077692046 >> v2:172.21.15.135:3300/0 conn(0x7f7dec0b5cd0 0x7f7dec0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec0d3600 0x7f7dec0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 --2- 172.21.15.62:0/1077692046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec160160 0x7f7dec0d30c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 -- 172.21.15.62:0/1077692046 >> 172.21.15.62:0/1077692046 conn(0x7f7dec089fe0 msgr2=0x7f7dec0d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 -- 172.21.15.62:0/1077692046 shutdown_connections 2023-09-30T13:55:42.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.671+0000 7f7df1244640 1 -- 172.21.15.62:0/1077692046 wait complete. 2023-09-30T13:55:42.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 Processor -- start 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 -- start start 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dec0b5cd0 0x7f7dec15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec160160 0x7f7dec156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15dd40 con 0x7f7dec0d3600 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0c8e00 con 0x7f7dec0b5cd0 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7df1244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15ce20 con 0x7f7dec160160 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7dea59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7dea59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60354/0 (socket says 172.21.15.62:60354) 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.673+0000 7f7dea59c640 1 -- 172.21.15.62:0/2959315369 learned_addr learned my addr 172.21.15.62:0/2959315369 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dead9d640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dec0b5cd0 0x7f7dec15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7deb59e640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec160160 0x7f7dec156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 -- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec160160 msgr2=0x7f7dec156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec160160 0x7f7dec156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 -- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dec0b5cd0 msgr2=0x7f7dec15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dec0b5cd0 0x7f7dec15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 -- 172.21.15.62:0/2959315369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40094d0 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dea59c640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d5f0 tx=0x7f7de000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00125f0 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0012750 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0012b00 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec15d0c0 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.674+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec15d680 con 0x7f7dec0d3600 2023-09-30T13:55:42.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.675+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec15de80 con 0x7f7dec0d3600 2023-09-30T13:55:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.676+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7de0012c60 con 0x7f7dec0d3600 2023-09-30T13:55:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.676+0000 7f7dd37fe640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 0x7f7dd806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.676+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7de0089ae0 con 0x7f7dec0d3600 2023-09-30T13:55:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.676+0000 7f7dead9d640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 0x7f7dd806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.677+0000 7f7dead9d640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 0x7f7dd806cff0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7de4036000 tx=0x7f7de4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:42.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.680+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7dec15de80 con 0x7f7dec0d3600 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.867+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7dec15de80 con 0x7f7dec0d3600 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.868+0000 7f7dd37fe640 1 -- 172.21.15.62:0/2959315369 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7dec15de80 con 0x7f7dec0d3600 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 msgr2=0x7f7dd806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 0x7f7dd806cff0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7de4036000 tx=0x7f7de4008030 comp rx=0 tx=0).stop 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 msgr2=0x7f7dec155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:42.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d5f0 tx=0x7f7de000dab0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 shutdown_connections 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dd806ab30 0x7f7dd806cff0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dec160160 0x7f7dec156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dec0d3600 0x7f7dec155d00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 --2- 172.21.15.62:0/2959315369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dec0b5cd0 0x7f7dec15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 >> 172.21.15.62:0/2959315369 conn(0x7f7dec089fe0 msgr2=0x7f7dec0d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 shutdown_connections 2023-09-30T13:55:42.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:42.870+0000 7f7df1244640 1 -- 172.21.15.62:0/2959315369 wait complete. 2023-09-30T13:55:42.880 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2023-09-30T13:55:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:42.880 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-09-30T13:55:42.912 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:42.912 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:55:42.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:42.913 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T13:55:43.078 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:43.078 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:43.094 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:43.094 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:43.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:43.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.297+0000 7feae8461640 1 Processor -- start 2023-09-30T13:55:43.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.297+0000 7feae8461640 1 -- start start 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae8461640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae8461640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feae00d1410 0x7feae00af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae8461640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00cb810 con 0x7feae006b070 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae8461640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae006c230 con 0x7feae00d1410 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae8461640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae00cccb0 con 0x7feae015cbb0 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae59fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feae006b070 0x7feae006bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45952/0 (socket says 172.21.15.62:45952) 2023-09-30T13:55:43.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae59fc640 1 -- 172.21.15.62:0/1230755314 learned_addr learned my addr 172.21.15.62:0/1230755314 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae69fe640 1 --2- 172.21.15.62:0/1230755314 >> v2:172.21.15.135:3300/0 conn(0x7feae00d1410 0x7feae00af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.298+0000 7feae61fd640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae51fb640 1 -- 172.21.15.62:0/1230755314 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863212788 0 0) 0x7feae00cb810 con 0x7feae006b070 2023-09-30T13:55:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae51fb640 1 -- 172.21.15.62:0/1230755314 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc003520 con 0x7feae006b070 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae69fe640 1 -- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 msgr2=0x7feae006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae69fe640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae69fe640 1 -- 172.21.15.62:0/1230755314 >> v1:172.21.15.62:6789/0 conn(0x7feae006b070 legacy=0x7feae006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae69fe640 1 -- 172.21.15.62:0/1230755314 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00caee0 con 0x7feae00d1410 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.299+0000 7feae61fd640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae69fe640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae00d1410 0x7feae00af3d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71baeda607a660e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae51fb640 1 -- 172.21.15.62:0/1230755314 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead802cc50 con 0x7feae00d1410 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae51fb640 1 -- 172.21.15.62:0/1230755314 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead802cdb0 con 0x7feae00d1410 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae51fb640 1 -- 172.21.15.62:0/1230755314 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8034640 con 0x7feae00d1410 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae8461640 1 -- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae00d1410 msgr2=0x7feae00af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.300+0000 7feae8461640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae00d1410 0x7feae00af3d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802bea0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 -- 172.21.15.62:0/1230755314 shutdown_connections 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae00d1410 0x7feae00af3d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 --2- 172.21.15.62:0/1230755314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 -- 172.21.15.62:0/1230755314 >> 172.21.15.62:0/1230755314 conn(0x7feae0089fe0 msgr2=0x7feae00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 -- 172.21.15.62:0/1230755314 shutdown_connections 2023-09-30T13:55:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.301+0000 7feae8461640 1 -- 172.21.15.62:0/1230755314 wait complete. 2023-09-30T13:55:43.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 Processor -- start 2023-09-30T13:55:43.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 -- start start 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae006b070 0x7feae014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae009b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015dd40 con 0x7feae00d1410 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015d0c0 con 0x7feae006b070 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.302+0000 7feae8461640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae015d3a0 con 0x7feae015cbb0 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60360/0 (socket says 172.21.15.62:60360) 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 -- 172.21.15.62:0/1622101995 learned_addr learned my addr 172.21.15.62:0/1622101995 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae69fe640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae009b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae61fd640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae006b070 0x7feae014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 -- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 msgr2=0x7feae009b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae009b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 -- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae006b070 msgr2=0x7feae014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae006b070 0x7feae014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 -- 172.21.15.62:0/1622101995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009400 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae69fe640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae009b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae59fc640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fead000c390 tx=0x7fead000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0005ce0 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0005e40 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead8009a70 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00072f0 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.303+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae015d960 con 0x7feae00d1410 2023-09-30T13:55:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.304+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae015de80 con 0x7feae00d1410 2023-09-30T13:55:43.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.305+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fead0007450 con 0x7feae00d1410 2023-09-30T13:55:43.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.305+0000 7fead6ffd640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 0x7feac406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.305+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fead0088ba0 con 0x7feae00d1410 2023-09-30T13:55:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.305+0000 7feae61fd640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 0x7feac406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.306+0000 7feae61fd640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 0x7feac406cff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feae01f5720 tx=0x7feadc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.310+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7feae015de80 con 0x7feae00d1410 2023-09-30T13:55:43.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.485+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae015de80 con 0x7feae00d1410 2023-09-30T13:55:43.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.486+0000 7fead6ffd640 1 -- 172.21.15.62:0/1622101995 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7feae015de80 con 0x7feae00d1410 2023-09-30T13:55:43.486 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:43.486 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 msgr2=0x7feac406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 0x7feac406cff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feae01f5720 tx=0x7feadc008040 comp rx=0 tx=0).stop 2023-09-30T13:55:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 msgr2=0x7feae01f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fead000c390 tx=0x7fead000c850 comp rx=0 tx=0).stop 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 shutdown_connections 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feac406ab30 0x7feac406cff0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feae015cbb0 0x7feae009b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feae00d1410 0x7feae01f1c90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 --2- 172.21.15.62:0/1622101995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae006b070 0x7feae014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 >> 172.21.15.62:0/1622101995 conn(0x7feae0089fe0 msgr2=0x7feae00c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 shutdown_connections 2023-09-30T13:55:43.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.488+0000 7feae8461640 1 -- 172.21.15.62:0/1622101995 wait complete. 2023-09-30T13:55:43.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:43.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.608+0000 7f76d5e1f640 1 Processor -- start 2023-09-30T13:55:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.608+0000 7f76d5e1f640 1 -- start start 2023-09-30T13:55:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76d5e1f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f76d015a880 0x7f76d00ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76d5e1f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00c9dd0 con 0x7f76d00b3990 2023-09-30T13:55:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76d5e1f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d015e630 con 0x7f76d00cb780 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76d5e1f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d015e910 con 0x7f76d015a880 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76ceffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76d00b3990 0x7f76d00c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45954/0 (socket says 172.21.15.62:45954) 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76ceffd640 1 -- 172.21.15.62:0/55125352 learned_addr learned my addr 172.21.15.62:0/55125352 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76cf7fe640 1 --2- 172.21.15.62:0/55125352 >> v2:172.21.15.135:3300/0 conn(0x7f76d015a880 0x7f76d00ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.609+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479448661 0 0) 0x7f76d00c9dd0 con 0x7f76d00b3990 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.610+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b8003520 con 0x7f76d00b3990 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.610+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2475639815 0 0) 0x7f76b8003520 con 0x7f76d00b3990 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.610+0000 7f76cf7fe640 1 -- 172.21.15.62:0/55125352 >> v1:172.21.15.135:6789/0 conn(0x7f76d00cb780 legacy=0x7f76d00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.610+0000 7f76cf7fe640 1 -- 172.21.15.62:0/55125352 >> v1:172.21.15.62:6789/0 conn(0x7f76d00b3990 legacy=0x7f76d00c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.610+0000 7f76cf7fe640 1 -- 172.21.15.62:0/55125352 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d015ebf0 con 0x7f76d015a880 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76cf7fe640 1 --2- 172.21.15.62:0/55125352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015a880 0x7f76d00ce360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d84b157cf575b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c002f050 con 0x7f76d015a880 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c0031500 con 0x7f76d015a880 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76ce7fc640 1 -- 172.21.15.62:0/55125352 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4001670 con 0x7f76d015a880 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 -- 172.21.15.62:0/55125352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015a880 msgr2=0x7f76d00ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/55125352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015a880 0x7f76d00ce360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002b820 comp rx=0 tx=0).stop 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 -- 172.21.15.62:0/55125352 shutdown_connections 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/55125352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d015a880 0x7f76d00ce360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 -- 172.21.15.62:0/55125352 >> 172.21.15.62:0/55125352 conn(0x7f76d006a380 msgr2=0x7f76d00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 -- 172.21.15.62:0/55125352 shutdown_connections 2023-09-30T13:55:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.611+0000 7f76d5e1f640 1 -- 172.21.15.62:0/55125352 wait complete. 2023-09-30T13:55:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.612+0000 7f76d5e1f640 1 Processor -- start 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 -- start start 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d00b3990 0x7f76d015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015a880 0x7f76d0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d006cb70 con 0x7f76d00cb780 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d006ce50 con 0x7f76d00b3990 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76d5e1f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d015ce70 con 0x7f76d015a880 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.613+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60374/0 (socket says 172.21.15.62:60374) 2023-09-30T13:55:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 -- 172.21.15.62:0/2069414376 learned_addr learned my addr 172.21.15.62:0/2069414376 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76cffff640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015a880 0x7f76d0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76cf7fe640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d00b3990 0x7f76d015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 -- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015a880 msgr2=0x7f76d0157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015a880 0x7f76d0157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 -- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d00b3990 msgr2=0x7f76d015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d00b3990 0x7f76d015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 -- 172.21.15.62:0/2069414376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009400 con 0x7f76d00cb780 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76ceffd640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c730 tx=0x7f76c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4005ad0 con 0x7f76d00cb780 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4005c50 con 0x7f76d00cb780 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d015d150 con 0x7f76d00cb780 2023-09-30T13:55:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007070 con 0x7f76d00cb780 2023-09-30T13:55:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.614+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d00c67c0 con 0x7f76d00cb780 2023-09-30T13:55:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.615+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d015d370 con 0x7f76d00cb780 2023-09-30T13:55:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.616+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f76c40071d0 con 0x7f76d00cb780 2023-09-30T13:55:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.616+0000 7f76b7fff640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 0x7f76bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.616+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76c4088d30 con 0x7f76d00cb780 2023-09-30T13:55:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.616+0000 7f76cf7fe640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 0x7f76bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.617+0000 7f76cf7fe640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 0x7f76bc06cff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76c0035000 tx=0x7f76c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.620+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f76c4053c50 con 0x7f76d00cb780 2023-09-30T13:55:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.795+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76d0073e70 con 0x7f76d00cb780 2023-09-30T13:55:43.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.796+0000 7f76b7fff640 1 -- 172.21.15.62:0/2069414376 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76c4017020 con 0x7f76d00cb780 2023-09-30T13:55:43.795 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 msgr2=0x7f76bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 0x7f76bc06cff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76c0035000 tx=0x7f76c0008030 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 msgr2=0x7f76d0156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c730 tx=0x7f76c400cbf0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 shutdown_connections 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f76bc06ab30 0x7f76bc06cff0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d015a880 0x7f76d0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76d00cb780 0x7f76d0156900 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 --2- 172.21.15.62:0/2069414376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d00b3990 0x7f76d015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.797+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 >> 172.21.15.62:0/2069414376 conn(0x7f76d006a380 msgr2=0x7f76d00acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:43.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.798+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 shutdown_connections 2023-09-30T13:55:43.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.798+0000 7f76d5e1f640 1 -- 172.21.15.62:0/2069414376 wait complete. 2023-09-30T13:55:43.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.917+0000 7efda3bc0640 1 Processor -- start 2023-09-30T13:55:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.917+0000 7efda3bc0640 1 -- start start 2023-09-30T13:55:43.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda3bc0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9c153d20 0x7efd9c0ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda3bc0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c06c540 con 0x7efd9c15d9f0 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda3bc0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c0b29c0 con 0x7efd9c0aeb00 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda3bc0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c154100 con 0x7efd9c153d20 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda195c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efd9c153d20 0x7efd9c0ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda215d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efd9c15d9f0 0x7efd9c06c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45962/0 (socket says 172.21.15.62:45962) 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda215d640 1 -- 172.21.15.62:0/1081061005 learned_addr learned my addr 172.21.15.62:0/1081061005 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda195c640 1 -- 172.21.15.62:0/1081061005 >> v1:172.21.15.135:6789/0 conn(0x7efd9c0aeb00 legacy=0x7efd9c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda195c640 1 -- 172.21.15.62:0/1081061005 >> v1:172.21.15.62:6789/0 conn(0x7efd9c15d9f0 legacy=0x7efd9c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.918+0000 7efda195c640 1 -- 172.21.15.62:0/1081061005 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c06c1f0 con 0x7efd9c153d20 2023-09-30T13:55:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.919+0000 7efda195c640 1 --2- 172.21.15.62:0/1081061005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c0ae5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06c3e0 tx=0x7efd9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6c6d2b47363887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.919+0000 7efda095a640 1 -- 172.21.15.62:0/1081061005 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031830 con 0x7efd9c153d20 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.919+0000 7efda095a640 1 -- 172.21.15.62:0/1081061005 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98031990 con 0x7efd9c153d20 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.919+0000 7efda095a640 1 -- 172.21.15.62:0/1081061005 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031d20 con 0x7efd9c153d20 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 -- 172.21.15.62:0/1081061005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 msgr2=0x7efd9c0ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1081061005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c0ae5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd9c06c3e0 tx=0x7efd9802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 -- 172.21.15.62:0/1081061005 shutdown_connections 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1081061005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c0ae5c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 -- 172.21.15.62:0/1081061005 >> 172.21.15.62:0/1081061005 conn(0x7efd9c0cb720 msgr2=0x7efd9c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 -- 172.21.15.62:0/1081061005 shutdown_connections 2023-09-30T13:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.920+0000 7efda3bc0640 1 -- 172.21.15.62:0/1081061005 wait complete. 2023-09-30T13:55:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.921+0000 7efda3bc0640 1 Processor -- start 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.921+0000 7efda3bc0640 1 -- start start 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 0x7efd9c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c15d9f0 0x7efd9c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c151d20 con 0x7efd9c153d20 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c14f5d0 con 0x7efd9c0aeb00 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c152d90 con 0x7efd9c15d9f0 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60388/0 (socket says 172.21.15.62:60388) 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 -- 172.21.15.62:0/1420413541 learned_addr learned my addr 172.21.15.62:0/1420413541 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda195c640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 0x7efd9c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda215d640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c15d9f0 0x7efd9c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 -- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c15d9f0 msgr2=0x7efd9c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c15d9f0 0x7efd9c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 -- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 msgr2=0x7efd9c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 0x7efd9c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 -- 172.21.15.62:0/1420413541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009400 con 0x7efd9c153d20 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda195c640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 0x7efd9c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda115b640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3f0 tx=0x7efd8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c011830 con 0x7efd9c153d20 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c011990 con 0x7efd9c153d20 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c011d40 con 0x7efd9c153d20 2023-09-30T13:55:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c150a20 con 0x7efd9c153d20 2023-09-30T13:55:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.922+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c150fe0 con 0x7efd9c153d20 2023-09-30T13:55:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.923+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c04e0d0 con 0x7efd9c153d20 2023-09-30T13:55:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.924+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efd8c01a400 con 0x7efd9c153d20 2023-09-30T13:55:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.924+0000 7efd927fc640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 0x7efd8006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.924+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd8c0893b0 con 0x7efd9c153d20 2023-09-30T13:55:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.924+0000 7efda195c640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 0x7efd8006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.925+0000 7efda195c640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 0x7efd8006cff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efd98036000 tx=0x7efd9803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:43.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:43.928+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efd8c0542d0 con 0x7efd9c153d20 2023-09-30T13:55:44.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.102+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd9c0cf040 con 0x7efd9c153d20 2023-09-30T13:55:44.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.102+0000 7efd927fc640 1 -- 172.21.15.62:0/1420413541 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd8c0578f0 con 0x7efd9c153d20 2023-09-30T13:55:44.102 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 msgr2=0x7efd8006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 0x7efd8006cff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efd98036000 tx=0x7efd9803c040 comp rx=0 tx=0).stop 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 msgr2=0x7efd9c1542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3f0 tx=0x7efd8c00b8b0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 shutdown_connections 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efd8006ab30 0x7efd8006cff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd9c15d9f0 0x7efd9c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd9c153d20 0x7efd9c1542d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 --2- 172.21.15.62:0/1420413541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c0aeb00 0x7efd9c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 >> 172.21.15.62:0/1420413541 conn(0x7efd9c0cb720 msgr2=0x7efd9c0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 shutdown_connections 2023-09-30T13:55:44.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.104+0000 7efda3bc0640 1 -- 172.21.15.62:0/1420413541 wait complete. 2023-09-30T13:55:44.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.223+0000 7eff247a9640 1 Processor -- start 2023-09-30T13:55:44.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.223+0000 7eff247a9640 1 -- start start 2023-09-30T13:55:44.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.224+0000 7eff247a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.224+0000 7eff247a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7eff1c0cd8c0 0x7eff1c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.224+0000 7eff247a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0d1410 con 0x7eff1c0b8760 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.224+0000 7eff247a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0ce290 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.224+0000 7eff247a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0d16f0 con 0x7eff1c15cbc0 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:42058/0 (socket says 172.21.15.62:42058) 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 -- 172.21.15.62:0/751626648 learned_addr learned my addr 172.21.15.62:0/751626648 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff21d44640 1 --1- 172.21.15.62:0/751626648 >> v1:172.21.15.135:6789/0 conn(0x7eff1c0b8760 0x7eff1c0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:49002/0 (socket says 172.21.15.62:49002) 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22d46640 1 --2- 172.21.15.62:0/751626648 >> v2:172.21.15.135:3300/0 conn(0x7eff1c0cd8c0 0x7eff1c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 -- 172.21.15.62:0/751626648 >> v2:172.21.15.135:3300/0 conn(0x7eff1c0cd8c0 msgr2=0x7eff1c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:44.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 --2- 172.21.15.62:0/751626648 >> v2:172.21.15.135:3300/0 conn(0x7eff1c0cd8c0 0x7eff1c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 -- 172.21.15.62:0/751626648 >> v1:172.21.15.135:6789/0 conn(0x7eff1c0b8760 legacy=0x7eff1c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.225+0000 7eff22545640 1 -- 172.21.15.62:0/751626648 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0d19d0 con 0x7eff1c15cbc0 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.226+0000 7eff22545640 1 --2- 172.21.15.62:0/751626648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff14009870 tx=0x7eff1402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e0fd473ea7337a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.226+0000 7eff21543640 1 -- 172.21.15.62:0/751626648 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14030840 con 0x7eff1c15cbc0 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.226+0000 7eff21543640 1 -- 172.21.15.62:0/751626648 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140309a0 con 0x7eff1c15cbc0 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.226+0000 7eff21543640 1 -- 172.21.15.62:0/751626648 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14030d30 con 0x7eff1c15cbc0 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 -- 172.21.15.62:0/751626648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 msgr2=0x7eff1c0d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 --2- 172.21.15.62:0/751626648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff14009870 tx=0x7eff1402b980 comp rx=0 tx=0).stop 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 -- 172.21.15.62:0/751626648 shutdown_connections 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 --2- 172.21.15.62:0/751626648 >> v2:172.21.15.135:3300/0 conn(0x7eff1c0cd8c0 0x7eff1c0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 --2- 172.21.15.62:0/751626648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c15cbc0 0x7eff1c0d24b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 -- 172.21.15.62:0/751626648 >> 172.21.15.62:0/751626648 conn(0x7eff1c0718a0 msgr2=0x7eff1c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 -- 172.21.15.62:0/751626648 shutdown_connections 2023-09-30T13:55:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.227+0000 7eff247a9640 1 -- 172.21.15.62:0/751626648 wait complete. 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.228+0000 7eff247a9640 1 Processor -- start 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.228+0000 7eff247a9640 1 -- start start 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 0x7eff1c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1c15cbc0 0x7eff1c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c148970 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14bbf0 con 0x7eff1c15cbc0 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff247a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14b630 con 0x7eff1c0b8760 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60396/0 (socket says 172.21.15.62:60396) 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 -- 172.21.15.62:0/4208830299 learned_addr learned my addr 172.21.15.62:0/4208830299 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff22545640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 0x7eff1c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff22d46640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1c15cbc0 0x7eff1c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 -- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 msgr2=0x7eff1c148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 0x7eff1c148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 -- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1c15cbc0 msgr2=0x7eff1c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1c15cbc0 0x7eff1c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 -- 172.21.15.62:0/4208830299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140094d0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff22545640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 0x7eff1c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.229+0000 7eff21d44640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c4d0 tx=0x7eff1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.230+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10007480 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.230+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100075e0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.230+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c14b910 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.230+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100049e0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.230+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c149040 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.231+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c148bc0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.231+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7eff10004b40 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.231+0000 7eff1affd640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 0x7eff0806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.231+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff100886b0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.232+0000 7eff22545640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 0x7eff0806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.232+0000 7eff22545640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 0x7eff0806cff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff14036000 tx=0x7eff14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.236+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7eff1c148bc0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.409+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff1c148bc0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.409+0000 7eff1affd640 1 -- 172.21.15.62:0/4208830299 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff1c148bc0 con 0x7eff1c0cd8c0 2023-09-30T13:55:44.409 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 msgr2=0x7eff0806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 0x7eff0806cff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff14036000 tx=0x7eff14008030 comp rx=0 tx=0).stop 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 msgr2=0x7eff1c14ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c4d0 tx=0x7eff1000c990 comp rx=0 tx=0).stop 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 shutdown_connections 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7eff0806ab30 0x7eff0806cff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1c15cbc0 0x7eff1c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff1c0cd8c0 0x7eff1c14ac00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 --2- 172.21.15.62:0/4208830299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1c0b8760 0x7eff1c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 >> 172.21.15.62:0/4208830299 conn(0x7eff1c0718a0 msgr2=0x7eff1c159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 shutdown_connections 2023-09-30T13:55:44.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.411+0000 7eff247a9640 1 -- 172.21.15.62:0/4208830299 wait complete. 2023-09-30T13:55:44.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:44.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.530+0000 7f1f048bb640 1 Processor -- start 2023-09-30T13:55:44.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.530+0000 7f1f048bb640 1 -- start start 2023-09-30T13:55:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1f048bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f0015cbc0 0x7f1f000d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1f048bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f000cd8c0 0x7f1f000cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1f048bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000d1410 con 0x7f1f000b8760 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1f048bb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f000ce290 con 0x7f1f000cd8c0 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1f048bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000d16f0 con 0x7f1f0015cbc0 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1efed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f000cd8c0 0x7f1f000cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1efdd9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1f000b8760 0x7f1f000d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45970/0 (socket says 172.21.15.62:45970) 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.531+0000 7f1efdd9b640 1 -- 172.21.15.62:0/3920078437 learned_addr learned my addr 172.21.15.62:0/3920078437 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efe59c640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f0015cbc0 0x7f1f000d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efed9d640 1 -- 172.21.15.62:0/3920078437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f0015cbc0 msgr2=0x7f1f000d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efed9d640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f0015cbc0 0x7f1f000d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efed9d640 1 -- 172.21.15.62:0/3920078437 >> v1:172.21.15.62:6789/0 conn(0x7f1f000b8760 legacy=0x7f1f000d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efed9d640 1 -- 172.21.15.62:0/3920078437 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000d19d0 con 0x7f1f000cd8c0 2023-09-30T13:55:44.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.532+0000 7f1efed9d640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000cdd50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6a199dabc85608 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1efd59a640 1 -- 172.21.15.62:0/3920078437 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0031830 con 0x7f1f000cd8c0 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1efd59a640 1 -- 172.21.15.62:0/3920078437 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0031990 con 0x7f1f000cd8c0 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1efd59a640 1 -- 172.21.15.62:0/3920078437 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0031d20 con 0x7f1f000cd8c0 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 -- 172.21.15.62:0/3920078437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 msgr2=0x7f1f000cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000cdd50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 -- 172.21.15.62:0/3920078437 shutdown_connections 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000cdd50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 --2- 172.21.15.62:0/3920078437 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f0015cbc0 0x7f1f000d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 -- 172.21.15.62:0/3920078437 >> 172.21.15.62:0/3920078437 conn(0x7f1f000718a0 msgr2=0x7f1f00071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 -- 172.21.15.62:0/3920078437 shutdown_connections 2023-09-30T13:55:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.533+0000 7f1f048bb640 1 -- 172.21.15.62:0/3920078437 wait complete. 2023-09-30T13:55:44.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.534+0000 7f1f048bb640 1 Processor -- start 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 -- start start 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 0x7f1f001f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 0x7f1f000b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001f5800 con 0x7f1f000cd8c0 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001f60a0 con 0x7f1f0015cbc0 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1f048bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001f2100 con 0x7f1f000b8760 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1efdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1efdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60408/0 (socket says 172.21.15.62:60408) 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.535+0000 7f1efdd9b640 1 -- 172.21.15.62:0/2330250474 learned_addr learned my addr 172.21.15.62:0/2330250474 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:44.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efed9d640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 0x7f1f000b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efe59c640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 0x7f1f001f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 -- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 msgr2=0x7f1f001f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 0x7f1f001f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 -- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 msgr2=0x7f1f000b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 0x7f1f000b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 -- 172.21.15.62:0/2330250474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0009400 con 0x7f1f000cd8c0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efed9d640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 0x7f1f000b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efe59c640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 0x7f1f001f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1efdd9b640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400c4d0 tx=0x7f1ef400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4005ce0 con 0x7f1f000cd8c0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4005e40 con 0x7f1f000cd8c0 2023-09-30T13:55:44.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f000c92f0 con 0x7f1f000cd8c0 2023-09-30T13:55:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4007270 con 0x7f1f000cd8c0 2023-09-30T13:55:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.536+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f001f5d30 con 0x7f1f000cd8c0 2023-09-30T13:55:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.537+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f000c6400 con 0x7f1f000cd8c0 2023-09-30T13:55:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.537+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1ef40073d0 con 0x7f1f000cd8c0 2023-09-30T13:55:44.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.538+0000 7f1eeeffd640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 0x7f1ee006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.538+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ef4088a40 con 0x7f1f000cd8c0 2023-09-30T13:55:44.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.538+0000 7f1efe59c640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 0x7f1ee006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.538+0000 7f1efe59c640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 0x7f1ee006cff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009f50 tx=0x7f1ef800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.542+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1ef408ae60 con 0x7f1f000cd8c0 2023-09-30T13:55:44.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.718+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1f0004e0d0 con 0x7f1f000cd8c0 2023-09-30T13:55:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.718+0000 7f1eeeffd640 1 -- 172.21.15.62:0/2330250474 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1ef4053980 con 0x7f1f000cd8c0 2023-09-30T13:55:44.718 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 msgr2=0x7f1ee006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 0x7f1ee006cff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009f50 tx=0x7f1ef800b040 comp rx=0 tx=0).stop 2023-09-30T13:55:44.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 msgr2=0x7f1f000b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400c4d0 tx=0x7f1ef400c990 comp rx=0 tx=0).stop 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 shutdown_connections 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ee006ab30 0x7f1ee006cff0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f0015cbc0 0x7f1f000b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f000cd8c0 0x7f1f000b5be0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 --2- 172.21.15.62:0/2330250474 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f000b8760 0x7f1f001f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.720+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 >> 172.21.15.62:0/2330250474 conn(0x7f1f000718a0 msgr2=0x7f1f001574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.721+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 shutdown_connections 2023-09-30T13:55:44.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.721+0000 7f1f048bb640 1 -- 172.21.15.62:0/2330250474 wait complete. 2023-09-30T13:55:44.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:44.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 Processor -- start 2023-09-30T13:55:44.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 -- start start 2023-09-30T13:55:44.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8814160160 0x7f88140d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88140cdef0 0x7f88140ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88140cda60 con 0x7f88140d3600 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140ce8e0 con 0x7f88140cdef0 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.838+0000 7f881b1b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140d18a0 con 0x7f8814160160 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f881974d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88140cdef0 0x7f88140ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f8813fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f88140d3600 0x7f88140b5790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45976/0 (socket says 172.21.15.62:45976) 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f8813fff640 1 -- 172.21.15.62:0/2428664229 learned_addr learned my addr 172.21.15.62:0/2428664229 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f8818f4c640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8814160160 0x7f88140d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f881974d640 1 -- 172.21.15.62:0/2428664229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8814160160 msgr2=0x7f88140d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f881974d640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8814160160 0x7f88140d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f881974d640 1 -- 172.21.15.62:0/2428664229 >> v1:172.21.15.62:6789/0 conn(0x7f88140d3600 legacy=0x7f88140b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f88137fe640 1 -- 172.21.15.62:0/2428664229 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955422780 0 0) 0x7f88140cda60 con 0x7f88140d3600 2023-09-30T13:55:44.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.839+0000 7f881974d640 1 -- 172.21.15.62:0/2428664229 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814160540 con 0x7f88140cdef0 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881974d640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88140cdef0 0x7f88140ce3a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f880c009dc0 tx=0x7f880c02bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503f3165888c90c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f88137fe640 1 -- 172.21.15.62:0/2428664229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c02ccd0 con 0x7f88140cdef0 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f88137fe640 1 -- 172.21.15.62:0/2428664229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c02ce30 con 0x7f88140cdef0 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f88137fe640 1 -- 172.21.15.62:0/2428664229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c034660 con 0x7f88140cdef0 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 -- 172.21.15.62:0/2428664229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88140cdef0 msgr2=0x7f88140ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88140cdef0 0x7f88140ce3a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f880c009dc0 tx=0x7f880c02bf20 comp rx=0 tx=0).stop 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 -- 172.21.15.62:0/2428664229 shutdown_connections 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88140cdef0 0x7f88140ce3a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2428664229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8814160160 0x7f88140d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 -- 172.21.15.62:0/2428664229 >> 172.21.15.62:0/2428664229 conn(0x7f8814089fe0 msgr2=0x7f88140d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 -- 172.21.15.62:0/2428664229 shutdown_connections 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.840+0000 7f881b1b0640 1 -- 172.21.15.62:0/2428664229 wait complete. 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.841+0000 7f881b1b0640 1 Processor -- start 2023-09-30T13:55:44.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 -- start start 2023-09-30T13:55:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88140cdef0 0x7f881415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88140d3600 0x7f881415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881415b4a0 con 0x7f8814160160 2023-09-30T13:55:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881409e800 con 0x7f88140d3600 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.842+0000 7f881b1b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881415e250 con 0x7f88140cdef0 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60432/0 (socket says 172.21.15.62:60432) 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 -- 172.21.15.62:0/2202558667 learned_addr learned my addr 172.21.15.62:0/2202558667 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f8818f4c640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88140cdef0 0x7f881415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f8813fff640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88140d3600 0x7f881415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 -- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88140cdef0 msgr2=0x7f881415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88140cdef0 0x7f881415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 -- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88140d3600 msgr2=0x7f881415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88140d3600 0x7f881415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 -- 172.21.15.62:0/2202558667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009a70 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881974d640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f880c02dfd0 tx=0x7f880c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c03d600 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c03d760 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881415e530 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c03daf0 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.843+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881415eaf0 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.844+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814073e70 con 0x7f8814160160 2023-09-30T13:55:44.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.845+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f880c03b040 con 0x7f8814160160 2023-09-30T13:55:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.845+0000 7f88117fa640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 0x7f87f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.845+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f880c0ab9a0 con 0x7f8814160160 2023-09-30T13:55:44.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.845+0000 7f8818f4c640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 0x7f87f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:44.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.846+0000 7f8818f4c640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 0x7f87f806cff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8808009b40 tx=0x7f8808009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:44.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:44.849+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f880c076970 con 0x7f8814160160 2023-09-30T13:55:45.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.038+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88140cfef0 con 0x7f8814160160 2023-09-30T13:55:45.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.038+0000 7f88117fa640 1 -- 172.21.15.62:0/2202558667 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f880c039080 con 0x7f8814160160 2023-09-30T13:55:45.038 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 msgr2=0x7f87f806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 0x7f87f806cff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8808009b40 tx=0x7f8808009190 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 msgr2=0x7f881409e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f880c02dfd0 tx=0x7f880c004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 shutdown_connections 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87f806ab30 0x7f87f806cff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8814160160 0x7f881409e2c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88140d3600 0x7f881415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 --2- 172.21.15.62:0/2202558667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88140cdef0 0x7f881415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 >> 172.21.15.62:0/2202558667 conn(0x7f8814089fe0 msgr2=0x7f88140b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 shutdown_connections 2023-09-30T13:55:45.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.040+0000 7f881b1b0640 1 -- 172.21.15.62:0/2202558667 wait complete. 2023-09-30T13:55:45.050 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:55:45.050 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:45.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:45.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.212+0000 7f71a8694640 1 Processor -- start 2023-09-30T13:55:45.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.212+0000 7f71a8694640 1 -- start start 2023-09-30T13:55:45.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a8694640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f71a00d06b0 0x7f71a006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a8694640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a00d0b20 con 0x7f71a015cbe0 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a8694640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a00cf450 con 0x7f71a00d1410 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a8694640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00cfcf0 con 0x7f71a00d06b0 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a6c31640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f71a00d06b0 0x7f71a006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a6430640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f71a015cbe0 0x7f71a00d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45990/0 (socket says 172.21.15.62:45990) 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.213+0000 7f71a6430640 1 -- 172.21.15.62:0/706412748 learned_addr learned my addr 172.21.15.62:0/706412748 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.214+0000 7f71a6c31640 1 -- 172.21.15.62:0/706412748 >> v1:172.21.15.135:6789/0 conn(0x7f71a00d1410 legacy=0x7f71a006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.214+0000 7f71a6c31640 1 -- 172.21.15.62:0/706412748 >> v1:172.21.15.62:6789/0 conn(0x7f71a015cbe0 legacy=0x7f71a00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.214+0000 7f71a6c31640 1 -- 172.21.15.62:0/706412748 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a00cf730 con 0x7f71a00d06b0 2023-09-30T13:55:45.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.214+0000 7f71a542e640 1 -- 172.21.15.62:0/706412748 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287806268 0 0) 0x7f71a00d0b20 con 0x7f71a015cbe0 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.214+0000 7f71a6c31640 1 --2- 172.21.15.62:0/706412748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d06b0 0x7f71a006bd60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71980097a0 tx=0x7f719802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4068ae142f90412 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a542e640 1 -- 172.21.15.62:0/706412748 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719802f810 con 0x7f71a00d06b0 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a542e640 1 -- 172.21.15.62:0/706412748 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719802f970 con 0x7f71a00d06b0 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a542e640 1 -- 172.21.15.62:0/706412748 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719802fd00 con 0x7f71a00d06b0 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 -- 172.21.15.62:0/706412748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d06b0 msgr2=0x7f71a006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 --2- 172.21.15.62:0/706412748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d06b0 0x7f71a006bd60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71980097a0 tx=0x7f719802b9f0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 -- 172.21.15.62:0/706412748 shutdown_connections 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 --2- 172.21.15.62:0/706412748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d06b0 0x7f71a006bd60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 -- 172.21.15.62:0/706412748 >> 172.21.15.62:0/706412748 conn(0x7f71a0089fe0 msgr2=0x7f71a00d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 -- 172.21.15.62:0/706412748 shutdown_connections 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.215+0000 7f71a8694640 1 -- 172.21.15.62:0/706412748 wait complete. 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.216+0000 7f71a8694640 1 Processor -- start 2023-09-30T13:55:45.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 -- start start 2023-09-30T13:55:45.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a00d06b0 0x7f71a00c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71a015cbe0 0x7f71a00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a015f3c0 con 0x7f71a00d1410 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00cc910 con 0x7f71a015cbe0 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a8694640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00c9f20 con 0x7f71a00d06b0 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a5c2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a5c2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60444/0 (socket says 172.21.15.62:60444) 2023-09-30T13:55:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.217+0000 7f71a5c2f640 1 -- 172.21.15.62:0/2742749384 learned_addr learned my addr 172.21.15.62:0/2742749384 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 -- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a00d06b0 msgr2=0x7f71a00c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a00d06b0 0x7f71a00c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 -- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71a015cbe0 msgr2=0x7f71a00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71a015cbe0 0x7f71a00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 -- 172.21.15.62:0/2742749384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009400 con 0x7f71a00d1410 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a5c2f640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f719400c480 tx=0x7f719400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940052d0 con 0x7f71a00d1410 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194005430 con 0x7f71a00d1410 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a01591f0 con 0x7f71a00d1410 2023-09-30T13:55:45.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194012870 con 0x7f71a00d1410 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.218+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a015f8f0 con 0x7f71a00d1410 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.219+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a004e0d0 con 0x7f71a00d1410 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.219+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f71940129d0 con 0x7f71a00d1410 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.220+0000 7f719effd640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 0x7f718c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.220+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7194089100 con 0x7f71a00d1410 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.220+0000 7f71a6430640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 0x7f718c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.221+0000 7f71a6430640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 0x7f718c06cff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7190000f80 tx=0x7f7190007c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.224+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7194054020 con 0x7f71a00d1410 2023-09-30T13:55:45.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.399+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71a00b8750 con 0x7f71a00d1410 2023-09-30T13:55:45.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.400+0000 7f719effd640 1 -- 172.21.15.62:0/2742749384 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f7194057640 con 0x7f71a00d1410 2023-09-30T13:55:45.400 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:45.400 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 msgr2=0x7f718c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 0x7f718c06cff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7190000f80 tx=0x7f7190007c70 comp rx=0 tx=0).stop 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 msgr2=0x7f71a0158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f719400c480 tx=0x7f719400c940 comp rx=0 tx=0).stop 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 shutdown_connections 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f718c06ab30 0x7f718c06cff0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71a015cbe0 0x7f71a00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71a00d1410 0x7f71a0158750 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 --2- 172.21.15.62:0/2742749384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a00d06b0 0x7f71a00c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 >> 172.21.15.62:0/2742749384 conn(0x7f71a0089fe0 msgr2=0x7f71a006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 shutdown_connections 2023-09-30T13:55:45.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.403+0000 7f71a8694640 1 -- 172.21.15.62:0/2742749384 wait complete. 2023-09-30T13:55:45.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:45.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.523+0000 7fec154c9640 1 Processor -- start 2023-09-30T13:55:45.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.523+0000 7fec154c9640 1 -- start start 2023-09-30T13:55:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec154c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fec1015ce90 0x7fec1006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec154c9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec1006b420 0x7fec1006ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec154c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1006f680 con 0x7fec1006f270 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec154c9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100ce3f0 con 0x7fec1006b420 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec154c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1006a120 con 0x7fec1015ce90 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec0e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec1006b420 0x7fec1006ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec0e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec1006b420 0x7fec1006ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60460/0 (socket says 172.21.15.62:60460) 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.524+0000 7fec0e7fc640 1 -- 172.21.15.62:0/620529901 learned_addr learned my addr 172.21.15.62:0/620529901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0effd640 1 --2- 172.21.15.62:0/620529901 >> v2:172.21.15.135:3300/0 conn(0x7fec1015ce90 0x7fec1006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0e7fc640 1 -- 172.21.15.62:0/620529901 >> v2:172.21.15.135:3300/0 conn(0x7fec1015ce90 msgr2=0x7fec1006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0e7fc640 1 --2- 172.21.15.62:0/620529901 >> v2:172.21.15.135:3300/0 conn(0x7fec1015ce90 0x7fec1006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0e7fc640 1 -- 172.21.15.62:0/620529901 >> v1:172.21.15.135:6789/0 conn(0x7fec1006f270 legacy=0x7fec100ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0e7fc640 1 -- 172.21.15.62:0/620529901 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1006a400 con 0x7fec1006b420 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.525+0000 7fec0e7fc640 1 --2- 172.21.15.62:0/620529901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1006b420 0x7fec1006ed30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec100b2330 tx=0x7febf802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd04dcb2c066101 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec0dffb640 1 -- 172.21.15.62:0/620529901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8030860 con 0x7fec1006b420 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec0dffb640 1 -- 172.21.15.62:0/620529901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80309c0 con 0x7fec1006b420 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec0dffb640 1 -- 172.21.15.62:0/620529901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8030d50 con 0x7fec1006b420 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 -- 172.21.15.62:0/620529901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1006b420 msgr2=0x7fec1006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 --2- 172.21.15.62:0/620529901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1006b420 0x7fec1006ed30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec100b2330 tx=0x7febf802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 -- 172.21.15.62:0/620529901 shutdown_connections 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 --2- 172.21.15.62:0/620529901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1006b420 0x7fec1006ed30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 --2- 172.21.15.62:0/620529901 >> v2:172.21.15.135:3300/0 conn(0x7fec1015ce90 0x7fec1006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 -- 172.21.15.62:0/620529901 >> 172.21.15.62:0/620529901 conn(0x7fec100cc180 msgr2=0x7fec100cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 -- 172.21.15.62:0/620529901 shutdown_connections 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.526+0000 7fec154c9640 1 -- 172.21.15.62:0/620529901 wait complete. 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.527+0000 7fec154c9640 1 Processor -- start 2023-09-30T13:55:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 -- start start 2023-09-30T13:55:45.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec1006f270 0x7fec100c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec1015dec0 0x7fec1015f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100aba00 con 0x7fec1015ce90 2023-09-30T13:55:45.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015ecd0 con 0x7fec1006f270 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec154c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015e430 con 0x7fec1015dec0 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec0e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec0e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60476/0 (socket says 172.21.15.62:60476) 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.528+0000 7fec0e7fc640 1 -- 172.21.15.62:0/2573292209 learned_addr learned my addr 172.21.15.62:0/2573292209 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 -- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec1015dec0 msgr2=0x7fec1015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec1015dec0 0x7fec1015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 -- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec1006f270 msgr2=0x7fec100c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0effd640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec1006f270 0x7fec100c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec1006f270 0x7fec100c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 -- 172.21.15.62:0/2573292209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80094d0 con 0x7fec1015ce90 2023-09-30T13:55:45.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec0e7fc640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7febf802b9e0 tx=0x7febf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8039b60 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8039ce0 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1015e710 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8043650 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.529+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100c6000 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.530+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100abb70 con 0x7fec1015ce90 2023-09-30T13:55:45.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.531+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7febf802f3b0 con 0x7fec1015ce90 2023-09-30T13:55:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.531+0000 7fec077fe640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 0x7febf006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.531+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febf80ab8b0 con 0x7fec1015ce90 2023-09-30T13:55:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.531+0000 7fec0effd640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 0x7febf006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.532+0000 7fec0effd640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 0x7febf006cff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec08006fd0 tx=0x7fec08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.536+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7febf8076740 con 0x7fec1015ce90 2023-09-30T13:55:45.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.710+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec1004e0d0 con 0x7fec1015ce90 2023-09-30T13:55:45.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.710+0000 7fec077fe640 1 -- 172.21.15.62:0/2573292209 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7febf80480a0 con 0x7fec1015ce90 2023-09-30T13:55:45.710 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:45.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.712+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 msgr2=0x7febf006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.712+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 0x7febf006cff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec08006fd0 tx=0x7fec08008040 comp rx=0 tx=0).stop 2023-09-30T13:55:45.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.712+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 msgr2=0x7fec10156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.712+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7febf802b9e0 tx=0x7febf8004730 comp rx=0 tx=0).stop 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 shutdown_connections 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7febf006ab30 0x7febf006cff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec1015dec0 0x7fec1015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec1015ce90 0x7fec10156d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 --2- 172.21.15.62:0/2573292209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec1006f270 0x7fec100c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 >> 172.21.15.62:0/2573292209 conn(0x7fec100cc180 msgr2=0x7fec1015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 shutdown_connections 2023-09-30T13:55:45.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.713+0000 7fec154c9640 1 -- 172.21.15.62:0/2573292209 wait complete. 2023-09-30T13:55:45.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:45.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.832+0000 7f1ad2533640 1 Processor -- start 2023-09-30T13:55:45.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.832+0000 7f1ad2533640 1 -- start start 2023-09-30T13:55:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.832+0000 7f1ad2533640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b2160 0x7f1acc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.832+0000 7f1ad2533640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1acc0b0a70 0x7f1acc0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.832+0000 7f1ad2533640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc071170 con 0x7f1acc0b4230 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1ad2533640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc15afa0 con 0x7f1acc0b0a70 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1ad2533640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0b0ef0 con 0x7f1acc0b2160 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1acb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1acc0b0a70 0x7f1acc0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1ad0ad0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1acc0b4230 0x7f1acc15e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46006/0 (socket says 172.21.15.62:46006) 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1ad0ad0640 1 -- 172.21.15.62:0/876200107 learned_addr learned my addr 172.21.15.62:0/876200107 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1acb7fe640 1 -- 172.21.15.62:0/876200107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b2160 msgr2=0x7f1acc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1acb7fe640 1 --2- 172.21.15.62:0/876200107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b2160 0x7f1acc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1acb7fe640 1 -- 172.21.15.62:0/876200107 >> v1:172.21.15.62:6789/0 conn(0x7f1acc0b4230 legacy=0x7f1acc15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.833+0000 7f1acb7fe640 1 -- 172.21.15.62:0/876200107 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc15b190 con 0x7f1acc0b0a70 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1acb7fe640 1 --2- 172.21.15.62:0/876200107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b0a70 0x7f1acc0b3cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097a0 tx=0x7f1ac002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62437c50f05ac26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1acaffd640 1 -- 172.21.15.62:0/876200107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0031830 con 0x7f1acc0b0a70 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1acaffd640 1 -- 172.21.15.62:0/876200107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0031990 con 0x7f1acc0b0a70 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1acaffd640 1 -- 172.21.15.62:0/876200107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0031d20 con 0x7f1acc0b0a70 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 -- 172.21.15.62:0/876200107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b0a70 msgr2=0x7f1acc0b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 --2- 172.21.15.62:0/876200107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b0a70 0x7f1acc0b3cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097a0 tx=0x7f1ac002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 -- 172.21.15.62:0/876200107 shutdown_connections 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 --2- 172.21.15.62:0/876200107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b0a70 0x7f1acc0b3cf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 --2- 172.21.15.62:0/876200107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b2160 0x7f1acc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 -- 172.21.15.62:0/876200107 >> 172.21.15.62:0/876200107 conn(0x7f1acc0cb720 msgr2=0x7f1acc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 -- 172.21.15.62:0/876200107 shutdown_connections 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.834+0000 7f1ad2533640 1 -- 172.21.15.62:0/876200107 wait complete. 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.836+0000 7f1ad2533640 1 Processor -- start 2023-09-30T13:55:45.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.836+0000 7f1ad2533640 1 -- start start 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 0x7f1acc152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 0x7f1acc159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1f2050 con 0x7f1acc0b2160 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc152eb0 con 0x7f1acc0b0a70 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1f2e10 con 0x7f1acc0b4230 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60500/0 (socket says 172.21.15.62:60500) 2023-09-30T13:55:45.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 -- 172.21.15.62:0/1027869399 learned_addr learned my addr 172.21.15.62:0/1027869399 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acbfff640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 0x7f1acc152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad0ad0640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 0x7f1acc159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 -- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 msgr2=0x7f1acc159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 0x7f1acc159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 -- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 msgr2=0x7f1acc152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 0x7f1acc152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 -- 172.21.15.62:0/1027869399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0009400 con 0x7f1acc0b2160 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acbfff640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 0x7f1acc152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad0ad0640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 0x7f1acc159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1acb7fe640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098c0 tx=0x7f1ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac003aa60 con 0x7f1acc0b2160 2023-09-30T13:55:45.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac003abc0 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc1f2240 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00423f0 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.837+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc1f27c0 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.838+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc1f2f80 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.839+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1ac004b3b0 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.839+0000 7f1ac8ff9640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 0x7f1ab806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.839+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ac00ab490 con 0x7f1acc0b2160 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.839+0000 7f1acbfff640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 0x7f1ab806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.840+0000 7f1acbfff640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 0x7f1ab806cff0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1abc006fd0 tx=0x7f1abc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:45.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:45.843+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1ac0076320 con 0x7f1acc0b2160 2023-09-30T13:55:46.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.017+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1acc04e0d0 con 0x7f1acc0b2160 2023-09-30T13:55:46.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.018+0000 7f1ac8ff9640 1 -- 172.21.15.62:0/1027869399 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ac0079940 con 0x7f1acc0b2160 2023-09-30T13:55:46.018 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:46.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.019+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 msgr2=0x7f1ab806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.019+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 0x7f1ab806cff0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1abc006fd0 tx=0x7f1abc008040 comp rx=0 tx=0).stop 2023-09-30T13:55:46.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.019+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 msgr2=0x7f1acc159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.019+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098c0 tx=0x7f1ac00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 shutdown_connections 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1ab806ab30 0x7f1ab806cff0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1acc0b4230 0x7f1acc159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1acc0b2160 0x7f1acc159a90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 --2- 172.21.15.62:0/1027869399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1acc0b0a70 0x7f1acc152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 >> 172.21.15.62:0/1027869399 conn(0x7f1acc0cb720 msgr2=0x7f1acc153050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 shutdown_connections 2023-09-30T13:55:46.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.020+0000 7f1ad2533640 1 -- 172.21.15.62:0/1027869399 wait complete. 2023-09-30T13:55:46.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:46.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 Processor -- start 2023-09-30T13:55:46.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 -- start start 2023-09-30T13:55:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c7415ce90 0x7f0c7406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c7406b420 0x7f0c7406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7406f680 con 0x7f0c7406b420 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c740ce3f0 con 0x7f0c7415ce90 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.140+0000 7f0c7ac75640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7406a120 con 0x7f0c7406f270 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c7406b420 0x7f0c7406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c7406b420 0x7f0c7406ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60516/0 (socket says 172.21.15.62:60516) 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 -- 172.21.15.62:0/837573365 learned_addr learned my addr 172.21.15.62:0/837573365 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 -- 172.21.15.62:0/837573365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 msgr2=0x7f0c740ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 --2- 172.21.15.62:0/837573365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 -- 172.21.15.62:0/837573365 >> v2:172.21.15.135:3300/0 conn(0x7f0c7415ce90 msgr2=0x7f0c7406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 --2- 172.21.15.62:0/837573365 >> v2:172.21.15.135:3300/0 conn(0x7f0c7415ce90 0x7f0c7406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.141+0000 7f0c73fff640 1 -- 172.21.15.62:0/837573365 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7406a400 con 0x7f0c7406b420 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c73fff640 1 --2- 172.21.15.62:0/837573365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c7406b420 0x7f0c7406ed30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c740b2330 tx=0x7f0c6002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be08e79d7d2f1b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c737fe640 1 -- 172.21.15.62:0/837573365 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60031860 con 0x7f0c7406b420 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c737fe640 1 -- 172.21.15.62:0/837573365 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600319c0 con 0x7f0c7406b420 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c737fe640 1 -- 172.21.15.62:0/837573365 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60031d50 con 0x7f0c7406b420 2023-09-30T13:55:46.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 -- 172.21.15.62:0/837573365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c7406b420 msgr2=0x7f0c7406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/837573365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c7406b420 0x7f0c7406ed30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c740b2330 tx=0x7f0c6002b900 comp rx=0 tx=0).stop 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 -- 172.21.15.62:0/837573365 shutdown_connections 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/837573365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/837573365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c7406b420 0x7f0c7406ed30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/837573365 >> v2:172.21.15.135:3300/0 conn(0x7f0c7415ce90 0x7f0c7406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 -- 172.21.15.62:0/837573365 >> 172.21.15.62:0/837573365 conn(0x7f0c740cc180 msgr2=0x7f0c740cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 -- 172.21.15.62:0/837573365 shutdown_connections 2023-09-30T13:55:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.142+0000 7f0c7ac75640 1 -- 172.21.15.62:0/837573365 wait complete. 2023-09-30T13:55:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 Processor -- start 2023-09-30T13:55:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 -- start start 2023-09-30T13:55:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 0x7f0c74148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.144+0000 7f0c7ac75640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740ae1a0 con 0x7f0c74148e70 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c7ac75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c74149320 con 0x7f0c7415ce90 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c7ac75640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740c4dd0 con 0x7f0c7406f270 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60532/0 (socket says 172.21.15.62:60532) 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 -- 172.21.15.62:0/1121749398 learned_addr learned my addr 172.21.15.62:0/1121749398 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c78a11640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c73fff640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 0x7f0c74148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 -- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 msgr2=0x7f0c740c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 -- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 msgr2=0x7f0c74148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 0x7f0c74148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 -- 172.21.15.62:0/1121749398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600094d0 con 0x7f0c74148e70 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c73fff640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 0x7f0c74148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c79212640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00b9a0 tx=0x7f0c6c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00cba0 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00cd20 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c740c50b0 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c014680 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.145+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c740c5670 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.146+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7404e0d0 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.147+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0c6c01d3b0 con 0x7f0c74148e70 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.147+0000 7f0c717fa640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 0x7f0c5806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.147+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c6c089600 con 0x7f0c74148e70 2023-09-30T13:55:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.147+0000 7f0c78a11640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 0x7f0c5806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.148+0000 7f0c78a11640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 0x7f0c5806cff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009890 tx=0x7f0c68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.151+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0c6c0543f0 con 0x7f0c74148e70 2023-09-30T13:55:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.327+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c740c2f20 con 0x7f0c74148e70 2023-09-30T13:55:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.328+0000 7f0c717fa640 1 -- 172.21.15.62:0/1121749398 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c6c057a10 con 0x7f0c74148e70 2023-09-30T13:55:46.328 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 msgr2=0x7f0c5806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 0x7f0c5806cff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009890 tx=0x7f0c68008040 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 msgr2=0x7f0c741f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00b9a0 tx=0x7f0c6c00be60 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 shutdown_connections 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c5806ab30 0x7f0c5806cff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c74148e70 0x7f0c741f1870 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7415ce90 0x7f0c74148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 --2- 172.21.15.62:0/1121749398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c7406f270 0x7f0c740c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 >> 172.21.15.62:0/1121749398 conn(0x7f0c740cc180 msgr2=0x7f0c740af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 shutdown_connections 2023-09-30T13:55:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.330+0000 7f0c7ac75640 1 -- 172.21.15.62:0/1121749398 wait complete. 2023-09-30T13:55:46.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:46.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.451+0000 7f309a0a2640 1 Processor -- start 2023-09-30T13:55:46.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.451+0000 7f309a0a2640 1 -- start start 2023-09-30T13:55:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f309a0a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 0x7f3094071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f309a0a2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f309415cee0 0x7f30940c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f309a0a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940c9a00 con 0x7f30940ae300 2023-09-30T13:55:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f309a0a2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309406d740 con 0x7f309415cee0 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f309a0a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309406da20 con 0x7f309415cb00 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f309415cee0 0x7f30940c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f309415cee0 0x7f30940c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60540/0 (socket says 172.21.15.62:60540) 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 -- 172.21.15.62:0/504029412 learned_addr learned my addr 172.21.15.62:0/504029412 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f30937fe640 1 --2- 172.21.15.62:0/504029412 >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 0x7f3094071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 -- 172.21.15.62:0/504029412 >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 msgr2=0x7f3094071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 --2- 172.21.15.62:0/504029412 >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 0x7f3094071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.452+0000 7f3092ffd640 1 -- 172.21.15.62:0/504029412 >> v1:172.21.15.135:6789/0 conn(0x7f30940ae300 legacy=0x7f309406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f3092ffd640 1 -- 172.21.15.62:0/504029412 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309406dd00 con 0x7f309415cee0 2023-09-30T13:55:46.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f30937fe640 1 --2- 172.21.15.62:0/504029412 >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 0x7f3094071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f3092ffd640 1 --2- 172.21.15.62:0/504029412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415cee0 0x7f30940c94c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3094066910 tx=0x7f308802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87842c7ecefbee9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f30927fc640 1 -- 172.21.15.62:0/504029412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088030860 con 0x7f309415cee0 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f30927fc640 1 -- 172.21.15.62:0/504029412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880309c0 con 0x7f309415cee0 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.453+0000 7f30927fc640 1 -- 172.21.15.62:0/504029412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088030d50 con 0x7f309415cee0 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 -- 172.21.15.62:0/504029412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415cee0 msgr2=0x7f30940c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 --2- 172.21.15.62:0/504029412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415cee0 0x7f30940c94c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3094066910 tx=0x7f308802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 -- 172.21.15.62:0/504029412 shutdown_connections 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 --2- 172.21.15.62:0/504029412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415cee0 0x7f30940c94c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 --2- 172.21.15.62:0/504029412 >> v2:172.21.15.135:3300/0 conn(0x7f309415cb00 0x7f3094071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 -- 172.21.15.62:0/504029412 >> 172.21.15.62:0/504029412 conn(0x7f3094070970 msgr2=0x7f3094070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 -- 172.21.15.62:0/504029412 shutdown_connections 2023-09-30T13:55:46.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.454+0000 7f309a0a2640 1 -- 172.21.15.62:0/504029412 wait complete. 2023-09-30T13:55:46.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.455+0000 7f309a0a2640 1 Processor -- start 2023-09-30T13:55:46.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.455+0000 7f309a0a2640 1 -- start start 2023-09-30T13:55:46.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30940ae300 0x7f309414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f309415cb00 0x7f309415f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940b1bf0 con 0x7f309415d2c0 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309415e1a0 con 0x7f309415cb00 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f309a0a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309415e480 con 0x7f30940ae300 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60544/0 (socket says 172.21.15.62:60544) 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 -- 172.21.15.62:0/1490310555 learned_addr learned my addr 172.21.15.62:0/1490310555 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 -- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30940ae300 msgr2=0x7f309414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30940ae300 0x7f309414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3092ffd640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f309415cb00 0x7f309415f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 -- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f309415cb00 msgr2=0x7f309415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f309415cb00 0x7f309415f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.456+0000 7f3093fff640 1 -- 172.21.15.62:0/1490310555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880094d0 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f3093fff640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c730 tx=0x7f308c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c003b70 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c003cf0 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c003ea0 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309415e760 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.457+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309415ed20 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.458+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30940666d0 con 0x7f309415d2c0 2023-09-30T13:55:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.458+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f308c005520 con 0x7f309415d2c0 2023-09-30T13:55:46.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.459+0000 7f307bfff640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 0x7f308006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.459+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f308c0894d0 con 0x7f309415d2c0 2023-09-30T13:55:46.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.459+0000 7f30937fe640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 0x7f308006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.460+0000 7f30937fe640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 0x7f308006d020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3084006e80 tx=0x7f3084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.463+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f308c0543f0 con 0x7f309415d2c0 2023-09-30T13:55:46.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.640+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f309404e0d0 con 0x7f309415d2c0 2023-09-30T13:55:46.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.644+0000 7f307bfff640 1 -- 172.21.15.62:0/1490310555 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f308c057a10 con 0x7f309415d2c0 2023-09-30T13:55:46.644 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 msgr2=0x7f308006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 0x7f308006d020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3084006e80 tx=0x7f3084008040 comp rx=0 tx=0).stop 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 msgr2=0x7f309415f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c730 tx=0x7f308c00cbf0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 shutdown_connections 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308006ab60 0x7f308006d020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f309415d2c0 0x7f309415f990 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f309415cb00 0x7f309415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 --2- 172.21.15.62:0/1490310555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30940ae300 0x7f309414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 >> 172.21.15.62:0/1490310555 conn(0x7f3094070970 msgr2=0x7f30940afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 shutdown_connections 2023-09-30T13:55:46.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.646+0000 7f309a0a2640 1 -- 172.21.15.62:0/1490310555 wait complete. 2023-09-30T13:55:46.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:46.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.764+0000 7f87377e2640 1 Processor -- start 2023-09-30T13:55:46.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.764+0000 7f87377e2640 1 -- start start 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f87377e2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 0x7f87300d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f87377e2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 0x7f873006b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f87377e2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87300cf520 con 0x7f873006b5b0 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f87377e2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300ce500 con 0x7f87301605a0 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f87377e2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300b1d20 con 0x7f87301601c0 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8735d7f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f873006b5b0 0x7f87300cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46016/0 (socket says 172.21.15.62:46016) 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8735d7f640 1 -- 172.21.15.62:0/131067805 learned_addr learned my addr 172.21.15.62:0/131067805 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f873557e640 1 --2- 172.21.15.62:0/131067805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 0x7f87300d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8734d7d640 1 --2- 172.21.15.62:0/131067805 >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 0x7f873006b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8727fff640 1 -- 172.21.15.62:0/131067805 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938061622 0 0) 0x7f87300cf520 con 0x7f873006b5b0 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8727fff640 1 -- 172.21.15.62:0/131067805 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f871c003520 con 0x7f873006b5b0 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f873557e640 1 -- 172.21.15.62:0/131067805 >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 msgr2=0x7f873006b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f873557e640 1 --2- 172.21.15.62:0/131067805 >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 0x7f873006b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f873557e640 1 -- 172.21.15.62:0/131067805 >> v1:172.21.15.62:6789/0 conn(0x7f873006b5b0 legacy=0x7f87300cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f873557e640 1 -- 172.21.15.62:0/131067805 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300caf00 con 0x7f87301601c0 2023-09-30T13:55:46.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.765+0000 7f8734d7d640 1 --2- 172.21.15.62:0/131067805 >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 0x7f873006b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.766+0000 7f873557e640 1 --2- 172.21.15.62:0/131067805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 0x7f87300d1330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097a0 tx=0x7f872c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a13d5865026708 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.766+0000 7f8727fff640 1 -- 172.21.15.62:0/131067805 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c031830 con 0x7f87301601c0 2023-09-30T13:55:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f8727fff640 1 -- 172.21.15.62:0/131067805 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c031990 con 0x7f87301601c0 2023-09-30T13:55:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f8727fff640 1 -- 172.21.15.62:0/131067805 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c031d00 con 0x7f87301601c0 2023-09-30T13:55:46.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 -- 172.21.15.62:0/131067805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 msgr2=0x7f87300d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 --2- 172.21.15.62:0/131067805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 0x7f87300d1330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097a0 tx=0x7f872c02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 -- 172.21.15.62:0/131067805 shutdown_connections 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 --2- 172.21.15.62:0/131067805 >> v2:172.21.15.135:3300/0 conn(0x7f87301605a0 0x7f873006b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 --2- 172.21.15.62:0/131067805 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87301601c0 0x7f87300d1330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 -- 172.21.15.62:0/131067805 >> 172.21.15.62:0/131067805 conn(0x7f87300d0810 msgr2=0x7f87300d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 -- 172.21.15.62:0/131067805 shutdown_connections 2023-09-30T13:55:46.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.767+0000 7f87377e2640 1 -- 172.21.15.62:0/131067805 wait complete. 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.768+0000 7f87377e2640 1 Processor -- start 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.768+0000 7f87377e2640 1 -- start start 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f873006b5b0 0x7f87300b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301601c0 0x7f873014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300b66e0 con 0x7f87301f20f0 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873015b140 con 0x7f87301601c0 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f87377e2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c95c0 con 0x7f873006b5b0 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60552/0 (socket says 172.21.15.62:60552) 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 -- 172.21.15.62:0/533422446 learned_addr learned my addr 172.21.15.62:0/533422446 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f873557e640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f873006b5b0 0x7f87300b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8734d7d640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301601c0 0x7f873014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 -- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f873006b5b0 msgr2=0x7f87300b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f873006b5b0 0x7f87300b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 -- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301601c0 msgr2=0x7f873014eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301601c0 0x7f873014eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.769+0000 7f8735d7f640 1 -- 172.21.15.62:0/533422446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009400 con 0x7f87301f20f0 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f8735d7f640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f872800cad0 tx=0x7f872800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800ac30 con 0x7f87301f20f0 2023-09-30T13:55:46.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872800ad90 con 0x7f87301f20f0 2023-09-30T13:55:46.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c009400 con 0x7f87301f20f0 2023-09-30T13:55:46.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728012620 con 0x7f87301f20f0 2023-09-30T13:55:46.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.770+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87300b6120 con 0x7f87301f20f0 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.771+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8730073e70 con 0x7f87301f20f0 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.772+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8728007070 con 0x7f87301f20f0 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.772+0000 7f8725ffb640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 0x7f871406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.772+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f87280894a0 con 0x7f87301f20f0 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.772+0000 7f873557e640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 0x7f871406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:46.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.773+0000 7f873557e640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 0x7f871406cff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f872c036000 tx=0x7f872c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:46.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.776+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f87280543f0 con 0x7f87301f20f0 2023-09-30T13:55:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.964+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f873014f090 con 0x7f87301f20f0 2023-09-30T13:55:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.965+0000 7f8725ffb640 1 -- 172.21.15.62:0/533422446 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8728057a10 con 0x7f87301f20f0 2023-09-30T13:55:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 msgr2=0x7f871406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 0x7f871406cff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f872c036000 tx=0x7f872c03c040 comp rx=0 tx=0).stop 2023-09-30T13:55:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 msgr2=0x7f873015e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:46.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f872800cad0 tx=0x7f872800cf90 comp rx=0 tx=0).stop 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 shutdown_connections 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f871406ab30 0x7f871406cff0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87301f20f0 0x7f873015e670 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301601c0 0x7f873014eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 --2- 172.21.15.62:0/533422446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f873006b5b0 0x7f87300b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 >> 172.21.15.62:0/533422446 conn(0x7f87300d0810 msgr2=0x7f873015cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 shutdown_connections 2023-09-30T13:55:46.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:46.967+0000 7f87377e2640 1 -- 172.21.15.62:0/533422446 wait complete. 2023-09-30T13:55:46.977 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:55:46.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:46.977 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-09-30T13:55:47.008 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:47.008 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:55:47.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:47.009 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-30T13:55:47.064 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:47.064 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:47.083 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:47.083 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:47.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:47.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.248+0000 7f0214c83640 1 Processor -- start 2023-09-30T13:55:47.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.248+0000 7f0214c83640 1 -- start start 2023-09-30T13:55:47.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f0214c83640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02101598c0 0x7f02100ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f0214c83640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02100ceea0 0x7f021015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f0214c83640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100b1e20 con 0x7f02100cea30 2023-09-30T13:55:47.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f0214c83640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100b1530 con 0x7f02100ceea0 2023-09-30T13:55:47.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f0214c83640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100b17d0 con 0x7f02101598c0 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02100ceea0 0x7f021015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020dd9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f02100cea30 0x7f021015d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46032/0 (socket says 172.21.15.62:46032) 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020dd9b640 1 -- 172.21.15.62:0/3597520208 learned_addr learned my addr 172.21.15.62:0/3597520208 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020e59c640 1 --2- 172.21.15.62:0/3597520208 >> v2:172.21.15.135:3300/0 conn(0x7f02101598c0 0x7f02100ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020ed9d640 1 -- 172.21.15.62:0/3597520208 >> v2:172.21.15.135:3300/0 conn(0x7f02101598c0 msgr2=0x7f02100ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020ed9d640 1 --2- 172.21.15.62:0/3597520208 >> v2:172.21.15.135:3300/0 conn(0x7f02101598c0 0x7f02100ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.249+0000 7f020ed9d640 1 -- 172.21.15.62:0/3597520208 >> v1:172.21.15.62:6789/0 conn(0x7f02100cea30 legacy=0x7f021015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020d59a640 1 -- 172.21.15.62:0/3597520208 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683460814 0 0) 0x7f02100b1e20 con 0x7f02100cea30 2023-09-30T13:55:47.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020ed9d640 1 -- 172.21.15.62:0/3597520208 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100b1ab0 con 0x7f02100ceea0 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020ed9d640 1 --2- 172.21.15.62:0/3597520208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015dc30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574c268133b8c614 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020d59a640 1 -- 172.21.15.62:0/3597520208 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208031830 con 0x7f02100ceea0 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020d59a640 1 -- 172.21.15.62:0/3597520208 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208031990 con 0x7f02100ceea0 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.250+0000 7f020d59a640 1 -- 172.21.15.62:0/3597520208 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208031d20 con 0x7f02100ceea0 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 -- 172.21.15.62:0/3597520208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 msgr2=0x7f021015dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 --2- 172.21.15.62:0/3597520208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015dc30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 -- 172.21.15.62:0/3597520208 shutdown_connections 2023-09-30T13:55:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 --2- 172.21.15.62:0/3597520208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015dc30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 --2- 172.21.15.62:0/3597520208 >> v2:172.21.15.135:3300/0 conn(0x7f02101598c0 0x7f02100ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 -- 172.21.15.62:0/3597520208 >> 172.21.15.62:0/3597520208 conn(0x7f021006a170 msgr2=0x7f021006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 -- 172.21.15.62:0/3597520208 shutdown_connections 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.251+0000 7f0214c83640 1 -- 172.21.15.62:0/3597520208 wait complete. 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.252+0000 7f0214c83640 1 Processor -- start 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.252+0000 7f0214c83640 1 -- start start 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02100cea30 0x7f0210154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101598c0 0x7f021015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c17c0 con 0x7f02100ceea0 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021015be30 con 0x7f02101598c0 2023-09-30T13:55:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f0214c83640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210154c90 con 0x7f02100cea30 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f020dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f020dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60576/0 (socket says 172.21.15.62:60576) 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.253+0000 7f020dd9b640 1 -- 172.21.15.62:0/1673529289 learned_addr learned my addr 172.21.15.62:0/1673529289 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020ed9d640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101598c0 0x7f021015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020e59c640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02100cea30 0x7f0210154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 -- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02100cea30 msgr2=0x7f0210154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02100cea30 0x7f0210154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 -- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101598c0 msgr2=0x7f021015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101598c0 0x7f021015b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 -- 172.21.15.62:0/1673529289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009400 con 0x7f02100ceea0 2023-09-30T13:55:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f020dd9b640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c500 tx=0x7f01f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8007560 con 0x7f02100ceea0 2023-09-30T13:55:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80047e0 con 0x7f02100ceea0 2023-09-30T13:55:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021015c2c0 con 0x7f02100ceea0 2023-09-30T13:55:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004b90 con 0x7f02100ceea0 2023-09-30T13:55:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.254+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021006dcc0 con 0x7f02100ceea0 2023-09-30T13:55:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.255+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100ca420 con 0x7f02100ceea0 2023-09-30T13:55:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.255+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f01f8004cf0 con 0x7f02100ceea0 2023-09-30T13:55:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.256+0000 7f0206ffd640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 0x7f01f006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.256+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f01f8088ab0 con 0x7f02100ceea0 2023-09-30T13:55:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.256+0000 7f020e59c640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 0x7f01f006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.257+0000 7f020e59c640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 0x7f01f006cff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0200008ea0 tx=0x7f02000083f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.260+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f01f80539d0 con 0x7f02100ceea0 2023-09-30T13:55:47.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.437+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021004e0d0 con 0x7f02100ceea0 2023-09-30T13:55:47.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.439+0000 7f0206ffd640 1 -- 172.21.15.62:0/1673529289 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f01f8018020 con 0x7f02100ceea0 2023-09-30T13:55:47.438 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:47.439 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:47.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 msgr2=0x7f01f006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 0x7f01f006cff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0200008ea0 tx=0x7f02000083f0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 msgr2=0x7f021015b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c500 tx=0x7f01f800c9c0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 shutdown_connections 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f01f006ab30 0x7f01f006cff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02101598c0 0x7f021015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02100ceea0 0x7f021015b020 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 --2- 172.21.15.62:0/1673529289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02100cea30 0x7f0210154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 >> 172.21.15.62:0/1673529289 conn(0x7f021006a170 msgr2=0x7f02100cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:47.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 shutdown_connections 2023-09-30T13:55:47.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.441+0000 7f0214c83640 1 -- 172.21.15.62:0/1673529289 wait complete. 2023-09-30T13:55:47.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:47.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.561+0000 7f81db578640 1 Processor -- start 2023-09-30T13:55:47.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.561+0000 7f81db578640 1 -- start start 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81db578640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f81d415cee0 0x7f81d4071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81db578640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81d40ae300 0x7f81d406ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81db578640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d406d740 con 0x7f81d415cb00 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81db578640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d406da20 con 0x7f81d40ae300 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81db578640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d406dd00 con 0x7f81d415cee0 2023-09-30T13:55:47.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81d9b15640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81d40ae300 0x7f81d406ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81d9314640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f81d415cb00 0x7f81d40c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45618/0 (socket says 172.21.15.62:45618) 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81d9314640 1 -- 172.21.15.62:0/1201676994 learned_addr learned my addr 172.21.15.62:0/1201676994 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.562+0000 7f81d8b13640 1 --2- 172.21.15.62:0/1201676994 >> v2:172.21.15.135:3300/0 conn(0x7f81d415cee0 0x7f81d4071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81d9b15640 1 -- 172.21.15.62:0/1201676994 >> v2:172.21.15.135:3300/0 conn(0x7f81d415cee0 msgr2=0x7f81d4071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81d9b15640 1 --2- 172.21.15.62:0/1201676994 >> v2:172.21.15.135:3300/0 conn(0x7f81d415cee0 0x7f81d4071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81cbfff640 1 -- 172.21.15.62:0/1201676994 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516052082 0 0) 0x7f81d406d740 con 0x7f81d415cb00 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81d9b15640 1 -- 172.21.15.62:0/1201676994 >> v1:172.21.15.62:6789/0 conn(0x7f81d415cb00 legacy=0x7f81d40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81d9b15640 1 -- 172.21.15.62:0/1201676994 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d406dfe0 con 0x7f81d40ae300 2023-09-30T13:55:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81d9b15640 1 --2- 172.21.15.62:0/1201676994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d40ae300 0x7f81d406ad60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81d4073fa0 tx=0x7f81d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce937c83af5cace5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81cbfff640 1 -- 172.21.15.62:0/1201676994 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d002cc80 con 0x7f81d40ae300 2023-09-30T13:55:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81cbfff640 1 -- 172.21.15.62:0/1201676994 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d002cde0 con 0x7f81d40ae300 2023-09-30T13:55:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.563+0000 7f81cbfff640 1 -- 172.21.15.62:0/1201676994 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0034660 con 0x7f81d40ae300 2023-09-30T13:55:47.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 -- 172.21.15.62:0/1201676994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d40ae300 msgr2=0x7f81d406ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 --2- 172.21.15.62:0/1201676994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d40ae300 0x7f81d406ad60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81d4073fa0 tx=0x7f81d002bed0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 -- 172.21.15.62:0/1201676994 shutdown_connections 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 --2- 172.21.15.62:0/1201676994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d40ae300 0x7f81d406ad60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 --2- 172.21.15.62:0/1201676994 >> v2:172.21.15.135:3300/0 conn(0x7f81d415cee0 0x7f81d4071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 -- 172.21.15.62:0/1201676994 >> 172.21.15.62:0/1201676994 conn(0x7f81d4070970 msgr2=0x7f81d4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:47.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 -- 172.21.15.62:0/1201676994 shutdown_connections 2023-09-30T13:55:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.564+0000 7f81db578640 1 -- 172.21.15.62:0/1201676994 wait complete. 2023-09-30T13:55:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.565+0000 7f81db578640 1 Processor -- start 2023-09-30T13:55:47.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.565+0000 7f81db578640 1 -- start start 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81d40ae300 0x7f81d415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 0x7f81d41f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d415ee30 con 0x7f81d415cb00 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d415f040 con 0x7f81d415cee0 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81db578640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d415f320 con 0x7f81d40ae300 2023-09-30T13:55:47.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49008/0 (socket says 172.21.15.62:49008) 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 -- 172.21.15.62:0/1486267169 learned_addr learned my addr 172.21.15.62:0/1486267169 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d9b15640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 0x7f81d41f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d9314640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81d40ae300 0x7f81d415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 -- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81d40ae300 msgr2=0x7f81d415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81d40ae300 0x7f81d415fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 -- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 msgr2=0x7f81d41f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 0x7f81d41f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d8b13640 1 -- 172.21.15.62:0/1486267169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0009a70 con 0x7f81d415cb00 2023-09-30T13:55:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.566+0000 7f81d9b15640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 0x7f81d41f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81d8b13640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d5f0 tx=0x7f81c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40125f0 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4012750 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d415f600 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4012b00 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.567+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d41f6650 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.568+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d40666d0 con 0x7f81d415cb00 2023-09-30T13:55:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.568+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f81c4012c60 con 0x7f81d415cb00 2023-09-30T13:55:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.569+0000 7f81c9ffb640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 0x7f81b806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.569+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81c4089a10 con 0x7f81d415cb00 2023-09-30T13:55:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.569+0000 7f81d9314640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 0x7f81b806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.569+0000 7f81d9314640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 0x7f81b806cff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81cc000f60 tx=0x7f81cc007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.573+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f81c40548a0 con 0x7f81d415cb00 2023-09-30T13:55:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.751+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81d404e0d0 con 0x7f81d415cb00 2023-09-30T13:55:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.751+0000 7f81c9ffb640 1 -- 172.21.15.62:0/1486267169 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81c4057ec0 con 0x7f81d415cb00 2023-09-30T13:55:47.751 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 msgr2=0x7f81b806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 0x7f81b806cff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81cc000f60 tx=0x7f81cc007d50 comp rx=0 tx=0).stop 2023-09-30T13:55:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 msgr2=0x7f81d415dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d5f0 tx=0x7f81c400dab0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 shutdown_connections 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f81b806ab30 0x7f81b806cff0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81d415cee0 0x7f81d41f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81d415cb00 0x7f81d415dcd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 --2- 172.21.15.62:0/1486267169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81d40ae300 0x7f81d415fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 >> 172.21.15.62:0/1486267169 conn(0x7f81d4070970 msgr2=0x7f81d40ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 shutdown_connections 2023-09-30T13:55:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.753+0000 7f81db578640 1 -- 172.21.15.62:0/1486267169 wait complete. 2023-09-30T13:55:47.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.872+0000 7faceebc9640 1 Processor -- start 2023-09-30T13:55:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.872+0000 7faceebc9640 1 -- start start 2023-09-30T13:55:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7face80b8760 0x7face80d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 0x7face80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80ce290 con 0x7face80b8760 2023-09-30T13:55:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80d1410 con 0x7face80cd8c0 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7faceebc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80d16f0 con 0x7face815cbc0 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7face7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7face80b8760 0x7face80d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7face7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7face80b8760 0x7face80d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49024/0 (socket says 172.21.15.62:49024) 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.873+0000 7face7fff640 1 -- 172.21.15.62:0/716082901 learned_addr learned my addr 172.21.15.62:0/716082901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7facec965640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7faced166640 1 --2- 172.21.15.62:0/716082901 >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 0x7face80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 -- 172.21.15.62:0/716082901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 msgr2=0x7face80d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face80d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 -- 172.21.15.62:0/716082901 >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 msgr2=0x7face80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 --2- 172.21.15.62:0/716082901 >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 0x7face80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 -- 172.21.15.62:0/716082901 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80d19d0 con 0x7face80b8760 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7facec965640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face80d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7faced166640 1 --2- 172.21.15.62:0/716082901 >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 0x7face80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.874+0000 7face7fff640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80b8760 0x7face80d0be0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7face80d09a0 tx=0x7facdc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccee9b1cd65c1015 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7face77fe640 1 -- 172.21.15.62:0/716082901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc031860 con 0x7face80b8760 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7face77fe640 1 -- 172.21.15.62:0/716082901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc0319c0 con 0x7face80b8760 2023-09-30T13:55:47.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7face77fe640 1 -- 172.21.15.62:0/716082901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc031d50 con 0x7face80b8760 2023-09-30T13:55:47.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 -- 172.21.15.62:0/716082901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80b8760 msgr2=0x7face80d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80b8760 0x7face80d0be0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7face80d09a0 tx=0x7facdc02b900 comp rx=0 tx=0).stop 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 -- 172.21.15.62:0/716082901 shutdown_connections 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 --2- 172.21.15.62:0/716082901 >> v2:172.21.15.135:3300/0 conn(0x7face80cd8c0 0x7face80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80b8760 0x7face80d0be0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 --2- 172.21.15.62:0/716082901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face80d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 -- 172.21.15.62:0/716082901 >> 172.21.15.62:0/716082901 conn(0x7face80718a0 msgr2=0x7face8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 -- 172.21.15.62:0/716082901 shutdown_connections 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.875+0000 7faceebc9640 1 -- 172.21.15.62:0/716082901 wait complete. 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.876+0000 7faceebc9640 1 Processor -- start 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.876+0000 7faceebc9640 1 -- start start 2023-09-30T13:55:47.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80b8760 0x7face815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face815f3c0 con 0x7face80cd8c0 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81534f0 con 0x7face80b8760 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7faceebc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face815f0e0 con 0x7face815cbc0 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7face7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7face7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49034/0 (socket says 172.21.15.62:49034) 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.877+0000 7face7fff640 1 -- 172.21.15.62:0/800697355 learned_addr learned my addr 172.21.15.62:0/800697355 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7faced166640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7facec965640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80b8760 0x7face815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 -- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 msgr2=0x7face815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face815a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 -- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80b8760 msgr2=0x7face815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80b8760 0x7face815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 -- 172.21.15.62:0/800697355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0094d0 con 0x7face80cd8c0 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face7fff640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facdc000c00 tx=0x7facdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc03ad10 con 0x7face80cd8c0 2023-09-30T13:55:47.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc03ae70 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80b26f0 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc044610 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.878+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80b2cb0 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.879+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face80b2550 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.880+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7facdc04d450 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.880+0000 7face57fa640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.880+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facdc0abc90 con 0x7face80cd8c0 2023-09-30T13:55:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.880+0000 7facec965640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.881+0000 7facec965640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7face00075b0 tx=0x7face0007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:47.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:47.884+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7face80b2550 con 0x7face80cd8c0 2023-09-30T13:55:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.060+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7face80b2550 con 0x7face80cd8c0 2023-09-30T13:55:48.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.060+0000 7face57fa640 1 -- 172.21.15.62:0/800697355 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7face80b2550 con 0x7face80cd8c0 2023-09-30T13:55:48.061 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 msgr2=0x7facd406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7face00075b0 tx=0x7face0007540 comp rx=0 tx=0).stop 2023-09-30T13:55:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 msgr2=0x7face81f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facdc000c00 tx=0x7facdc0046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 shutdown_connections 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7face815cbc0 0x7face815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80cd8c0 0x7face81f1ac0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 --2- 172.21.15.62:0/800697355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80b8760 0x7face815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 >> 172.21.15.62:0/800697355 conn(0x7face80718a0 msgr2=0x7face80cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 shutdown_connections 2023-09-30T13:55:48.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.062+0000 7faceebc9640 1 -- 172.21.15.62:0/800697355 wait complete. 2023-09-30T13:55:48.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:48.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.182+0000 7fcc140bb640 1 Processor -- start 2023-09-30T13:55:48.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.182+0000 7fcc140bb640 1 -- start start 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc140bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcc0c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc140bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc0c0b8760 0x7fcc0c0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc140bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0d1410 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc140bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0d16f0 con 0x7fcc0c0b8760 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc140bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0d19d0 con 0x7fcc0c15cbc0 2023-09-30T13:55:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc12658640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcc0c0cd8c0 0x7fcc0c0b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45634/0 (socket says 172.21.15.62:45634) 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.183+0000 7fcc12658640 1 -- 172.21.15.62:0/252896594 learned_addr learned my addr 172.21.15.62:0/252896594 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcc0c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11656640 1 --2- 172.21.15.62:0/252896594 >> v2:172.21.15.135:3300/0 conn(0x7fcc0c0b8760 0x7fcc0c0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416563722 0 0) 0x7fcc0c0d1410 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf4003520 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874058068 0 0) 0x7fcbf4003520 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 msgr2=0x7fcc0c0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcc0c0d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 >> v2:172.21.15.135:3300/0 conn(0x7fcc0c0b8760 msgr2=0x7fcc0c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 --2- 172.21.15.62:0/252896594 >> v2:172.21.15.135:3300/0 conn(0x7fcc0c0b8760 0x7fcc0c0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0d1cb0 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fcbfc001670 con 0x7fcc0c0cd8c0 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 >> v1:172.21.15.62:6789/0 conn(0x7fcc0c0cd8c0 legacy=0x7fcc0c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcbf4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcbf4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0d16f0 con 0x7fcbf4003970 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0d19d0 con 0x7fcbf40047c0 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf400b980 con 0x7fcc0c15cbc0 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcbf4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11656640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc12658640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcbf4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 -- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 msgr2=0x7fcbf4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcbf4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 -- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf40047c0 msgr2=0x7fcbf4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc11e57640 1 -- 172.21.15.62:0/252896594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4003520 con 0x7fcbf4003970 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.184+0000 7fcc12658640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15cbc0 0x7fcbf4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:48.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.185+0000 7fcc11e57640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcbf4003d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009fc0 tx=0x7fcbf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edf84b5ed873895 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.185+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0402cc20 con 0x7fcbf4003970 2023-09-30T13:55:48.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.185+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0400f040 con 0x7fcbf4003970 2023-09-30T13:55:48.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.185+0000 7fcc10e55640 1 -- 172.21.15.62:0/252896594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04034440 con 0x7fcbf4003970 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 -- 172.21.15.62:0/252896594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 msgr2=0x7fcbf4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 --2- 172.21.15.62:0/252896594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcbf4003d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009fc0 tx=0x7fcbf40057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc12658640 1 -- 172.21.15.62:0/252896594 reap_dead start 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 -- 172.21.15.62:0/252896594 shutdown_connections 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 -- 172.21.15.62:0/252896594 >> 172.21.15.62:0/252896594 conn(0x7fcc0c0718a0 msgr2=0x7fcc0c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 -- 172.21.15.62:0/252896594 shutdown_connections 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.186+0000 7fcc140bb640 1 -- 172.21.15.62:0/252896594 wait complete. 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.187+0000 7fcc140bb640 1 Processor -- start 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.187+0000 7fcc140bb640 1 -- start start 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15e170 0x7fcc0c15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c1e7300 0x7fcc0c0d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0ca3d0 con 0x7fcbf4003970 2023-09-30T13:55:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c1e6eb0 con 0x7fcc0c1e7300 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc140bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0c9bc0 con 0x7fcc0c15e170 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49046/0 (socket says 172.21.15.62:49046) 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 -- 172.21.15.62:0/1745736707 learned_addr learned my addr 172.21.15.62:0/1745736707 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc12658640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c1e7300 0x7fcc0c0d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11656640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15e170 0x7fcc0c15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 -- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15e170 msgr2=0x7fcc0c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15e170 0x7fcc0c15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 -- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c1e7300 msgr2=0x7fcc0c0d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c1e7300 0x7fcc0c0d2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 -- 172.21.15.62:0/1745736707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c15e6a0 con 0x7fcbf4003970 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.188+0000 7fcc11e57640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e230 tx=0x7fcc04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.189+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04034bd0 con 0x7fcbf4003970 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.189+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04034d30 con 0x7fcbf4003970 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.189+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c0c9e10 con 0x7fcbf4003970 2023-09-30T13:55:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.189+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04034ea0 con 0x7fcbf4003970 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.189+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c15f530 con 0x7fcbf4003970 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.190+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c04e0d0 con 0x7fcbf4003970 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.190+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fcc04040450 con 0x7fcbf4003970 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.191+0000 7fcc0a7fc640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 0x7fcbf806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.191+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc040abc40 con 0x7fcbf4003970 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.191+0000 7fcc11656640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 0x7fcbf806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.191+0000 7fcc11656640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 0x7fcbf806cff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c1e6c40 tx=0x7fcc00009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.195+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fcc04076c20 con 0x7fcbf4003970 2023-09-30T13:55:48.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.369+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc0c15d570 con 0x7fcbf4003970 2023-09-30T13:55:48.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.370+0000 7fcc0a7fc640 1 -- 172.21.15.62:0/1745736707 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc0407a240 con 0x7fcbf4003970 2023-09-30T13:55:48.369 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 msgr2=0x7fcbf806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 0x7fcbf806cff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c1e6c40 tx=0x7fcc00009190 comp rx=0 tx=0).stop 2023-09-30T13:55:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 msgr2=0x7fcc0c0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e230 tx=0x7fcc04009750 comp rx=0 tx=0).stop 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 shutdown_connections 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fcbf806ab30 0x7fcbf806cff0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc0c1e7300 0x7fcc0c0d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.371+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc0c15e170 0x7fcc0c15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.372+0000 7fcc140bb640 1 --2- 172.21.15.62:0/1745736707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbf4003970 0x7fcc0c0c8fb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.372+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 >> 172.21.15.62:0/1745736707 conn(0x7fcc0c0718a0 msgr2=0x7fcc0c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.372+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 shutdown_connections 2023-09-30T13:55:48.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.372+0000 7fcc140bb640 1 -- 172.21.15.62:0/1745736707 wait complete. 2023-09-30T13:55:48.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:48.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.490+0000 7f675b8a2640 1 Processor -- start 2023-09-30T13:55:48.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.490+0000 7f675b8a2640 1 -- start start 2023-09-30T13:55:48.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.491+0000 7f675b8a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f675415cbc0 0x7f67540d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.491+0000 7f675b8a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f67540cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.491+0000 7f675b8a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540d1410 con 0x7f67540b8760 2023-09-30T13:55:48.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.491+0000 7f675b8a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540ce290 con 0x7f675415cbc0 2023-09-30T13:55:48.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.491+0000 7f675b8a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540d16f0 con 0x7f67540cd8c0 2023-09-30T13:55:48.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f6759e3f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f67540cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f675963e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f675415cbc0 0x7f67540d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f6758e3d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f67540b8760 0x7f67540d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:47508/0 (socket says 172.21.15.62:47508) 2023-09-30T13:55:48.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f6758e3d640 1 -- 172.21.15.62:0/3876082309 learned_addr learned my addr 172.21.15.62:0/3876082309 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f675963e640 1 -- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 msgr2=0x7f67540cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f675963e640 1 --2- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f67540cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f675963e640 1 -- 172.21.15.62:0/3876082309 >> v1:172.21.15.135:6789/0 conn(0x7f67540b8760 legacy=0x7f67540d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f6753fff640 1 -- 172.21.15.62:0/3876082309 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944909832 0 0) 0x7f67540d1410 con 0x7f67540b8760 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.492+0000 7f675963e640 1 -- 172.21.15.62:0/3876082309 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540d19d0 con 0x7f675415cbc0 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.493+0000 7f675963e640 1 --2- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540d24b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f674c0097a0 tx=0x7f674c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dacaf31219102bc4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.493+0000 7f6753fff640 1 -- 172.21.15.62:0/3876082309 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c031830 con 0x7f675415cbc0 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.493+0000 7f6753fff640 1 -- 172.21.15.62:0/3876082309 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c031990 con 0x7f675415cbc0 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.493+0000 7f6753fff640 1 -- 172.21.15.62:0/3876082309 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c031d20 con 0x7f675415cbc0 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 -- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 msgr2=0x7f67540d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 --2- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540d24b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f674c0097a0 tx=0x7f674c02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 -- 172.21.15.62:0/3876082309 shutdown_connections 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 --2- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f67540cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 --2- 172.21.15.62:0/3876082309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540d24b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 -- 172.21.15.62:0/3876082309 >> 172.21.15.62:0/3876082309 conn(0x7f67540718a0 msgr2=0x7f6754071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 -- 172.21.15.62:0/3876082309 shutdown_connections 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.494+0000 7f675b8a2640 1 -- 172.21.15.62:0/3876082309 wait complete. 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.495+0000 7f675b8a2640 1 Processor -- start 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.495+0000 7f675b8a2640 1 -- start start 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f675415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c9fd0 con 0x7f67540b8760 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675415d9b0 con 0x7f675415cbc0 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675b8a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675415d3f0 con 0x7f67540cd8c0 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49062/0 (socket says 172.21.15.62:49062) 2023-09-30T13:55:48.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 -- 172.21.15.62:0/1314976205 learned_addr learned my addr 172.21.15.62:0/1314976205 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6758e3d640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f675415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6759e3f640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 -- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 msgr2=0x7f675415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f675415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 -- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 msgr2=0x7f67540cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 -- 172.21.15.62:0/1314976205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c009400 con 0x7f67540b8760 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6759e3f640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6758e3d640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f675415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f675963e640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f674c0097a0 tx=0x7f674c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c004230 con 0x7f67540b8760 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.496+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c004390 con 0x7f67540b8760 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.497+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675415d6d0 con 0x7f67540b8760 2023-09-30T13:55:48.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.497+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c03a870 con 0x7f67540b8760 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.497+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6754151e20 con 0x7f67540b8760 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.498+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675404e0d0 con 0x7f67540b8760 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.498+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f674c03a9d0 con 0x7f67540b8760 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.498+0000 7f6751ffb640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 0x7f674006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.499+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f674c0ab710 con 0x7f67540b8760 2023-09-30T13:55:48.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.499+0000 7f6758e3d640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 0x7f674006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.499+0000 7f6758e3d640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 0x7f674006cff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f675415bfa0 tx=0x7f6748007c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.503+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f674c076630 con 0x7f67540b8760 2023-09-30T13:55:48.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.678+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f67540b75a0 con 0x7f67540b8760 2023-09-30T13:55:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.678+0000 7f6751ffb640 1 -- 172.21.15.62:0/1314976205 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f674c079c50 con 0x7f67540b8760 2023-09-30T13:55:48.678 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 msgr2=0x7f674006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 0x7f674006cff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f675415bfa0 tx=0x7f6748007c30 comp rx=0 tx=0).stop 2023-09-30T13:55:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 msgr2=0x7f67541518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f674c0097a0 tx=0x7f674c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 shutdown_connections 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674006ab30 0x7f674006cff0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f675415cbc0 0x7f67540cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67540cd8c0 0x7f675415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 --2- 172.21.15.62:0/1314976205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67540b8760 0x7f67541518e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 >> 172.21.15.62:0/1314976205 conn(0x7f67540718a0 msgr2=0x7f6754156200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 shutdown_connections 2023-09-30T13:55:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.680+0000 7f675b8a2640 1 -- 172.21.15.62:0/1314976205 wait complete. 2023-09-30T13:55:48.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.798+0000 7f1c73abb640 1 Processor -- start 2023-09-30T13:55:48.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.798+0000 7f1c73abb640 1 -- start start 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c73abb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 0x7f1c6c0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c73abb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c6c0ce530 0x7f1c6c069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c73abb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0cafe0 con 0x7f1c6c0cac00 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c73abb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c06d150 con 0x7f1c6c0ce530 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c73abb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c066130 con 0x7f1c6c06d570 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c71857640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1c6c0cac00 0x7f1c6c065a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45648/0 (socket says 172.21.15.62:45648) 2023-09-30T13:55:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c71857640 1 -- 172.21.15.62:0/3928478267 learned_addr learned my addr 172.21.15.62:0/3928478267 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c72058640 1 --2- 172.21.15.62:0/3928478267 >> v2:172.21.15.62:3300/0 conn(0x7f1c6c0ce530 0x7f1c6c069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c70855640 1 -- 172.21.15.62:0/3928478267 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504853419 0 0) 0x7f1c64001110 con 0x7f1c6c0cac00 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c71056640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 0x7f1c6c0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c70855640 1 -- 172.21.15.62:0/3928478267 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c54003520 con 0x7f1c6c0cac00 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c72058640 1 -- 172.21.15.62:0/3928478267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 msgr2=0x7f1c6c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c72058640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 0x7f1c6c0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c72058640 1 -- 172.21.15.62:0/3928478267 >> v1:172.21.15.62:6789/0 conn(0x7f1c6c0cac00 legacy=0x7f1c6c065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c72058640 1 -- 172.21.15.62:0/3928478267 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0cb510 con 0x7f1c6c0ce530 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.799+0000 7f1c71056640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 0x7f1c6c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.800+0000 7f1c72058640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0ce530 0x7f1c6c069d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009dc0 tx=0x7f1c5c02bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c0473eba0b4221 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.800+0000 7f1c70855640 1 -- 172.21.15.62:0/3928478267 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c02cb20 con 0x7f1c6c0ce530 2023-09-30T13:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.800+0000 7f1c70855640 1 -- 172.21.15.62:0/3928478267 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c02cc80 con 0x7f1c6c0ce530 2023-09-30T13:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.800+0000 7f1c70855640 1 -- 172.21.15.62:0/3928478267 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c034440 con 0x7f1c6c0ce530 2023-09-30T13:55:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 -- 172.21.15.62:0/3928478267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0ce530 msgr2=0x7f1c6c069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0ce530 0x7f1c6c069d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009dc0 tx=0x7f1c5c02bd70 comp rx=0 tx=0).stop 2023-09-30T13:55:48.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 -- 172.21.15.62:0/3928478267 shutdown_connections 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0ce530 0x7f1c6c069d50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 --2- 172.21.15.62:0/3928478267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c06d570 0x7f1c6c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 -- 172.21.15.62:0/3928478267 >> 172.21.15.62:0/3928478267 conn(0x7f1c6c0b0850 msgr2=0x7f1c6c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 -- 172.21.15.62:0/3928478267 shutdown_connections 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.801+0000 7f1c73abb640 1 -- 172.21.15.62:0/3928478267 wait complete. 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.802+0000 7f1c73abb640 1 Processor -- start 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.802+0000 7f1c73abb640 1 -- start start 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 0x7f1c6c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c0ce530 0x7f1c6c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c8d60 con 0x7f1c6c0cac00 2023-09-30T13:55:48.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c160240 con 0x7f1c6c06d570 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c73abb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c8fb0 con 0x7f1c6c0ce530 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49076/0 (socket says 172.21.15.62:49076) 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 -- 172.21.15.62:0/1252059446 learned_addr learned my addr 172.21.15.62:0/1252059446 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71857640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 0x7f1c6c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c72058640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c0ce530 0x7f1c6c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 -- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c0ce530 msgr2=0x7f1c6c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c0ce530 0x7f1c6c0b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 -- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 msgr2=0x7f1c6c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 0x7f1c6c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 -- 172.21.15.62:0/1252059446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009a70 con 0x7f1c6c0cac00 2023-09-30T13:55:48.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71857640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 0x7f1c6c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.803+0000 7f1c71056640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c820 tx=0x7f1c6000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.804+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60007a30 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.804+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c60007b90 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.804+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000ce10 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.804+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0c9290 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.804+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0c9850 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.805+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c073e70 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.805+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1c600113f0 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.806+0000 7f1c6a7fc640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 0x7f1c5806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.806+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c60089720 con 0x7f1c6c0cac00 2023-09-30T13:55:48.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.806+0000 7f1c71857640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 0x7f1c5806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.806+0000 7f1c71857640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 0x7f1c5806cff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c64001370 tx=0x7f1c64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:48.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.810+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1c600545b0 con 0x7f1c6c0cac00 2023-09-30T13:55:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.997+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c6c0b1400 con 0x7f1c6c0cac00 2023-09-30T13:55:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.998+0000 7f1c6a7fc640 1 -- 172.21.15.62:0/1252059446 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c60057bd0 con 0x7f1c6c0cac00 2023-09-30T13:55:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.999+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 msgr2=0x7f1c5806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.999+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 0x7f1c5806cff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c64001370 tx=0x7f1c64009040 comp rx=0 tx=0).stop 2023-09-30T13:55:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.999+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 msgr2=0x7f1c6c0c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:48.999+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c820 tx=0x7f1c6000cce0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 shutdown_connections 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1c5806ab30 0x7f1c5806cff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c6c0ce530 0x7f1c6c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c6c0cac00 0x7f1c6c0c8480 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 --2- 172.21.15.62:0/1252059446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c6c06d570 0x7f1c6c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 >> 172.21.15.62:0/1252059446 conn(0x7f1c6c0b0850 msgr2=0x7f1c6c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 shutdown_connections 2023-09-30T13:55:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.000+0000 7f1c73abb640 1 -- 172.21.15.62:0/1252059446 wait complete. 2023-09-30T13:55:49.010 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:55:49.010 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:55:49.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:49.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.135+0000 7f2768f0c640 1 Processor -- start 2023-09-30T13:55:49.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.135+0000 7f2768f0c640 1 -- start start 2023-09-30T13:55:49.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2768f0c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f27640ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2768f0c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27640b2e50 con 0x7f27640cdc20 2023-09-30T13:55:49.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2768f0c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27640ac2d0 con 0x7f27640cea30 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2768f0c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640cc340 con 0x7f27640cee90 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f276259c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f27640cdc20 0x7f27640b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45662/0 (socket says 172.21.15.62:45662) 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f276259c640 1 -- 172.21.15.62:0/949283336 learned_addr learned my addr 172.21.15.62:0/949283336 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2762d9d640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f27640ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259950765 0 0) 0x7f27640b2e50 con 0x7f27640cdc20 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2750003520 con 0x7f27640cdc20 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195680318 0 0) 0x7f27640ac2d0 con 0x7f27640cea30 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27640b2e50 con 0x7f27640cea30 2023-09-30T13:55:49.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373107825 0 0) 0x7f2750003520 con 0x7f27640cdc20 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 msgr2=0x7f27640ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f27640ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 >> v1:172.21.15.135:6789/0 conn(0x7f27640cea30 legacy=0x7f27640ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640cc620 con 0x7f27640cdc20 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f27540017f0 con 0x7f27640cdc20 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 >> v1:172.21.15.62:6789/0 conn(0x7f27640cdc20 legacy=0x7f27640b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f2750003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500040e0 0x7f27500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2750004d00 0x7f2750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640cc340 con 0x7f27500040e0 2023-09-30T13:55:49.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275000bb40 con 0x7f2750004d00 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.136+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275000bd00 con 0x7f27640cee90 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500040e0 0x7f27500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f2762d9d640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2750004d00 0x7f2750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f276259c640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f2750003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 -- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 msgr2=0x7f2750003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27640cee90 0x7f2750003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 -- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2750004d00 msgr2=0x7f2750005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2750004d00 0x7f2750005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.137+0000 7f275bfff640 1 -- 172.21.15.62:0/949283336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750003520 con 0x7f27500040e0 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f275bfff640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500040e0 0x7f27500047c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f274c0018d0 tx=0x7f27500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d1470e03dc36a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0052d0 con 0x7f27500040e0 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c005430 con 0x7f27500040e0 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2761d9b640 1 -- 172.21.15.62:0/949283336 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c003810 con 0x7f27500040e0 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 -- 172.21.15.62:0/949283336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500040e0 msgr2=0x7f27500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 --2- 172.21.15.62:0/949283336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27500040e0 0x7f27500047c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f274c0018d0 tx=0x7f27500057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2762d9d640 1 -- 172.21.15.62:0/949283336 reap_dead start 2023-09-30T13:55:49.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 -- 172.21.15.62:0/949283336 shutdown_connections 2023-09-30T13:55:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 -- 172.21.15.62:0/949283336 >> 172.21.15.62:0/949283336 conn(0x7f276406a170 msgr2=0x7f276406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 -- 172.21.15.62:0/949283336 shutdown_connections 2023-09-30T13:55:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.138+0000 7f2768f0c640 1 -- 172.21.15.62:0/949283336 wait complete. 2023-09-30T13:55:49.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 Processor -- start 2023-09-30T13:55:49.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 -- start start 2023-09-30T13:55:49.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27500040e0 0x7f276415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27640ab790 0x7f276406c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640abc10 con 0x7f2764158490 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276415afc0 con 0x7f27640ab790 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f2768f0c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276415b210 con 0x7f27500040e0 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f275bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.140+0000 7f275bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49090/0 (socket says 172.21.15.62:49090) 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 -- 172.21.15.62:0/2999181604 learned_addr learned my addr 172.21.15.62:0/2999181604 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f2762d9d640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27640ab790 0x7f276406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f276259c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27500040e0 0x7f276415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 -- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27500040e0 msgr2=0x7f276415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27500040e0 0x7f276415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 -- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27640ab790 msgr2=0x7f276406c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27640ab790 0x7f276406c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 -- 172.21.15.62:0/2999181604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276415b4f0 con 0x7f2764158490 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275bfff640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f274c035040 tx=0x7f274c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c007450 con 0x7f2764158490 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0075b0 con 0x7f2764158490 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276415b7d0 con 0x7f2764158490 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c007720 con 0x7f2764158490 2023-09-30T13:55:49.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.141+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764158910 con 0x7f2764158490 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.142+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27640cd100 con 0x7f2764158490 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.143+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f274c0037f0 con 0x7f2764158490 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.143+0000 7f275affd640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 0x7f274406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.143+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f274c0ab830 con 0x7f2764158490 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.143+0000 7f276259c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 0x7f274406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.144+0000 7f276259c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 0x7f274406d020 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2754001270 tx=0x7f2754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.147+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f274c076770 con 0x7f2764158490 2023-09-30T13:55:49.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:55:49.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:55:49.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.324+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f276404e0d0 con 0x7f2764158490 2023-09-30T13:55:49.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.325+0000 7f275affd640 1 -- 172.21.15.62:0/2999181604 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f274c079d90 con 0x7f2764158490 2023-09-30T13:55:49.325 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:49.325 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 msgr2=0x7f274406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 0x7f274406d020 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2754001270 tx=0x7f2754009040 comp rx=0 tx=0).stop 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 msgr2=0x7f27640ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f274c035040 tx=0x7f274c0012d0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 shutdown_connections 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f274406ab60 0x7f274406d020 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27640ab790 0x7f276406c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2764158490 0x7f27640ab250 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 --2- 172.21.15.62:0/2999181604 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27500040e0 0x7f276415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 >> 172.21.15.62:0/2999181604 conn(0x7f276406a170 msgr2=0x7f27640b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 shutdown_connections 2023-09-30T13:55:49.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.327+0000 7f2768f0c640 1 -- 172.21.15.62:0/2999181604 wait complete. 2023-09-30T13:55:49.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:49.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:49.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.523+0000 7f02b56e0640 1 Processor -- start 2023-09-30T13:55:49.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 -- start start 2023-09-30T13:55:49.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02b015cee0 0x7f02b0071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02b00ae300 0x7f02b006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b006d740 con 0x7f02b015cb00 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b006da20 con 0x7f02b015cee0 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02b56e0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b006dd00 con 0x7f02b00ae300 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02ae7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02b015cee0 0x7f02b0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02aeffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f02b015cb00 0x7f02b00c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45664/0 (socket says 172.21.15.62:45664) 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.524+0000 7f02aeffd640 1 -- 172.21.15.62:0/1338650530 learned_addr learned my addr 172.21.15.62:0/1338650530 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02af7fe640 1 --2- 172.21.15.62:0/1338650530 >> v2:172.21.15.135:3300/0 conn(0x7f02b00ae300 0x7f02b006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1338650530 >> v2:172.21.15.135:3300/0 conn(0x7f02b00ae300 msgr2=0x7f02b006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02ae7fc640 1 --2- 172.21.15.62:0/1338650530 >> v2:172.21.15.135:3300/0 conn(0x7f02b00ae300 0x7f02b006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1338650530 >> v1:172.21.15.62:6789/0 conn(0x7f02b015cb00 legacy=0x7f02b00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02adffb640 1 -- 172.21.15.62:0/1338650530 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957542434 0 0) 0x7f02b006d740 con 0x7f02b015cb00 2023-09-30T13:55:49.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.525+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1338650530 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b006dfe0 con 0x7f02b015cee0 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02ae7fc640 1 --2- 172.21.15.62:0/1338650530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cee0 0x7f02b0071860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b1ac0 tx=0x7f029802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b90c01e2a4f523 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02adffb640 1 -- 172.21.15.62:0/1338650530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298031830 con 0x7f02b015cee0 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02adffb640 1 -- 172.21.15.62:0/1338650530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298031990 con 0x7f02b015cee0 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02adffb640 1 -- 172.21.15.62:0/1338650530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298031d20 con 0x7f02b015cee0 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 -- 172.21.15.62:0/1338650530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cee0 msgr2=0x7f02b0071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1338650530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cee0 0x7f02b0071860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b1ac0 tx=0x7f029802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 -- 172.21.15.62:0/1338650530 shutdown_connections 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1338650530 >> v2:172.21.15.135:3300/0 conn(0x7f02b00ae300 0x7f02b006ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1338650530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cee0 0x7f02b0071860 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 -- 172.21.15.62:0/1338650530 >> 172.21.15.62:0/1338650530 conn(0x7f02b0070970 msgr2=0x7f02b0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 -- 172.21.15.62:0/1338650530 shutdown_connections 2023-09-30T13:55:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.526+0000 7f02b56e0640 1 -- 172.21.15.62:0/1338650530 wait complete. 2023-09-30T13:55:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.528+0000 7f02b56e0640 1 Processor -- start 2023-09-30T13:55:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.528+0000 7f02b56e0640 1 -- start start 2023-09-30T13:55:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.528+0000 7f02b56e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b00ae300 0x7f02b014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.528+0000 7f02b56e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.528+0000 7f02b56e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 0x7f02b00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02b56e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015d460 con 0x7f02b015cb00 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02b56e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015d700 con 0x7f02b00ae300 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02b56e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b015d9e0 con 0x7f02b015cee0 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49120/0 (socket says 172.21.15.62:49120) 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1654730257 learned_addr learned my addr 172.21.15.62:0/1654730257 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02aeffd640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b00ae300 0x7f02b014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02af7fe640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 0x7f02b00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 msgr2=0x7f02b00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 0x7f02b00c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b00ae300 msgr2=0x7f02b014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b00ae300 0x7f02b014f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 -- 172.21.15.62:0/1654730257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009400 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02af7fe640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 0x7f02b00c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02ae7fc640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f02980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298004230 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02980043b0 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b015dcc0 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298004520 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.529+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b014f700 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.530+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b00666d0 con 0x7f02b015cb00 2023-09-30T13:55:49.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.531+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f029803a870 con 0x7f02b015cb00 2023-09-30T13:55:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.531+0000 7f02a77fe640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 0x7f029006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.531+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02980ab810 con 0x7f02b015cb00 2023-09-30T13:55:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.532+0000 7f02aeffd640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 0x7f029006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.532+0000 7f02aeffd640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 0x7f029006cff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02a8000f60 tx=0x7f02a8007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.535+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f02980766a0 con 0x7f02b015cb00 2023-09-30T13:55:49.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.711+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02b014f890 con 0x7f02b015cb00 2023-09-30T13:55:49.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.711+0000 7f02a77fe640 1 -- 172.21.15.62:0/1654730257 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02b014f890 con 0x7f02b015cb00 2023-09-30T13:55:49.711 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:49.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 msgr2=0x7f029006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 0x7f029006cff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02a8000f60 tx=0x7f02a8007b50 comp rx=0 tx=0).stop 2023-09-30T13:55:49.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 msgr2=0x7f02b00c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f02980046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 shutdown_connections 2023-09-30T13:55:49.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f029006ab30 0x7f029006cff0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02b015cee0 0x7f02b00c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02b015cb00 0x7f02b00c8290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 --2- 172.21.15.62:0/1654730257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02b00ae300 0x7f02b014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 >> 172.21.15.62:0/1654730257 conn(0x7f02b0070970 msgr2=0x7f02b00abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 shutdown_connections 2023-09-30T13:55:49.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.713+0000 7f02b56e0640 1 -- 172.21.15.62:0/1654730257 wait complete. 2023-09-30T13:55:49.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:49.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.833+0000 7f41f14da640 1 Processor -- start 2023-09-30T13:55:49.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.833+0000 7f41f14da640 1 -- start start 2023-09-30T13:55:49.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.834+0000 7f41f14da640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 0x7f41ec0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.834+0000 7f41f14da640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41ec0b0e60 0x7f41ec0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.834+0000 7f41f14da640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec0af960 con 0x7f41ec159610 2023-09-30T13:55:49.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.834+0000 7f41f14da640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec06c390 con 0x7f41ec0b0e60 2023-09-30T13:55:49.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.834+0000 7f41f14da640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec06c670 con 0x7f41ec1599f0 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41ea7fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 0x7f41ec0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eb7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41ec0b0e60 0x7f41ec0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eaffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f41ec159610 0x7f41ec0af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:47524/0 (socket says 172.21.15.62:47524) 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eaffd640 1 -- 172.21.15.62:0/1990148790 learned_addr learned my addr 172.21.15.62:0/1990148790 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eb7fe640 1 -- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 msgr2=0x7f41ec0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eb7fe640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 0x7f41ec0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eb7fe640 1 -- 172.21.15.62:0/1990148790 >> v1:172.21.15.135:6789/0 conn(0x7f41ec159610 legacy=0x7f41ec0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41e9ffb640 1 -- 172.21.15.62:0/1990148790 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217198768 0 0) 0x7f41ec0af960 con 0x7f41ec159610 2023-09-30T13:55:49.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41eb7fe640 1 -- 172.21.15.62:0/1990148790 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec06c950 con 0x7f41ec0b0e60 2023-09-30T13:55:49.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.835+0000 7f41ea7fc640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 0x7f41ec0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:49.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.836+0000 7f41eb7fe640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec0b0e60 0x7f41ec0b02c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009d90 tx=0x7f41e402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775698004ed1f44d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.836+0000 7f41e9ffb640 1 -- 172.21.15.62:0/1990148790 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e402cbc0 con 0x7f41ec0b0e60 2023-09-30T13:55:49.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.836+0000 7f41e9ffb640 1 -- 172.21.15.62:0/1990148790 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e402cd20 con 0x7f41ec0b0e60 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.836+0000 7f41e9ffb640 1 -- 172.21.15.62:0/1990148790 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4034660 con 0x7f41ec0b0e60 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 -- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec0b0e60 msgr2=0x7f41ec0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec0b0e60 0x7f41ec0b02c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009d90 tx=0x7f41e402be10 comp rx=0 tx=0).stop 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 -- 172.21.15.62:0/1990148790 shutdown_connections 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec1599f0 0x7f41ec0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 --2- 172.21.15.62:0/1990148790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec0b0e60 0x7f41ec0b02c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 -- 172.21.15.62:0/1990148790 >> 172.21.15.62:0/1990148790 conn(0x7f41ec0cb720 msgr2=0x7f41ec0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 -- 172.21.15.62:0/1990148790 shutdown_connections 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.837+0000 7f41f14da640 1 -- 172.21.15.62:0/1990148790 wait complete. 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.838+0000 7f41f14da640 1 Processor -- start 2023-09-30T13:55:49.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.838+0000 7f41f14da640 1 -- start start 2023-09-30T13:55:49.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec159610 0x7f41ec0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec1599f0 0x7f41ec14a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec14a680 con 0x7f41ec0b0e60 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec157d10 con 0x7f41ec1599f0 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41f14da640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec157ff0 con 0x7f41ec159610 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49130/0 (socket says 172.21.15.62:49130) 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 -- 172.21.15.62:0/3764552252 learned_addr learned my addr 172.21.15.62:0/3764552252 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eb7fe640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec1599f0 0x7f41ec14a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41ea7fc640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec159610 0x7f41ec0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 -- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec159610 msgr2=0x7f41ec0ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec159610 0x7f41ec0ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 -- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec1599f0 msgr2=0x7f41ec14a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec1599f0 0x7f41ec14a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 -- 172.21.15.62:0/3764552252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009400 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.839+0000 7f41eaffd640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c430 tx=0x7f41dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.840+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0074e0 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.840+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc007660 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.840+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e4009a70 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.840+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc004a20 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.840+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec1585b0 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.841+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec0ad5b0 con 0x7f41ec0b0e60 2023-09-30T13:55:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.841+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f41dc004b80 con 0x7f41ec0b0e60 2023-09-30T13:55:49.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.842+0000 7f41d37fe640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 0x7f41d806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:49.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.842+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41dc089360 con 0x7f41ec0b0e60 2023-09-30T13:55:49.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.842+0000 7f41ea7fc640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 0x7f41d806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:49.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.842+0000 7f41ea7fc640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 0x7f41d806cff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f41ec1e5290 tx=0x7f41e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:49.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:49.846+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f41dc054220 con 0x7f41ec0b0e60 2023-09-30T13:55:50.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.022+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41ec04e0d0 con 0x7f41ec0b0e60 2023-09-30T13:55:50.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.022+0000 7f41d37fe640 1 -- 172.21.15.62:0/3764552252 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41dc057840 con 0x7f41ec0b0e60 2023-09-30T13:55:50.022 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 msgr2=0x7f41d806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 0x7f41d806cff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f41ec1e5290 tx=0x7f41e0009190 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 msgr2=0x7f41ec157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c430 tx=0x7f41dc00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 shutdown_connections 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f41d806ab30 0x7f41d806cff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41ec1599f0 0x7f41ec14a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41ec159610 0x7f41ec0ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 --2- 172.21.15.62:0/3764552252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41ec0b0e60 0x7f41ec157610 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 >> 172.21.15.62:0/3764552252 conn(0x7f41ec0cb720 msgr2=0x7f41ec155330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 shutdown_connections 2023-09-30T13:55:50.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.024+0000 7f41f14da640 1 -- 172.21.15.62:0/3764552252 wait complete. 2023-09-30T13:55:50.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:50.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.147+0000 7fe959476640 1 Processor -- start 2023-09-30T13:55:50.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.147+0000 7fe959476640 1 -- start start 2023-09-30T13:55:50.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe959476640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9540b8760 0x7fe9540d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe959476640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540cd8c0 0x7fe9540cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe959476640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9540d1410 con 0x7fe95415cbc0 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe959476640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9540ce290 con 0x7fe9540b8760 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe959476640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540d16f0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9540b8760 0x7fe9540d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe9540b8760 0x7fe9540d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49132/0 (socket says 172.21.15.62:49132) 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 -- 172.21.15.62:0/1174535000 learned_addr learned my addr 172.21.15.62:0/1174535000 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9537fe640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540cd8c0 0x7fe9540cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 -- 172.21.15.62:0/1174535000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540cd8c0 msgr2=0x7fe9540cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540cd8c0 0x7fe9540cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 -- 172.21.15.62:0/1174535000 >> v1:172.21.15.135:6789/0 conn(0x7fe95415cbc0 legacy=0x7fe9540d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.148+0000 7fe9527fc640 1 -- 172.21.15.62:0/1174535000 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540d19d0 con 0x7fe9540b8760 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.149+0000 7fe9527fc640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540b8760 0x7fe9540d24b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe948009870 tx=0x7fe94802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee89ab9c66a0778e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.149+0000 7fe951ffb640 1 -- 172.21.15.62:0/1174535000 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948030840 con 0x7fe9540b8760 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.149+0000 7fe951ffb640 1 -- 172.21.15.62:0/1174535000 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9480309a0 con 0x7fe9540b8760 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.149+0000 7fe951ffb640 1 -- 172.21.15.62:0/1174535000 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948030d30 con 0x7fe9540b8760 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 -- 172.21.15.62:0/1174535000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540b8760 msgr2=0x7fe9540d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540b8760 0x7fe9540d24b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe948009870 tx=0x7fe94802b980 comp rx=0 tx=0).stop 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 -- 172.21.15.62:0/1174535000 shutdown_connections 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540cd8c0 0x7fe9540cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 --2- 172.21.15.62:0/1174535000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540b8760 0x7fe9540d24b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 -- 172.21.15.62:0/1174535000 >> 172.21.15.62:0/1174535000 conn(0x7fe9540718a0 msgr2=0x7fe954071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 -- 172.21.15.62:0/1174535000 shutdown_connections 2023-09-30T13:55:50.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.150+0000 7fe959476640 1 -- 172.21.15.62:0/1174535000 wait complete. 2023-09-30T13:55:50.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.151+0000 7fe959476640 1 Processor -- start 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.151+0000 7fe959476640 1 -- start start 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540b8760 0x7fe95414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95415cbc0 0x7fe9541f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f5dd0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f22f0 con 0x7fe95415cbc0 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe959476640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540cb8f0 con 0x7fe9540b8760 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe9527fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe9527fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49148/0 (socket says 172.21.15.62:49148) 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe9527fc640 1 -- 172.21.15.62:0/3276778391 learned_addr learned my addr 172.21.15.62:0/3276778391 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe952ffd640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540b8760 0x7fe95414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.152+0000 7fe9537fe640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95415cbc0 0x7fe9541f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 -- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540b8760 msgr2=0x7fe95414c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540b8760 0x7fe95414c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 -- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95415cbc0 msgr2=0x7fe9541f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95415cbc0 0x7fe9541f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 -- 172.21.15.62:0/3276778391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480094d0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe9527fc640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe94802b9c0 tx=0x7fe948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948039c90 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948039df0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9540cbbd0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480446c0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.153+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9540cb5e0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.154+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9541f5f10 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.155+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe94802f390 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.155+0000 7fe93b7fe640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 0x7fe94006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.155+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe94803e070 con 0x7fe9540cd8c0 2023-09-30T13:55:50.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.155+0000 7fe952ffd640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 0x7fe94006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.156+0000 7fe952ffd640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 0x7fe94006cff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9541541b0 tx=0x7fe944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.159+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe948076dc0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.336+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe95404e0d0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.336+0000 7fe93b7fe640 1 -- 172.21.15.62:0/3276778391 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe94807a3e0 con 0x7fe9540cd8c0 2023-09-30T13:55:50.336 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:50.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 msgr2=0x7fe94006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 0x7fe94006cff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9541541b0 tx=0x7fe944009040 comp rx=0 tx=0).stop 2023-09-30T13:55:50.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 msgr2=0x7fe9540cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe94802b9c0 tx=0x7fe948004730 comp rx=0 tx=0).stop 2023-09-30T13:55:50.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 shutdown_connections 2023-09-30T13:55:50.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe94006ab30 0x7fe94006cff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95415cbc0 0x7fe9541f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe9540cd8c0 0x7fe9540cb0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 --2- 172.21.15.62:0/3276778391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9540b8760 0x7fe95414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 >> 172.21.15.62:0/3276778391 conn(0x7fe9540718a0 msgr2=0x7fe9540b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 shutdown_connections 2023-09-30T13:55:50.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.338+0000 7fe959476640 1 -- 172.21.15.62:0/3276778391 wait complete. 2023-09-30T13:55:50.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:50.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.459+0000 7f3208fce640 1 Processor -- start 2023-09-30T13:55:50.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.459+0000 7f3208fce640 1 -- start start 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f3208fce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 0x7f32040b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f3208fce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040d0050 con 0x7f32040cd960 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f3208fce640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320406b500 con 0x7f320406bf80 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f3208fce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040cdd40 con 0x7f320406b070 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f320259c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f32040cd960 0x7f320406b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45672/0 (socket says 172.21.15.62:45672) 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f320259c640 1 -- 172.21.15.62:0/501062669 learned_addr learned my addr 172.21.15.62:0/501062669 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.460+0000 7f31fbfff640 1 --2- 172.21.15.62:0/501062669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 0x7f32040b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302069724 0 0) 0x7f32040d0050 con 0x7f32040cd960 2023-09-30T13:55:50.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003520 con 0x7f32040cd960 2023-09-30T13:55:50.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989480315 0 0) 0x7f320406b500 con 0x7f320406bf80 2023-09-30T13:55:50.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32040d0050 con 0x7f320406bf80 2023-09-30T13:55:50.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f31fbfff640 1 -- 172.21.15.62:0/501062669 >> v1:172.21.15.135:6789/0 conn(0x7f320406bf80 legacy=0x7f32040b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f31fbfff640 1 -- 172.21.15.62:0/501062669 >> v1:172.21.15.62:6789/0 conn(0x7f32040cd960 legacy=0x7f320406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.461+0000 7f31fbfff640 1 -- 172.21.15.62:0/501062669 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040cf720 con 0x7f320406b070 2023-09-30T13:55:50.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.462+0000 7f31fbfff640 1 --2- 172.21.15.62:0/501062669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 0x7f32040b04c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097d0 tx=0x7f31ec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=874ca39253dd5487 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec031890 con 0x7f320406b070 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0319f0 con 0x7f320406b070 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3201d9b640 1 -- 172.21.15.62:0/501062669 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec031d60 con 0x7f320406b070 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 -- 172.21.15.62:0/501062669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 msgr2=0x7f32040b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 --2- 172.21.15.62:0/501062669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 0x7f32040b04c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097d0 tx=0x7f31ec02b930 comp rx=0 tx=0).stop 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 -- 172.21.15.62:0/501062669 shutdown_connections 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 --2- 172.21.15.62:0/501062669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f320406b070 0x7f32040b04c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 -- 172.21.15.62:0/501062669 >> 172.21.15.62:0/501062669 conn(0x7f32040d08e0 msgr2=0x7f32040d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 -- 172.21.15.62:0/501062669 shutdown_connections 2023-09-30T13:55:50.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.463+0000 7f3208fce640 1 -- 172.21.15.62:0/501062669 wait complete. 2023-09-30T13:55:50.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.465+0000 7f3208fce640 1 Processor -- start 2023-09-30T13:55:50.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.465+0000 7f3208fce640 1 -- start start 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32040cd960 0x7f32040ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32040c6980 0x7f32040c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040ae740 con 0x7f320406bf80 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320414b010 con 0x7f32040cd960 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3208fce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040adb30 con 0x7f32040c6980 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49162/0 (socket says 172.21.15.62:49162) 2023-09-30T13:55:50.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 -- 172.21.15.62:0/4018315093 learned_addr learned my addr 172.21.15.62:0/4018315093 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f31fbfff640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32040cd960 0x7f32040ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f3202d9d640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32040c6980 0x7f32040c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 -- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32040c6980 msgr2=0x7f32040c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32040c6980 0x7f32040c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 -- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32040cd960 msgr2=0x7f32040ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32040cd960 0x7f32040ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 -- 172.21.15.62:0/4018315093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009400 con 0x7f320406bf80 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f320259c640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c500 tx=0x7f31f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.466+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4005ce0 con 0x7f320406bf80 2023-09-30T13:55:50.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.467+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4005e60 con 0x7f320406bf80 2023-09-30T13:55:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.467+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040ade10 con 0x7f320406bf80 2023-09-30T13:55:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.467+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4007330 con 0x7f320406bf80 2023-09-30T13:55:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.467+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040ae3d0 con 0x7f320406bf80 2023-09-30T13:55:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.468+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320404e0d0 con 0x7f320406bf80 2023-09-30T13:55:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.468+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f31f4007490 con 0x7f320406bf80 2023-09-30T13:55:50.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.468+0000 7f31faffd640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 0x7f31e406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.469+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31f4088b60 con 0x7f320406bf80 2023-09-30T13:55:50.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.469+0000 7f31fbfff640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 0x7f31e406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.469+0000 7f31fbfff640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 0x7f31e406d020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31ec036000 tx=0x7f31ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.473+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f31f4053bf0 con 0x7f320406bf80 2023-09-30T13:55:50.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.649+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3204066ca0 con 0x7f320406bf80 2023-09-30T13:55:50.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.649+0000 7f31faffd640 1 -- 172.21.15.62:0/4018315093 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31f4017020 con 0x7f320406bf80 2023-09-30T13:55:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:50.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 msgr2=0x7f31e406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 0x7f31e406d020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31ec036000 tx=0x7f31ec008030 comp rx=0 tx=0).stop 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 msgr2=0x7f32040aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c500 tx=0x7f31f400c9c0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 shutdown_connections 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f31e406ab60 0x7f31e406d020 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32040c6980 0x7f32040c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32040cd960 0x7f32040ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 --2- 172.21.15.62:0/4018315093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f320406bf80 0x7f32040aebd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 >> 172.21.15.62:0/4018315093 conn(0x7f32040d08e0 msgr2=0x7f320415b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 shutdown_connections 2023-09-30T13:55:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.651+0000 7f3208fce640 1 -- 172.21.15.62:0/4018315093 wait complete. 2023-09-30T13:55:50.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:55:50.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 Processor -- start 2023-09-30T13:55:50.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 -- start start 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09e40b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f09e4065a20 0x7f09e40cde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40cd9b0 con 0x7f09e415aaa0 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e415ae80 con 0x7f09e4065a20 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.771+0000 7f09eb5dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40ccda0 con 0x7f09e40c2460 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e9378640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f09e415aaa0 0x7f09e40ca8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45682/0 (socket says 172.21.15.62:45682) 2023-09-30T13:55:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e9378640 1 -- 172.21.15.62:0/2920153641 learned_addr learned my addr 172.21.15.62:0/2920153641 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520819666 0 0) 0x7f09e40cd9b0 con 0x7f09e415aaa0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e9b79640 1 --2- 172.21.15.62:0/2920153641 >> v2:172.21.15.135:3300/0 conn(0x7f09e4065a20 0x7f09e40cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09cc003520 con 0x7f09e415aaa0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e8b77640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09e40b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528484579 0 0) 0x7f09cc003520 con 0x7f09e415aaa0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 msgr2=0x7f09e40b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09e40b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 >> v2:172.21.15.135:3300/0 conn(0x7f09e4065a20 msgr2=0x7f09e40cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 --2- 172.21.15.62:0/2920153641 >> v2:172.21.15.135:3300/0 conn(0x7f09e4065a20 0x7f09e40cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40cd080 con 0x7f09e415aaa0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f09dc001670 con 0x7f09e415aaa0 2023-09-30T13:55:50.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 >> v1:172.21.15.62:6789/0 conn(0x7f09e415aaa0 legacy=0x7f09e40ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc003ef0 0x7f09cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09cc004d00 0x7f09cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e415ae80 con 0x7f09cc004d00 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40ccda0 con 0x7f09cc003ef0 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc00b980 con 0x7f09e40c2460 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e9b79640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09cc004d00 0x7f09cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e9378640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.772+0000 7f09e8b77640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc003ef0 0x7f09cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 -- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 msgr2=0x7f09cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09e40c2460 0x7f09cc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 -- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc003ef0 msgr2=0x7f09cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09cc003ef0 0x7f09cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 -- 172.21.15.62:0/2920153641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc003520 con 0x7f09cc004d00 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.773+0000 7f09e9b79640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09cc004d00 0x7f09cc005180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fc0 tx=0x7f09cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fed5d62d1a10f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d402cc40 con 0x7f09cc004d00 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400f040 con 0x7f09cc004d00 2023-09-30T13:55:50.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09e3fff640 1 -- 172.21.15.62:0/2920153641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4034440 con 0x7f09cc004d00 2023-09-30T13:55:50.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 -- 172.21.15.62:0/2920153641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09cc004d00 msgr2=0x7f09cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/2920153641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09cc004d00 0x7f09cc005180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fc0 tx=0x7f09cc0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09e9b79640 1 -- 172.21.15.62:0/2920153641 reap_dead start 2023-09-30T13:55:50.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 -- 172.21.15.62:0/2920153641 shutdown_connections 2023-09-30T13:55:50.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 -- 172.21.15.62:0/2920153641 >> 172.21.15.62:0/2920153641 conn(0x7f09e40b0850 msgr2=0x7f09e40b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 -- 172.21.15.62:0/2920153641 shutdown_connections 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.774+0000 7f09eb5dc640 1 -- 172.21.15.62:0/2920153641 wait complete. 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.775+0000 7f09eb5dc640 1 Processor -- start 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.775+0000 7f09eb5dc640 1 -- start start 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 0x7f09e41f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 0x7f09e409dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e409e8a0 con 0x7f09e409e420 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40b3cf0 con 0x7f09e406cf70 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09eb5dc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e406c1b0 con 0x7f09cc004d00 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09e9b79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09e9b79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49178/0 (socket says 172.21.15.62:49178) 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09e9b79640 1 -- 172.21.15.62:0/977418276 learned_addr learned my addr 172.21.15.62:0/977418276 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09e8b77640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 0x7f09e409dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.776+0000 7f09e9378640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 0x7f09e41f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 -- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 msgr2=0x7f09e41f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 0x7f09e41f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 -- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 msgr2=0x7f09e409dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 0x7f09e409dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 -- 172.21.15.62:0/977418276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e406c490 con 0x7f09e409e420 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e8b77640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 0x7f09e409dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9378640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 0x7f09e41f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:50.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e9b79640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f09d402dfd0 tx=0x7f09d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4043070 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4034b50 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e406c770 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4003990 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.777+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40b3500 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.778+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e4066dc0 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.778+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f09d403e440 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.779+0000 7f09e1ffb640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 0x7f09d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.779+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09d40aafc0 con 0x7f09e409e420 2023-09-30T13:55:50.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.779+0000 7f09e9378640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 0x7f09d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.780+0000 7f09e9378640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 0x7f09d006cff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001050 tx=0x7f09dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.783+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f09d4075ee0 con 0x7f09e409e420 2023-09-30T13:55:50.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.971+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09e4073e70 con 0x7f09e409e420 2023-09-30T13:55:50.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.972+0000 7f09e1ffb640 1 -- 172.21.15.62:0/977418276 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f09d4039020 con 0x7f09e409e420 2023-09-30T13:55:50.971 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 msgr2=0x7f09d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 0x7f09d006cff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001050 tx=0x7f09dc009040 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 msgr2=0x7f09e40b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f09d402dfd0 tx=0x7f09d4009750 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 shutdown_connections 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09d006ab30 0x7f09d006cff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09e409e420 0x7f09e40b2fc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09e406cf70 0x7f09e409dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 --2- 172.21.15.62:0/977418276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09cc004d00 0x7f09e41f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:50.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 >> 172.21.15.62:0/977418276 conn(0x7f09e40b0850 msgr2=0x7f09e4159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:50.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 shutdown_connections 2023-09-30T13:55:50.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:50.974+0000 7f09eb5dc640 1 -- 172.21.15.62:0/977418276 wait complete. 2023-09-30T13:55:50.984 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2023-09-30T13:55:50.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:50.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-09-30T13:55:51.016 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:51.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:55:51.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:55:51.017 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-30T13:55:51.074 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T13:55:51.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.180+0000 7f44b81a9640 1 Processor -- start 2023-09-30T13:55:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.181+0000 7f44b81a9640 1 -- start start 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.181+0000 7f44b81a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f44b006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.181+0000 7f44b81a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00d0b40 con 0x7f44b015cbe0 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.181+0000 7f44b81a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00cf450 con 0x7f44b00d1410 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.181+0000 7f44b81a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cfcf0 con 0x7f44b00d06b0 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b5f45640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f44b015cbe0 0x7f44b00d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45684/0 (socket says 172.21.15.62:45684) 2023-09-30T13:55:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b5f45640 1 -- 172.21.15.62:0/3956408611 learned_addr learned my addr 172.21.15.62:0/3956408611 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242494330 0 0) 0x7f44ac001290 con 0x7f44b015cbe0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449c003520 con 0x7f44b015cbe0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b6746640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f44b006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009830600 0 0) 0x7f449c003520 con 0x7f44b015cbe0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 msgr2=0x7f44b006bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f44b006bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 >> v1:172.21.15.135:6789/0 conn(0x7f44b00d1410 legacy=0x7f44b006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00cf730 con 0x7f44b015cbe0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f44ac001980 con 0x7f44b015cbe0 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b6746640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f44b006bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 >> v1:172.21.15.62:6789/0 conn(0x7f44b015cbe0 legacy=0x7f44b00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f449c0039a0 0x7f449c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c0047c0 0x7f449c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f449c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cfcf0 con 0x7f449c0039a0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c00bb10 con 0x7f449c0047c0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c00bcd0 con 0x7f44b00d06b0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b5f45640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f449c0039a0 0x7f449c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b6746640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f449c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.182+0000 7f44b5744640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c0047c0 0x7f449c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 -- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 msgr2=0x7f449c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44b00d06b0 0x7f449c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 -- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c0047c0 msgr2=0x7f449c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c0047c0 0x7f449c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 -- 172.21.15.62:0/3956408611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c003520 con 0x7f449c0039a0 2023-09-30T13:55:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b5f45640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f449c0039a0 0x7f449c003dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c210 tx=0x7f449c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d0e27a8646e376 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.183+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac007270 con 0x7f449c0039a0 2023-09-30T13:55:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0073f0 con 0x7f449c0039a0 2023-09-30T13:55:51.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b4f43640 1 -- 172.21.15.62:0/3956408611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac02c890 con 0x7f449c0039a0 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 -- 172.21.15.62:0/3956408611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f449c0039a0 msgr2=0x7f449c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 --2- 172.21.15.62:0/3956408611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f449c0039a0 0x7f449c003dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c210 tx=0x7f449c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b6746640 1 -- 172.21.15.62:0/3956408611 reap_dead start 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 -- 172.21.15.62:0/3956408611 shutdown_connections 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 -- 172.21.15.62:0/3956408611 >> 172.21.15.62:0/3956408611 conn(0x7f44b0089fe0 msgr2=0x7f44b00d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 -- 172.21.15.62:0/3956408611 shutdown_connections 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.184+0000 7f44b81a9640 1 -- 172.21.15.62:0/3956408611 wait complete. 2023-09-30T13:55:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.185+0000 7f44b81a9640 1 Processor -- start 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.185+0000 7f44b81a9640 1 -- start start 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f449c0039a0 0x7f44b00b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b015b6a0 0x7f44b009fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cc3d0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00ca450 con 0x7f44b015b6a0 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b81a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00ca730 con 0x7f449c0039a0 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b6746640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b6746640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49208/0 (socket says 172.21.15.62:49208) 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b6746640 1 -- 172.21.15.62:0/2539603466 learned_addr learned my addr 172.21.15.62:0/2539603466 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b5f45640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f449c0039a0 0x7f44b00b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.186+0000 7f44b5744640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b015b6a0 0x7f44b009fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 -- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f449c0039a0 msgr2=0x7f44b00b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f449c0039a0 0x7f44b00b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 -- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b015b6a0 msgr2=0x7f44b009fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b015b6a0 0x7f44b009fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 -- 172.21.15.62:0/2539603466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00caa10 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b6746640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44b008c050 tx=0x7f44a8010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a801b070 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8010d20 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8010ed0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b00cacf0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.187+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b009ffa0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.188+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b00caee0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.188+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f44a8003990 con 0x7f44b00cb9e0 2023-09-30T13:55:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.189+0000 7f44a67fc640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 0x7f449406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.189+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44a8089b00 con 0x7f44b00cb9e0 2023-09-30T13:55:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.189+0000 7f44b5f45640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 0x7f449406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.190+0000 7f44b5f45640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 0x7f449406d020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44ac034000 tx=0x7f44ac009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.193+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f44a8054ad0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.403+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b004e0d0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.403+0000 7f44a67fc640 1 -- 172.21.15.62:0/2539603466 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f44a80580f0 con 0x7f44b00cb9e0 2023-09-30T13:55:51.403 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:51.403 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 msgr2=0x7f449406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 0x7f449406d020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44ac034000 tx=0x7f44ac009030 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 msgr2=0x7f44b00cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44b008c050 tx=0x7f44a8010530 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 shutdown_connections 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f449406ab60 0x7f449406d020 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44b00cb9e0 0x7f44b00cbe90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b015b6a0 0x7f44b009fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 --2- 172.21.15.62:0/2539603466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f449c0039a0 0x7f44b00b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 >> 172.21.15.62:0/2539603466 conn(0x7f44b0089fe0 msgr2=0x7f44b00b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 shutdown_connections 2023-09-30T13:55:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.405+0000 7f44b81a9640 1 -- 172.21.15.62:0/2539603466 wait complete. 2023-09-30T13:55:51.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:51.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.522+0000 7f9ec7e64640 1 Processor -- start 2023-09-30T13:55:51.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.522+0000 7f9ec7e64640 1 -- start start 2023-09-30T13:55:51.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9ec00ace50 0x7f9ec00b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec00cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec00cef70 0x7f9ec015e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00cf400 con 0x7f9ec00cef70 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00b2e50 con 0x7f9ec00ace50 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec7e64640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015b9a0 con 0x7f9ec00b31c0 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec00cef70 0x7f9ec015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec00cef70 0x7f9ec015e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49210/0 (socket says 172.21.15.62:49210) 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 -- 172.21.15.62:0/696284299 learned_addr learned my addr 172.21.15.62:0/696284299 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec5c00640 1 --2- 172.21.15.62:0/696284299 >> v2:172.21.15.135:3300/0 conn(0x7f9ec00ace50 0x7f9ec00b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec53ff640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec00cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 -- 172.21.15.62:0/696284299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 msgr2=0x7f9ec00cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec00cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 -- 172.21.15.62:0/696284299 >> v2:172.21.15.135:3300/0 conn(0x7f9ec00ace50 msgr2=0x7f9ec00b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 --2- 172.21.15.62:0/696284299 >> v2:172.21.15.135:3300/0 conn(0x7f9ec00ace50 0x7f9ec00b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.523+0000 7f9ec6401640 1 -- 172.21.15.62:0/696284299 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00cc950 con 0x7f9ec00cef70 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.524+0000 7f9ec6401640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec015e510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00b1840 tx=0x7f9eb802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d065720a26d7f27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.524+0000 7f9ec4bfe640 1 -- 172.21.15.62:0/696284299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb802c9e0 con 0x7f9ec00cef70 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.524+0000 7f9ec4bfe640 1 -- 172.21.15.62:0/696284299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb802cb40 con 0x7f9ec00cef70 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.524+0000 7f9ec4bfe640 1 -- 172.21.15.62:0/696284299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80343f0 con 0x7f9ec00cef70 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 -- 172.21.15.62:0/696284299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 msgr2=0x7f9ec015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec015e510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00b1840 tx=0x7f9eb802be40 comp rx=0 tx=0).stop 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 -- 172.21.15.62:0/696284299 shutdown_connections 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec015e510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/696284299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec00cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/696284299 >> v2:172.21.15.135:3300/0 conn(0x7f9ec00ace50 0x7f9ec00b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 -- 172.21.15.62:0/696284299 >> 172.21.15.62:0/696284299 conn(0x7f9ec006a170 msgr2=0x7f9ec006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 -- 172.21.15.62:0/696284299 shutdown_connections 2023-09-30T13:55:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.525+0000 7f9ec7e64640 1 -- 172.21.15.62:0/696284299 wait complete. 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.526+0000 7f9ec7e64640 1 Processor -- start 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.526+0000 7f9ec7e64640 1 -- start start 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 0x7f9ec014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec0071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c6e10 con 0x7f9ec00cef70 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c76b0 con 0x7f9ec00ace50 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec7e64640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec014b440 con 0x7f9ec00b31c0 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49226/0 (socket says 172.21.15.62:49226) 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 -- 172.21.15.62:0/1088265994 learned_addr learned my addr 172.21.15.62:0/1088265994 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec5c00640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 0x7f9ec014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec53ff640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec0071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 -- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 msgr2=0x7f9ec0071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec0071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 -- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 msgr2=0x7f9ec014af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 0x7f9ec014af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 -- 172.21.15.62:0/1088265994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009b30 con 0x7f9ec00cef70 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec5c00640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 0x7f9ec014af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ec6401640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009f40 tx=0x7f9eb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.527+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8009510 con 0x7f9ec00cef70 2023-09-30T13:55:51.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.528+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb803e450 con 0x7f9ec00cef70 2023-09-30T13:55:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.528+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb803e800 con 0x7f9ec00cef70 2023-09-30T13:55:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.528+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00c64f0 con 0x7f9ec00cef70 2023-09-30T13:55:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.528+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00c7340 con 0x7f9ec00cef70 2023-09-30T13:55:51.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.529+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec015adb0 con 0x7f9ec00cef70 2023-09-30T13:55:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.529+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9eb803e960 con 0x7f9ec00cef70 2023-09-30T13:55:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.529+0000 7f9ebe7fc640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 0x7f9eac06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.529+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9eb80ac5c0 con 0x7f9ec00cef70 2023-09-30T13:55:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.530+0000 7f9ec5c00640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 0x7f9eac06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.530+0000 7f9ec5c00640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 0x7f9eac06d020 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b00 tx=0x7f9eb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.534+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9ec015adb0 con 0x7f9ec00cef70 2023-09-30T13:55:51.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.713+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec015adb0 con 0x7f9ec00cef70 2023-09-30T13:55:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.715+0000 7f9ebe7fc640 1 -- 172.21.15.62:0/1088265994 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f9ec015adb0 con 0x7f9ec00cef70 2023-09-30T13:55:51.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:51.715 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 msgr2=0x7f9eac06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 0x7f9eac06d020 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b00 tx=0x7f9eb0008040 comp rx=0 tx=0).stop 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 msgr2=0x7f9ec00c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009f40 tx=0x7f9eb8004a40 comp rx=0 tx=0).stop 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 shutdown_connections 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9eac06ab60 0x7f9eac06d020 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec00cef70 0x7f9ec00c3fe0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ec00b31c0 0x7f9ec0071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 --2- 172.21.15.62:0/1088265994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ec00ace50 0x7f9ec014af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 >> 172.21.15.62:0/1088265994 conn(0x7f9ec006a170 msgr2=0x7f9ec00cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:51.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 shutdown_connections 2023-09-30T13:55:51.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.717+0000 7f9ec7e64640 1 -- 172.21.15.62:0/1088265994 wait complete. 2023-09-30T13:55:51.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:54:47.809905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:54:48.754727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-30T13:54:52.456547+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T13:55:51.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:55:51.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.837+0000 7fbbdb190640 1 Processor -- start 2023-09-30T13:55:51.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.837+0000 7fbbdb190640 1 -- start start 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbdb190640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbbd406b070 0x7fbbd40b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbdb190640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbd40b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbdb190640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40d0050 con 0x7fbbd40cd960 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbdb190640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40cdd40 con 0x7fbbd406b070 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbdb190640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd406b500 con 0x7fbbd406bf80 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd8f2c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbbd40cd960 0x7fbbd406b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45696/0 (socket says 172.21.15.62:45696) 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd8f2c640 1 -- 172.21.15.62:0/826147262 learned_addr learned my addr 172.21.15.62:0/826147262 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd972d640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbd40b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd3fff640 1 --2- 172.21.15.62:0/826147262 >> v2:172.21.15.135:3300/0 conn(0x7fbbd406b070 0x7fbbd40b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830692703 0 0) 0x7fbbd40d0050 con 0x7fbbd40cd960 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc4003520 con 0x7fbbd40cd960 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743156790 0 0) 0x7fbbc4003520 con 0x7fbbd40cd960 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 msgr2=0x7fbbd40b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbd40b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 >> v2:172.21.15.135:3300/0 conn(0x7fbbd406b070 msgr2=0x7fbbd40b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 --2- 172.21.15.62:0/826147262 >> v2:172.21.15.135:3300/0 conn(0x7fbbd406b070 0x7fbbd40b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40cf720 con 0x7fbbd40cd960 2023-09-30T13:55:51.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.838+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fbbc8001670 con 0x7fbbd40cd960 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 >> v1:172.21.15.62:6789/0 conn(0x7fbbd40cd960 legacy=0x7fbbd406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd406b500 con 0x7fbbc4003970 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400b980 con 0x7fbbc4004d00 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400bac0 con 0x7fbbd406bf80 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd3fff640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd972d640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 -- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 msgr2=0x7fbbc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbd406bf80 0x7fbbc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 -- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc4004d00 msgr2=0x7fbbc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc4004d00 0x7fbbc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.839+0000 7fbbd8f2c640 1 -- 172.21.15.62:0/826147262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4003520 con 0x7fbbc4003970 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800c2c0 tx=0x7fbbc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a27054b87009aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8005ad0 con 0x7fbbc4003970 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc8005c30 con 0x7fbbc4003970 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbd37fe640 1 -- 172.21.15.62:0/826147262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc802c8b0 con 0x7fbbc4003970 2023-09-30T13:55:51.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbdb190640 1 -- 172.21.15.62:0/826147262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc4003970 msgr2=0x7fbbc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbdb190640 1 --2- 172.21.15.62:0/826147262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800c2c0 tx=0x7fbbc40057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbd972d640 1 -- 172.21.15.62:0/826147262 reap_dead start 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbdb190640 1 -- 172.21.15.62:0/826147262 shutdown_connections 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbdb190640 1 -- 172.21.15.62:0/826147262 >> 172.21.15.62:0/826147262 conn(0x7fbbd40d08e0 msgr2=0x7fbbd40d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.840+0000 7fbbdb190640 1 -- 172.21.15.62:0/826147262 shutdown_connections 2023-09-30T13:55:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.841+0000 7fbbdb190640 1 -- 172.21.15.62:0/826147262 wait complete. 2023-09-30T13:55:51.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.842+0000 7fbbdb190640 1 Processor -- start 2023-09-30T13:55:51.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.842+0000 7fbbdb190640 1 -- start start 2023-09-30T13:55:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbc4003970 0x7fbbd4157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 0x7fbbd4159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41f29e0 con 0x7fbbd40ad910 2023-09-30T13:55:51.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40c6ea0 con 0x7fbbd41f2560 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41f2c30 con 0x7fbbc4003970 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49248/0 (socket says 172.21.15.62:49248) 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 -- 172.21.15.62:0/705339306 learned_addr learned my addr 172.21.15.62:0/705339306 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbc4003970 0x7fbbd4157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd972d640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 0x7fbbd4159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 -- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbc4003970 msgr2=0x7fbbd4157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbc4003970 0x7fbbd4157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 -- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 msgr2=0x7fbbd4159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 0x7fbbd4159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:51.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 -- 172.21.15.62:0/705339306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd41f2f10 con 0x7fbbd40ad910 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd972d640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 0x7fbbd4159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd3fff640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011600 tx=0x7fbbc0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000f920 con 0x7fbbd40ad910 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000fa80 con 0x7fbbd40ad910 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd4156e80 con 0x7fbbd40ad910 2023-09-30T13:55:51.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000fdf0 con 0x7fbbd40ad910 2023-09-30T13:55:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.843+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd40add90 con 0x7fbbd40ad910 2023-09-30T13:55:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.845+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40d0490 con 0x7fbbd40ad910 2023-09-30T13:55:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.845+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbbc0015460 con 0x7fbbd40ad910 2023-09-30T13:55:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.845+0000 7fbbd17fa640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 0x7fbbb806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:51.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.845+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbbc0089de0 con 0x7fbbd40ad910 2023-09-30T13:55:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.846+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 0x7fbbb806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.846+0000 7fbbd8f2c640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 0x7fbbb806cff0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8034000 tx=0x7fbbc8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:51.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:51.849+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbbc0054c70 con 0x7fbbd40ad910 2023-09-30T13:55:52.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.023+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbd404e0d0 con 0x7fbbd40ad910 2023-09-30T13:55:52.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.023+0000 7fbbd17fa640 1 -- 172.21.15.62:0/705339306 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbc0058290 con 0x7fbbd40ad910 2023-09-30T13:55:52.024 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:55:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 msgr2=0x7fbbb806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 0x7fbbb806cff0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8034000 tx=0x7fbbc8007000 comp rx=0 tx=0).stop 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 msgr2=0x7fbbd41f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011600 tx=0x7fbbc0011ac0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 shutdown_connections 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbb806ab30 0x7fbbb806cff0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbd41f2560 0x7fbbd4159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbd40ad910 0x7fbbd41f2020 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 --2- 172.21.15.62:0/705339306 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbbc4003970 0x7fbbd4157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 >> 172.21.15.62:0/705339306 conn(0x7fbbd40d08e0 msgr2=0x7fbbd40ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 shutdown_connections 2023-09-30T13:55:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.025+0000 7fbbdb190640 1 -- 172.21.15.62:0/705339306 wait complete. 2023-09-30T13:55:52.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:55:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.146+0000 7f607c701640 1 Processor -- start 2023-09-30T13:55:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.146+0000 7f607c701640 1 -- start start 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f60740cd960 0x7f607406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f607406b070 0x7f607406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740b18a0 0x7f60741609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740cdd40 con 0x7f607406b070 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740d0050 con 0x7f60740cd960 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607c701640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607406b500 con 0x7f60740b18a0 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f607406b070 0x7f607406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f607406b070 0x7f607406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49254/0 (socket says 172.21.15.62:49254) 2023-09-30T13:55:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 -- 172.21.15.62:0/2612700442 learned_addr learned my addr 172.21.15.62:0/2612700442 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607ac9e640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740b18a0 0x7f60741609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f607a49d640 1 --2- 172.21.15.62:0/2612700442 >> v2:172.21.15.135:3300/0 conn(0x7f60740cd960 0x7f607406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 -- 172.21.15.62:0/2612700442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740b18a0 msgr2=0x7f60741609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740b18a0 0x7f60741609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 -- 172.21.15.62:0/2612700442 >> v2:172.21.15.135:3300/0 conn(0x7f60740cd960 msgr2=0x7f607406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 --2- 172.21.15.62:0/2612700442 >> v2:172.21.15.135:3300/0 conn(0x7f60740cd960 0x7f607406b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.147+0000 7f6079c9c640 1 -- 172.21.15.62:0/2612700442 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740cf720 con 0x7f607406b070 2023-09-30T13:55:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.148+0000 7f6079c9c640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607406b070 0x7f607406bdb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6074070cf0 tx=0x7f606402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e85e164d50c4458 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.148+0000 7f607949b640 1 -- 172.21.15.62:0/2612700442 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064031870 con 0x7f607406b070 2023-09-30T13:55:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.148+0000 7f607949b640 1 -- 172.21.15.62:0/2612700442 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60640319d0 con 0x7f607406b070 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.148+0000 7f607949b640 1 -- 172.21.15.62:0/2612700442 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064031d60 con 0x7f607406b070 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.148+0000 7f607c701640 1 -- 172.21.15.62:0/2612700442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607406b070 msgr2=0x7f607406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607406b070 0x7f607406bdb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6074070cf0 tx=0x7f606402b910 comp rx=0 tx=0).stop 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 -- 172.21.15.62:0/2612700442 shutdown_connections 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740b18a0 0x7f60741609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 --2- 172.21.15.62:0/2612700442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607406b070 0x7f607406bdb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 --2- 172.21.15.62:0/2612700442 >> v2:172.21.15.135:3300/0 conn(0x7f60740cd960 0x7f607406b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 -- 172.21.15.62:0/2612700442 >> 172.21.15.62:0/2612700442 conn(0x7f60740d08e0 msgr2=0x7f60740d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 -- 172.21.15.62:0/2612700442 shutdown_connections 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.149+0000 7f607c701640 1 -- 172.21.15.62:0/2612700442 wait complete. 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.150+0000 7f607c701640 1 Processor -- start 2023-09-30T13:55:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.150+0000 7f607c701640 1 -- start start 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.150+0000 7f607c701640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.150+0000 7f607c701640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 0x7f60740c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.150+0000 7f607c701640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 0x7f607415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607c701640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60741f3440 con 0x7f60740b18a0 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607c701640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740b26b0 con 0x7f60740b2d50 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607c701640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740b3280 con 0x7f60740cd960 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49260/0 (socket says 172.21.15.62:49260) 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 -- 172.21.15.62:0/3742814448 learned_addr learned my addr 172.21.15.62:0/3742814448 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607ac9e640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 0x7f607415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f6079c9c640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 0x7f60740c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 -- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 msgr2=0x7f60740c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 0x7f60740c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 -- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 msgr2=0x7f607415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 0x7f607415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 -- 172.21.15.62:0/3742814448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640094d0 con 0x7f60740b18a0 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607ac9e640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 0x7f607415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f6079c9c640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 0x7f60740c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:52.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607a49d640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f607000e9b0 tx=0x7f607000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070009670 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000c9a0 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60741f5a70 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000cd50 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.151+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60741f6030 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.152+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607404e0d0 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.153+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6070013470 con 0x7f60740b18a0 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.153+0000 7f606affd640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 0x7f605806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.154+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6070089840 con 0x7f60740b18a0 2023-09-30T13:55:52.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.154+0000 7f6079c9c640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 0x7f605806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.154+0000 7f6079c9c640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 0x7f605806cff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6064036000 tx=0x7f606403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.158+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f60700546d0 con 0x7f60740b18a0 2023-09-30T13:55:52.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.333+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6074066ca0 con 0x7f60740b18a0 2023-09-30T13:55:52.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.334+0000 7f606affd640 1 -- 172.21.15.62:0/3742814448 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6070057cf0 con 0x7f60740b18a0 2023-09-30T13:55:52.333 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 msgr2=0x7f605806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 0x7f605806cff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6064036000 tx=0x7f606403c040 comp rx=0 tx=0).stop 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 msgr2=0x7f60741f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f607000e9b0 tx=0x7f607000ee70 comp rx=0 tx=0).stop 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 shutdown_connections 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f605806ab30 0x7f605806cff0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60740b2d50 0x7f607415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60740cd960 0x7f60740c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 --2- 172.21.15.62:0/3742814448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60740b18a0 0x7f60741f2f00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.335+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 >> 172.21.15.62:0/3742814448 conn(0x7f60740d08e0 msgr2=0x7f607406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.336+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 shutdown_connections 2023-09-30T13:55:52.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.336+0000 7f607c701640 1 -- 172.21.15.62:0/3742814448 wait complete. 2023-09-30T13:55:52.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:55:52.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.456+0000 7f4898834640 1 Processor -- start 2023-09-30T13:55:52.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.456+0000 7f4898834640 1 -- start start 2023-09-30T13:55:52.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4898834640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4894071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4898834640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f489415cee0 0x7f48940c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4898834640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940c9a00 con 0x7f48940ae300 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4898834640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406d740 con 0x7f489415cee0 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4898834640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489406da20 con 0x7f489415cb00 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4892d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48940ae300 0x7f489406ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45706/0 (socket says 172.21.15.62:45706) 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4892d9d640 1 -- 172.21.15.62:0/3740518935 learned_addr learned my addr 172.21.15.62:0/3740518935 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870644376 0 0) 0x7f48940c9a00 con 0x7f48940ae300 2023-09-30T13:55:52.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f488bfff640 1 --2- 172.21.15.62:0/3740518935 >> v2:172.21.15.135:3300/0 conn(0x7f489415cee0 0x7f48940c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f489259c640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4894071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4880003520 con 0x7f48940ae300 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009957554 0 0) 0x7f4880003520 con 0x7f48940ae300 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 msgr2=0x7f4894071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4894071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 >> v2:172.21.15.135:3300/0 conn(0x7f489415cee0 msgr2=0x7f48940c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 --2- 172.21.15.62:0/3740518935 >> v2:172.21.15.135:3300/0 conn(0x7f489415cee0 0x7f48940c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489406dd00 con 0x7f48940ae300 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f488c0019f0 con 0x7f48940ae300 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 >> v1:172.21.15.62:6789/0 conn(0x7f48940ae300 legacy=0x7f489406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4880003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4880003f40 0x7f48800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880004d00 0x7f4880005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489406d740 con 0x7f4880004d00 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489406da20 con 0x7f4880003f40 2023-09-30T13:55:52.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.457+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488000b980 con 0x7f489415cb00 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880004d00 0x7f4880005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f488bfff640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4880003f40 0x7f48800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f489259c640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4880003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 -- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 msgr2=0x7f4880003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4880003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 -- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4880003f40 msgr2=0x7f48800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4880003f40 0x7f48800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f4892d9d640 1 -- 172.21.15.62:0/3740518935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880003520 con 0x7f4880004d00 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.458+0000 7f489259c640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f489415cb00 0x7f4880003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880004d00 0x7f4880005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f488c00a7c0 tx=0x7f48800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3e6c6907856dec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c034630 con 0x7f4880004d00 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c02f070 con 0x7f4880004d00 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4891d9b640 1 -- 172.21.15.62:0/3740518935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c034a30 con 0x7f4880004d00 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 -- 172.21.15.62:0/3740518935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880004d00 msgr2=0x7f4880005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 --2- 172.21.15.62:0/3740518935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880004d00 0x7f4880005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f488c00a7c0 tx=0x7f48800057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4892d9d640 1 -- 172.21.15.62:0/3740518935 reap_dead start 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 -- 172.21.15.62:0/3740518935 shutdown_connections 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 -- 172.21.15.62:0/3740518935 >> 172.21.15.62:0/3740518935 conn(0x7f4894070970 msgr2=0x7f4894070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 -- 172.21.15.62:0/3740518935 shutdown_connections 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.459+0000 7f4898834640 1 -- 172.21.15.62:0/3740518935 wait complete. 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 Processor -- start 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 -- start start 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48941f20c0 0x7f489415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 0x7f489415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940b20a0 con 0x7f48941f1ce0 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940b2380 con 0x7f48941f20c0 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f4898834640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940b2660 con 0x7f48941f30d0 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.461+0000 7f489259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49280/0 (socket says 172.21.15.62:49280) 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 -- 172.21.15.62:0/3272047000 learned_addr learned my addr 172.21.15.62:0/3272047000 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:52.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f488bfff640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48941f20c0 0x7f489415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 0x7f489415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 -- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 msgr2=0x7f489415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 0x7f489415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 -- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48941f20c0 msgr2=0x7f489415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48941f20c0 0x7f489415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 -- 172.21.15.62:0/3272047000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940b2940 con 0x7f48941f1ce0 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f4892d9d640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 0x7f489415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f489259c640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f48840116d0 tx=0x7f4884011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884015870 con 0x7f48941f1ce0 2023-09-30T13:55:52.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840159d0 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48940b1d90 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884015d80 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.462+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4894150a40 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.463+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48940666d0 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.464+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f488400f460 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.464+0000 7f488affd640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 0x7f487406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.464+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4884089df0 con 0x7f48941f1ce0 2023-09-30T13:55:52.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.464+0000 7f488bfff640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 0x7f487406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.465+0000 7f488bfff640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 0x7f487406cff0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f489415c0d0 tx=0x7f487c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.468+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4884054c90 con 0x7f48941f1ce0 2023-09-30T13:55:52.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.642+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4894066e20 con 0x7f48941f1ce0 2023-09-30T13:55:52.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.642+0000 7f488affd640 1 -- 172.21.15.62:0/3272047000 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48840582b0 con 0x7f48941f1ce0 2023-09-30T13:55:52.642 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 msgr2=0x7f487406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 0x7f487406cff0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f489415c0d0 tx=0x7f487c009190 comp rx=0 tx=0).stop 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 msgr2=0x7f48940b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f48840116d0 tx=0x7f4884011ad0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 shutdown_connections 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f487406ab30 0x7f487406cff0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48941f30d0 0x7f489415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48941f20c0 0x7f489415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 --2- 172.21.15.62:0/3272047000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48941f1ce0 0x7f48940b1850 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 >> 172.21.15.62:0/3272047000 conn(0x7f4894070970 msgr2=0x7f48940afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 shutdown_connections 2023-09-30T13:55:52.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.644+0000 7f4898834640 1 -- 172.21.15.62:0/3272047000 wait complete. 2023-09-30T13:55:52.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-30T13:55:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.764+0000 7fb5adb8a640 1 Processor -- start 2023-09-30T13:55:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.764+0000 7fb5adb8a640 1 -- start start 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5adb8a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5a80b2160 0x7fb5a80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5adb8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b4400 0x7fb5a8070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5adb8a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a815b190 con 0x7fb5a80b0a70 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5adb8a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a80b0f20 con 0x7fb5a80b2160 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5adb8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a815afa0 con 0x7fb5a80b4400 2023-09-30T13:55:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5a80b2160 0x7fb5a80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb5a80b0a70 0x7fb5a80b3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45712/0 (socket says 172.21.15.62:45712) 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a6ffd640 1 -- 172.21.15.62:0/3659107789 learned_addr learned my addr 172.21.15.62:0/3659107789 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a77fe640 1 -- 172.21.15.62:0/3659107789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b4400 msgr2=0x7fb5a8070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a7fff640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b4400 0x7fb5a8070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a77fe640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b4400 0x7fb5a8070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a77fe640 1 -- 172.21.15.62:0/3659107789 >> v1:172.21.15.62:6789/0 conn(0x7fb5a80b0a70 legacy=0x7fb5a80b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a67fc640 1 -- 172.21.15.62:0/3659107789 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585440724 0 0) 0x7fb5a815b190 con 0x7fb5a80b0a70 2023-09-30T13:55:52.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.765+0000 7fb5a77fe640 1 -- 172.21.15.62:0/3659107789 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a815b470 con 0x7fb5a80b2160 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.766+0000 7fb5a77fe640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b2160 0x7fb5a80b0530 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097a0 tx=0x7fb59802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7edea2dc9a771c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.766+0000 7fb5a67fc640 1 -- 172.21.15.62:0/3659107789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031830 con 0x7fb5a80b2160 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.766+0000 7fb5a67fc640 1 -- 172.21.15.62:0/3659107789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb598031990 con 0x7fb5a80b2160 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.766+0000 7fb5a67fc640 1 -- 172.21.15.62:0/3659107789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031d20 con 0x7fb5a80b2160 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 -- 172.21.15.62:0/3659107789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b2160 msgr2=0x7fb5a80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b2160 0x7fb5a80b0530 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097a0 tx=0x7fb59802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 -- 172.21.15.62:0/3659107789 shutdown_connections 2023-09-30T13:55:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b4400 0x7fb5a8070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/3659107789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b2160 0x7fb5a80b0530 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 -- 172.21.15.62:0/3659107789 >> 172.21.15.62:0/3659107789 conn(0x7fb5a80cb720 msgr2=0x7fb5a80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 -- 172.21.15.62:0/3659107789 shutdown_connections 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.767+0000 7fb5adb8a640 1 -- 172.21.15.62:0/3659107789 wait complete. 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.768+0000 7fb5adb8a640 1 Processor -- start 2023-09-30T13:55:52.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.768+0000 7fb5adb8a640 1 -- start start 2023-09-30T13:55:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b2160 0x7fb5a81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 0x7fb5a80ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a81591d0 con 0x7fb5a80b0a70 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a81594b0 con 0x7fb5a80b4400 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5adb8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8159790 con 0x7fb5a80b2160 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49310/0 (socket says 172.21.15.62:49310) 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 -- 172.21.15.62:0/1688860162 learned_addr learned my addr 172.21.15.62:0/1688860162 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a6ffd640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b2160 0x7fb5a81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a7fff640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 0x7fb5a80ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 -- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b2160 msgr2=0x7fb5a81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b2160 0x7fb5a81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 -- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 msgr2=0x7fb5a80ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 0x7fb5a80ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 -- 172.21.15.62:0/1688860162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009400 con 0x7fb5a80b0a70 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a7fff640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 0x7fb5a80ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.769+0000 7fb5a77fe640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb59802bee0 tx=0x7fb5980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.770+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59803ba70 con 0x7fb5a80b0a70 2023-09-30T13:55:52.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.770+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59803bbf0 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.770+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a8159a70 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.770+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980453f0 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.770+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a80ab4d0 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.771+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a8159f90 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.771+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb59804e450 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.771+0000 7fb58ffff640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 0x7fb59406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.772+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb5980ab7b0 con 0x7fb5a80b0a70 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.772+0000 7fb5a6ffd640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 0x7fb59406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:52.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.772+0000 7fb5a6ffd640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 0x7fb59406cff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80706b0 tx=0x7fb59c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:52.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.776+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb5a8159f90 con 0x7fb5a80b0a70 2023-09-30T13:55:52.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.951+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb5a8159f90 con 0x7fb5a80b0a70 2023-09-30T13:55:52.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.952+0000 7fb58ffff640 1 -- 172.21.15.62:0/1688860162 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb5a8159f90 con 0x7fb5a80b0a70 2023-09-30T13:55:52.952 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 msgr2=0x7fb59406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 0x7fb59406cff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80706b0 tx=0x7fb59c009040 comp rx=0 tx=0).stop 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 msgr2=0x7fb5a80aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb59802bee0 tx=0x7fb5980046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 shutdown_connections 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb59406ab30 0x7fb59406cff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a80b4400 0x7fb5a80ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5a80b2160 0x7fb5a81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 --2- 172.21.15.62:0/1688860162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5a80b0a70 0x7fb5a80aaf90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:52.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 >> 172.21.15.62:0/1688860162 conn(0x7fb5a80cb720 msgr2=0x7fb5a80ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:52.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 shutdown_connections 2023-09-30T13:55:52.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:52.954+0000 7fb5adb8a640 1 -- 172.21.15.62:0/1688860162 wait complete. 2023-09-30T13:55:52.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:53.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 Processor -- start 2023-09-30T13:55:53.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 -- start start 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 0x7f2f440d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f440cf450 con 0x7f2f4406c660 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f440cf730 con 0x7f2f440d0d00 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.071+0000 7f2f4a3f0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cfcf0 con 0x7f2f4415cbe0 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f4898d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2f4406c660 0x7f2f440cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45714/0 (socket says 172.21.15.62:45714) 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f4898d640 1 -- 172.21.15.62:0/729116615 learned_addr learned my addr 172.21.15.62:0/729116615 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f43fff640 1 --2- 172.21.15.62:0/729116615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 0x7f2f440d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115964748 0 0) 0x7f2f440cf450 con 0x7f2f4406c660 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f2c003520 con 0x7f2f4406c660 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656325913 0 0) 0x7f2f440cf730 con 0x7f2f440d0d00 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f440cf450 con 0x7f2f440d0d00 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164227690 0 0) 0x7f2f2c003520 con 0x7f2f4406c660 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f43fff640 1 -- 172.21.15.62:0/729116615 >> v1:172.21.15.135:6789/0 conn(0x7f2f440d0d00 legacy=0x7f2f440cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f43fff640 1 -- 172.21.15.62:0/729116615 >> v1:172.21.15.62:6789/0 conn(0x7f2f4406c660 legacy=0x7f2f440cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.072+0000 7f2f43fff640 1 -- 172.21.15.62:0/729116615 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440cfa10 con 0x7f2f4415cbe0 2023-09-30T13:55:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.073+0000 7f2f43fff640 1 --2- 172.21.15.62:0/729116615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 0x7f2f440d06b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=801def7f5a3786ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.073+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0019f0 con 0x7f2f4415cbe0 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.073+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34031560 con 0x7f2f4415cbe0 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.073+0000 7f2f42ffd640 1 -- 172.21.15.62:0/729116615 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340318d0 con 0x7f2f4415cbe0 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/729116615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 msgr2=0x7f2f440d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/729116615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 0x7f2f440d06b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3402b880 comp rx=0 tx=0).stop 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/729116615 shutdown_connections 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/729116615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4415cbe0 0x7f2f440d06b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/729116615 >> 172.21.15.62:0/729116615 conn(0x7f2f44089fe0 msgr2=0x7f2f440d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/729116615 shutdown_connections 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.074+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/729116615 wait complete. 2023-09-30T13:55:53.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.075+0000 7f2f4a3f0640 1 Processor -- start 2023-09-30T13:55:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.075+0000 7f2f4a3f0640 1 -- start start 2023-09-30T13:55:53.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4406c660 0x7f2f440cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 0x7f2f440b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cce60 con 0x7f2f440d0d00 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cb880 con 0x7f2f4415cbe0 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4a3f0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cbb60 con 0x7f2f4406c660 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49316/0 (socket says 172.21.15.62:49316) 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 -- 172.21.15.62:0/2756545131 learned_addr learned my addr 172.21.15.62:0/2756545131 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f43fff640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4406c660 0x7f2f440cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4898d640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 0x7f2f440b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 -- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4406c660 msgr2=0x7f2f440cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4406c660 0x7f2f440cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 -- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 msgr2=0x7f2f440b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 0x7f2f440b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 -- 172.21.15.62:0/2756545131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340093a0 con 0x7f2f440d0d00 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f4898d640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 0x7f2f440b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f437fe640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c490 tx=0x7f2f3800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.076+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380052d0 con 0x7f2f440d0d00 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.077+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38005430 con 0x7f2f440d0d00 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.077+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f440cbe40 con 0x7f2f440d0d00 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.077+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38012870 con 0x7f2f440d0d00 2023-09-30T13:55:53.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.077+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f440cc400 con 0x7f2f440d0d00 2023-09-30T13:55:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.078+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f440b1280 con 0x7f2f440d0d00 2023-09-30T13:55:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.078+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2f380129d0 con 0x7f2f440d0d00 2023-09-30T13:55:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.078+0000 7f2f40ff9640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 0x7f2f3006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.079+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f38089130 con 0x7f2f440d0d00 2023-09-30T13:55:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.079+0000 7f2f43fff640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 0x7f2f3006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.079+0000 7f2f43fff640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 0x7f2f3006cff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f34036000 tx=0x7f2f3403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.083+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2f38054050 con 0x7f2f440d0d00 2023-09-30T13:55:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.299+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f440b1a30 con 0x7f2f440d0d00 2023-09-30T13:55:53.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.299+0000 7f2f40ff9640 1 -- 172.21.15.62:0/2756545131 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f2f38057670 con 0x7f2f440d0d00 2023-09-30T13:55:53.299 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:53.299 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:53.299 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 msgr2=0x7f2f3006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 0x7f2f3006cff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f34036000 tx=0x7f2f3403d040 comp rx=0 tx=0).stop 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 msgr2=0x7f2f44159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c490 tx=0x7f2f3800c950 comp rx=0 tx=0).stop 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 shutdown_connections 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f3006ab30 0x7f2f3006cff0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4415cbe0 0x7f2f440b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f440d0d00 0x7f2f44159e50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 --2- 172.21.15.62:0/2756545131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f4406c660 0x7f2f440cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 >> 172.21.15.62:0/2756545131 conn(0x7f2f44089fe0 msgr2=0x7f2f440d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 shutdown_connections 2023-09-30T13:55:53.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.301+0000 7f2f4a3f0640 1 -- 172.21.15.62:0/2756545131 wait complete. 2023-09-30T13:55:53.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:53.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.419+0000 7f0e5851d640 1 Processor -- start 2023-09-30T13:55:53.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.419+0000 7f0e5851d640 1 -- start start 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e5851d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0e5015aa80 0x7f0e50071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e5851d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e5015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e5851d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5006cba0 con 0x7f0e500c94f0 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e5851d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e50071860 con 0x7f0e5015aa80 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e5851d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5015efe0 con 0x7f0e5015e470 2023-09-30T13:55:53.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e56aba640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0e500c94f0 0x7f0e500b1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45724/0 (socket says 172.21.15.62:45724) 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e56aba640 1 -- 172.21.15.62:0/546417889 learned_addr learned my addr 172.21.15.62:0/546417889 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e55ab8640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e5015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e562b9640 1 --2- 172.21.15.62:0/546417889 >> v2:172.21.15.135:3300/0 conn(0x7f0e5015aa80 0x7f0e50071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e552b7640 1 -- 172.21.15.62:0/546417889 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011554726 0 0) 0x7f0e5006cba0 con 0x7f0e500c94f0 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e552b7640 1 -- 172.21.15.62:0/546417889 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c003520 con 0x7f0e500c94f0 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e562b9640 1 -- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 msgr2=0x7f0e5015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e562b9640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e5015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e562b9640 1 -- 172.21.15.62:0/546417889 >> v1:172.21.15.62:6789/0 conn(0x7f0e500c94f0 legacy=0x7f0e500b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e562b9640 1 -- 172.21.15.62:0/546417889 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5015f2c0 con 0x7f0e5015aa80 2023-09-30T13:55:53.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.420+0000 7f0e55ab8640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e5015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:53.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.421+0000 7f0e562b9640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e50071320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097a0 tx=0x7f0e4c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe005a101a3450f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e552b7640 1 -- 172.21.15.62:0/546417889 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c02d040 con 0x7f0e5015aa80 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e552b7640 1 -- 172.21.15.62:0/546417889 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c031810 con 0x7f0e5015aa80 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e552b7640 1 -- 172.21.15.62:0/546417889 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c031ba0 con 0x7f0e5015aa80 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 -- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 msgr2=0x7f0e50071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e50071320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097a0 tx=0x7f0e4c02b8b0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 -- 172.21.15.62:0/546417889 shutdown_connections 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e5015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 --2- 172.21.15.62:0/546417889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e50071320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 -- 172.21.15.62:0/546417889 >> 172.21.15.62:0/546417889 conn(0x7f0e500ced50 msgr2=0x7f0e500cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 -- 172.21.15.62:0/546417889 shutdown_connections 2023-09-30T13:55:53.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.422+0000 7f0e5851d640 1 -- 172.21.15.62:0/546417889 wait complete. 2023-09-30T13:55:53.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.423+0000 7f0e5851d640 1 Processor -- start 2023-09-30T13:55:53.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.423+0000 7f0e5851d640 1 -- start start 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e500c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e500af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500cd8e0 con 0x7f0e500c94f0 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500cd600 con 0x7f0e5015aa80 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e5851d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500ab970 con 0x7f0e5015e470 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e562b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e562b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49328/0 (socket says 172.21.15.62:49328) 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e562b9640 1 -- 172.21.15.62:0/3301418900 learned_addr learned my addr 172.21.15.62:0/3301418900 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e55ab8640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e500c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.424+0000 7f0e56aba640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e500af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 -- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 msgr2=0x7f0e500af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e500af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 -- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 msgr2=0x7f0e500c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e500c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 -- 172.21.15.62:0/3301418900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009400 con 0x7f0e500c94f0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e562b9640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0098c0 tx=0x7f0e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c03ad60 con 0x7f0e500c94f0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c044400 con 0x7f0e500c94f0 2023-09-30T13:55:53.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c009400 con 0x7f0e500c94f0 2023-09-30T13:55:53.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0445b0 con 0x7f0e500c94f0 2023-09-30T13:55:53.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.425+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e500abf30 con 0x7f0e500c94f0 2023-09-30T13:55:53.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.426+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e500721f0 con 0x7f0e500c94f0 2023-09-30T13:55:53.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.427+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0e4c04d440 con 0x7f0e500c94f0 2023-09-30T13:55:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.427+0000 7f0e46ffd640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 0x7f0e3406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.427+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e4c0ab620 con 0x7f0e500c94f0 2023-09-30T13:55:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.427+0000 7f0e55ab8640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 0x7f0e3406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.428+0000 7f0e55ab8640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 0x7f0e3406d020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c5dd0 tx=0x7f0e40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.431+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0e4c0765f0 con 0x7f0e500c94f0 2023-09-30T13:55:53.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.608+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e50073f10 con 0x7f0e500c94f0 2023-09-30T13:55:53.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.609+0000 7f0e46ffd640 1 -- 172.21.15.62:0/3301418900 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7f0e4c079c10 con 0x7f0e500c94f0 2023-09-30T13:55:53.609 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:53.609 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 msgr2=0x7f0e3406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 0x7f0e3406d020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c5dd0 tx=0x7f0e40009190 comp rx=0 tx=0).stop 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 msgr2=0x7f0e50155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0098c0 tx=0x7f0e4c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 shutdown_connections 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e3406ab60 0x7f0e3406d020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e5015e470 0x7f0e500af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e5015aa80 0x7f0e500c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 --2- 172.21.15.62:0/3301418900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e500c94f0 0x7f0e50155a30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 >> 172.21.15.62:0/3301418900 conn(0x7f0e500ced50 msgr2=0x7f0e5015d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 shutdown_connections 2023-09-30T13:55:53.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.611+0000 7f0e5851d640 1 -- 172.21.15.62:0/3301418900 wait complete. 2023-09-30T13:55:53.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T13:55:53.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.729+0000 7fa4bd96c640 1 Processor -- start 2023-09-30T13:55:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.729+0000 7fa4bd96c640 1 -- start start 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4bd96c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4b8158c20 0x7fa4b80b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4bd96c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa4b80cc210 0x7fa4b8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4bd96c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8159540 con 0x7fa4b80caea0 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4bd96c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80b1ea0 con 0x7fa4b8158c20 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4bd96c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806ddf0 con 0x7fa4b80cc210 2023-09-30T13:55:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4b8158c20 0x7fa4b80b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa4b8158c20 0x7fa4b80b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49342/0 (socket says 172.21.15.62:49342) 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/1380180924 learned_addr learned my addr 172.21.15.62:0/1380180924 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4affff640 1 --2- 172.21.15.62:0/1380180924 >> v2:172.21.15.135:3300/0 conn(0x7fa4b80cc210 0x7fa4b8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/1380180924 >> v2:172.21.15.135:3300/0 conn(0x7fa4b80cc210 msgr2=0x7fa4b8159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 --2- 172.21.15.62:0/1380180924 >> v2:172.21.15.135:3300/0 conn(0x7fa4b80cc210 0x7fa4b8159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/1380180924 >> v1:172.21.15.135:6789/0 conn(0x7fa4b80caea0 legacy=0x7fa4b80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.730+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/1380180924 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80cdf30 con 0x7fa4b8158c20 2023-09-30T13:55:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.731+0000 7fa4b6ffd640 1 --2- 172.21.15.62:0/1380180924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b8158c20 0x7fa4b80b22f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa4b806e490 tx=0x7fa4a802c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50db782dae1dbc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.731+0000 7fa4b67fc640 1 -- 172.21.15.62:0/1380180924 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8004230 con 0x7fa4b8158c20 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.731+0000 7fa4b67fc640 1 -- 172.21.15.62:0/1380180924 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8004390 con 0x7fa4b8158c20 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.731+0000 7fa4b67fc640 1 -- 172.21.15.62:0/1380180924 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8003810 con 0x7fa4b8158c20 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 -- 172.21.15.62:0/1380180924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b8158c20 msgr2=0x7fa4b80b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/1380180924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b8158c20 0x7fa4b80b22f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa4b806e490 tx=0x7fa4a802c9e0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 -- 172.21.15.62:0/1380180924 shutdown_connections 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/1380180924 >> v2:172.21.15.135:3300/0 conn(0x7fa4b80cc210 0x7fa4b8159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/1380180924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b8158c20 0x7fa4b80b22f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 -- 172.21.15.62:0/1380180924 >> 172.21.15.62:0/1380180924 conn(0x7fa4b806a170 msgr2=0x7fa4b806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 -- 172.21.15.62:0/1380180924 shutdown_connections 2023-09-30T13:55:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.732+0000 7fa4bd96c640 1 -- 172.21.15.62:0/1380180924 wait complete. 2023-09-30T13:55:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.733+0000 7fa4bd96c640 1 Processor -- start 2023-09-30T13:55:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.733+0000 7fa4bd96c640 1 -- start start 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4b80cc210 0x7fa4b80afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b8158c20 0x7fa4b81f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80b0b10 con 0x7fa4b80caea0 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81f2fe0 con 0x7fa4b8158c20 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4bd96c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80b0550 con 0x7fa4b80cc210 2023-09-30T13:55:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49350/0 (socket says 172.21.15.62:49350) 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/4221975989 learned_addr learned my addr 172.21.15.62:0/4221975989 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4affff640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4b80cc210 0x7fa4b80afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b77fe640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b8158c20 0x7fa4b81f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4b80cc210 msgr2=0x7fa4b80afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4b80cc210 0x7fa4b80afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b8158c20 msgr2=0x7fa4b81f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b8158c20 0x7fa4b81f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 -- 172.21.15.62:0/4221975989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009460 con 0x7fa4b80caea0 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b6ffd640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa4a802ca20 tx=0x7fa4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.734+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a803d070 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.735+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8004500 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.735+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80b0830 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.735+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8003dd0 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.735+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81f1810 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.736+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b81f1390 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.736+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa4a8030600 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.736+0000 7fa4b4ff9640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 0x7fa49806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.737+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4a80ab3e0 con 0x7fa4b80caea0 2023-09-30T13:55:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.737+0000 7fa4affff640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 0x7fa49806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.737+0000 7fa4affff640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 0x7fa49806cff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4b81eddc0 tx=0x7fa4a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.741+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa4b81f1390 con 0x7fa4b80caea0 2023-09-30T13:55:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.954+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b81f1390 con 0x7fa4b80caea0 2023-09-30T13:55:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.955+0000 7fa4b4ff9640 1 -- 172.21.15.62:0/4221975989 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fa4b81f1390 con 0x7fa4b80caea0 2023-09-30T13:55:53.954 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:53.955 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 msgr2=0x7fa49806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 0x7fa49806cff0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4b81eddc0 tx=0x7fa4a0008040 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 msgr2=0x7fa4b81e4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa4a802ca20 tx=0x7fa4a80046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 shutdown_connections 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa49806ab30 0x7fa49806cff0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4b8158c20 0x7fa4b81f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa4b80cc210 0x7fa4b80afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 --2- 172.21.15.62:0/4221975989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4b80caea0 0x7fa4b81e4cd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 >> 172.21.15.62:0/4221975989 conn(0x7fa4b806a170 msgr2=0x7fa4b80c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 shutdown_connections 2023-09-30T13:55:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:53.957+0000 7fa4bd96c640 1 -- 172.21.15.62:0/4221975989 wait complete. 2023-09-30T13:55:53.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:55:54.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.073+0000 7fa6d6de9640 1 Processor -- start 2023-09-30T13:55:54.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.073+0000 7fa6d6de9640 1 -- start start 2023-09-30T13:55:54.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6d6de9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa6d006dd60 0x7fa6d006e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6d6de9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d015aed0 con 0x7fa6d00b48e0 2023-09-30T13:55:54.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6d6de9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d0066070 con 0x7fa6d00c26f0 2023-09-30T13:55:54.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6d6de9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d00b50a0 con 0x7fa6d006dd60 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6cffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa6d00b48e0 0x7fa6d006cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45730/0 (socket says 172.21.15.62:45730) 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6cffff640 1 -- 172.21.15.62:0/1816314729 learned_addr learned my addr 172.21.15.62:0/1816314729 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6d4b85640 1 --2- 172.21.15.62:0/1816314729 >> v2:172.21.15.135:3300/0 conn(0x7fa6d006dd60 0x7fa6d006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6cf7fe640 1 -- 172.21.15.62:0/1816314729 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697811457 0 0) 0x7fa6d015aed0 con 0x7fa6d00b48e0 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.074+0000 7fa6cf7fe640 1 -- 172.21.15.62:0/1816314729 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b8003520 con 0x7fa6d00b48e0 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.075+0000 7fa6d4b85640 1 -- 172.21.15.62:0/1816314729 >> v1:172.21.15.135:6789/0 conn(0x7fa6d00c26f0 legacy=0x7fa6d006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.075+0000 7fa6d4b85640 1 -- 172.21.15.62:0/1816314729 >> v1:172.21.15.62:6789/0 conn(0x7fa6d00b48e0 legacy=0x7fa6d006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.075+0000 7fa6d4b85640 1 -- 172.21.15.62:0/1816314729 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00b1670 con 0x7fa6d006dd60 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.075+0000 7fa6d4b85640 1 --2- 172.21.15.62:0/1816314729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d006dd60 0x7fa6d006e140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00097a0 tx=0x7fa6c002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287a48f3c6ae5db4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6cf7fe640 1 -- 172.21.15.62:0/1816314729 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c002e070 con 0x7fa6d006dd60 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6cf7fe640 1 -- 172.21.15.62:0/1816314729 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c00315a0 con 0x7fa6d006dd60 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6cf7fe640 1 -- 172.21.15.62:0/1816314729 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0031930 con 0x7fa6d006dd60 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1816314729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d006dd60 msgr2=0x7fa6d006e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1816314729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d006dd60 0x7fa6d006e140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00097a0 tx=0x7fa6c002b840 comp rx=0 tx=0).stop 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1816314729 shutdown_connections 2023-09-30T13:55:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1816314729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d006dd60 0x7fa6d006e140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1816314729 >> 172.21.15.62:0/1816314729 conn(0x7fa6d00b0b50 msgr2=0x7fa6d00b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1816314729 shutdown_connections 2023-09-30T13:55:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.076+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1816314729 wait complete. 2023-09-30T13:55:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.077+0000 7fa6d6de9640 1 Processor -- start 2023-09-30T13:55:54.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.077+0000 7fa6d6de9640 1 -- start start 2023-09-30T13:55:54.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d006dd60 0x7fa6d01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d00b48e0 0x7fa6d00c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d009d4c0 con 0x7fa6d00c26f0 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01579e0 con 0x7fa6d00b48e0 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d6de9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00c3ed0 con 0x7fa6d006dd60 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d5386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d5386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49354/0 (socket says 172.21.15.62:49354) 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.078+0000 7fa6d5386640 1 -- 172.21.15.62:0/1603769770 learned_addr learned my addr 172.21.15.62:0/1603769770 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6cffff640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d00b48e0 0x7fa6d00c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d4b85640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d006dd60 0x7fa6d01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 -- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d006dd60 msgr2=0x7fa6d01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d006dd60 0x7fa6d01574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 -- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d00b48e0 msgr2=0x7fa6d00c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d00b48e0 0x7fa6d00c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 -- 172.21.15.62:0/1603769770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0009400 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d5386640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c6b0 tx=0x7fa6c800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8003b70 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8003cf0 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8005310 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d00c3630 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.079+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d00c3bf0 con 0x7fa6d00c26f0 2023-09-30T13:55:54.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.080+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d009d600 con 0x7fa6d00c26f0 2023-09-30T13:55:54.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.081+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa6c8005470 con 0x7fa6d00c26f0 2023-09-30T13:55:54.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.081+0000 7fa6cd7fa640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 0x7fa6bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.081+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6c80892b0 con 0x7fa6d00c26f0 2023-09-30T13:55:54.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.081+0000 7fa6d4b85640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 0x7fa6bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.082+0000 7fa6d4b85640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 0x7fa6bc06cff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0036000 tx=0x7fa6c003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.085+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa6d009d600 con 0x7fa6d00c26f0 2023-09-30T13:55:54.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.302+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6d009d600 con 0x7fa6d00c26f0 2023-09-30T13:55:54.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.303+0000 7fa6cd7fa640 1 -- 172.21.15.62:0/1603769770 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fa6d009d600 con 0x7fa6d00c26f0 2023-09-30T13:55:54.303 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:54.303 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2648805728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2648805728},{"type":"v1","addr":"172.21.15.62:6834","nonce":2648805728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2428090649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":2428090649},{"type":"v1","addr":"172.21.15.135:6837","nonce":2428090649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3999956846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3999956846},{"type":"v1","addr":"172.21.15.62:6835","nonce":3999956846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:54:49.768336+0000","modified":"2023-09-30T13:55:05.842227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/2869657877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2869657877},{"type":"v1","addr":"172.21.15.135:6836","nonce":2869657877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T13:55:54.303 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 msgr2=0x7fa6bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 0x7fa6bc06cff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0036000 tx=0x7fa6c003d040 comp rx=0 tx=0).stop 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 msgr2=0x7fa6d009f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c6b0 tx=0x7fa6c800cb70 comp rx=0 tx=0).stop 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 shutdown_connections 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa6bc06ab30 0x7fa6bc06cff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6d00c26f0 0x7fa6d009f910 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6d00b48e0 0x7fa6d00c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 --2- 172.21.15.62:0/1603769770 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa6d006dd60 0x7fa6d01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 >> 172.21.15.62:0/1603769770 conn(0x7fa6d00b0b50 msgr2=0x7fa6d006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 shutdown_connections 2023-09-30T13:55:54.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.305+0000 7fa6d6de9640 1 -- 172.21.15.62:0/1603769770 wait complete. 2023-09-30T13:55:54.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:55:54.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.423+0000 7fbb5f797640 1 Processor -- start 2023-09-30T13:55:54.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.423+0000 7fbb5f797640 1 -- start start 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5f797640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5815cdb0 0x7fbb580cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5f797640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb580ca200 0x7fbb580ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5f797640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5815d190 con 0x7fbb580d0040 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5f797640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580d05e0 con 0x7fbb580ca200 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5f797640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b0900 con 0x7fbb5815cdb0 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5dd34640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb580ca200 0x7fbb580ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5cd32640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb580d0040 0x7fbb580cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45740/0 (socket says 172.21.15.62:45740) 2023-09-30T13:55:54.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5cd32640 1 -- 172.21.15.62:0/1120135208 learned_addr learned my addr 172.21.15.62:0/1120135208 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:54.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5d533640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5815cdb0 0x7fbb580cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5dd34640 1 -- 172.21.15.62:0/1120135208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5815cdb0 msgr2=0x7fbb580cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:54.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5dd34640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5815cdb0 0x7fbb580cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5dd34640 1 -- 172.21.15.62:0/1120135208 >> v1:172.21.15.62:6789/0 conn(0x7fbb580d0040 legacy=0x7fbb580cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.424+0000 7fbb5dd34640 1 -- 172.21.15.62:0/1120135208 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580b0be0 con 0x7fbb580ca200 2023-09-30T13:55:54.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb5dd34640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580ca200 0x7fbb580ca660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b4bb0f2ffb9f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb4ffff640 1 -- 172.21.15.62:0/1120135208 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5002cc50 con 0x7fbb580ca200 2023-09-30T13:55:54.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb4ffff640 1 -- 172.21.15.62:0/1120135208 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5002cdb0 con 0x7fbb580ca200 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb4ffff640 1 -- 172.21.15.62:0/1120135208 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50034660 con 0x7fbb580ca200 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb5f797640 1 -- 172.21.15.62:0/1120135208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580ca200 msgr2=0x7fbb580ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.425+0000 7fbb5f797640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580ca200 0x7fbb580ca660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009d90 tx=0x7fbb5002bea0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 -- 172.21.15.62:0/1120135208 shutdown_connections 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580ca200 0x7fbb580ca660 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 --2- 172.21.15.62:0/1120135208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb5815cdb0 0x7fbb580cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 -- 172.21.15.62:0/1120135208 >> 172.21.15.62:0/1120135208 conn(0x7fbb58098a50 msgr2=0x7fbb580cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 -- 172.21.15.62:0/1120135208 shutdown_connections 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.426+0000 7fbb5f797640 1 -- 172.21.15.62:0/1120135208 wait complete. 2023-09-30T13:55:54.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 Processor -- start 2023-09-30T13:55:54.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 -- start start 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 0x7fbb581466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 0x7fbb58148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c5650 con 0x7fbb580d0040 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c3e10 con 0x7fbb5815cdb0 2023-09-30T13:55:54.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.427+0000 7fbb5f797640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58149590 con 0x7fbb580ca200 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49378/0 (socket says 172.21.15.62:49378) 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 -- 172.21.15.62:0/2644905107 learned_addr learned my addr 172.21.15.62:0/2644905107 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5d533640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 0x7fbb581466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5dd34640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 0x7fbb58148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 -- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 msgr2=0x7fbb581466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 0x7fbb581466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 -- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 msgr2=0x7fbb58148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 0x7fbb58148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 -- 172.21.15.62:0/2644905107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009a70 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5d533640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 0x7fbb581466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5dd34640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 0x7fbb58148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5cd32640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c480 tx=0x7fbb4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48005ce0 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48005e40 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58149870 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb480072d0 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.428+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb581492a0 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.429+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb581474e0 con 0x7fbb580d0040 2023-09-30T13:55:54.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.430+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbb480074f0 con 0x7fbb580d0040 2023-09-30T13:55:54.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.430+0000 7fbb4dffb640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 0x7fbb3c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.430+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbb48088ad0 con 0x7fbb580d0040 2023-09-30T13:55:54.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.430+0000 7fbb5d533640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 0x7fbb3c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.431+0000 7fbb5d533640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 0x7fbb3c06cff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb1e0 tx=0x7fbb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.434+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbb48053970 con 0x7fbb580d0040 2023-09-30T13:55:54.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.612+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb580c5790 con 0x7fbb580d0040 2023-09-30T13:55:54.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.613+0000 7fbb4dffb640 1 -- 172.21.15.62:0/2644905107 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18711 (secure 0 0 0) 0x7fbb580c5790 con 0x7fbb580d0040 2023-09-30T13:55:54.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:55:54.613 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:55:31.576165+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:54:47.809905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-30T13:54:48.754727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-30T13:54:52.456547+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 msgr2=0x7fbb3c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 0x7fbb3c06cff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb1e0 tx=0x7fbb54008040 comp rx=0 tx=0).stop 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 msgr2=0x7fbb5815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c480 tx=0x7fbb4800c940 comp rx=0 tx=0).stop 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 shutdown_connections 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbb3c06ab30 0x7fbb3c06cff0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb5815cdb0 0x7fbb58148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb580d0040 0x7fbb5815dca0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 --2- 172.21.15.62:0/2644905107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb580ca200 0x7fbb581466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 >> 172.21.15.62:0/2644905107 conn(0x7fbb58098a50 msgr2=0x7fbb580cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 shutdown_connections 2023-09-30T13:55:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.615+0000 7fbb5f797640 1 -- 172.21.15.62:0/2644905107 wait complete. 2023-09-30T13:55:54.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T13:55:54.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.735+0000 7f0b911c5640 1 Processor -- start 2023-09-30T13:55:54.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.735+0000 7f0b911c5640 1 -- start start 2023-09-30T13:55:54.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b911c5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b8c0b5790 0x7f0b8c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b911c5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c0cda60 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b911c5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c0d18a0 con 0x7f0b8c160160 2023-09-30T13:55:54.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b911c5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c160540 con 0x7f0b8c0b5790 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b8a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b8c0b5790 0x7f0b8c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b8b59e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0b8c0b5bf0 0x7f0b8c0cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45746/0 (socket says 172.21.15.62:45746) 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.736+0000 7f0b8b59e640 1 -- 172.21.15.62:0/3971348607 learned_addr learned my addr 172.21.15.62:0/3971348607 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3971348607 >> v1:172.21.15.135:6789/0 conn(0x7f0b8c160160 legacy=0x7f0b8c0d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3971348607 >> v1:172.21.15.62:6789/0 conn(0x7f0b8c0b5bf0 legacy=0x7f0b8c0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b89d9b640 1 -- 172.21.15.62:0/3971348607 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293173052 0 0) 0x7f0b8c0cda60 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3971348607 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0cd450 con 0x7f0b8c0b5790 2023-09-30T13:55:54.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b8a59c640 1 --2- 172.21.15.62:0/3971348607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5790 0x7f0b8c0cdef0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67629d39d8f79169 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.737+0000 7f0b89d9b640 1 -- 172.21.15.62:0/3971348607 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74030610 con 0x7f0b8c0b5790 2023-09-30T13:55:54.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b89d9b640 1 -- 172.21.15.62:0/3971348607 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74030770 con 0x7f0b8c0b5790 2023-09-30T13:55:54.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b89d9b640 1 -- 172.21.15.62:0/3971348607 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74030b00 con 0x7f0b8c0b5790 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 -- 172.21.15.62:0/3971348607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5790 msgr2=0x7f0b8c0cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3971348607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5790 0x7f0b8c0cdef0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402b960 comp rx=0 tx=0).stop 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 -- 172.21.15.62:0/3971348607 shutdown_connections 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3971348607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5790 0x7f0b8c0cdef0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 -- 172.21.15.62:0/3971348607 >> 172.21.15.62:0/3971348607 conn(0x7f0b8c089fe0 msgr2=0x7f0b8c0d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 -- 172.21.15.62:0/3971348607 shutdown_connections 2023-09-30T13:55:54.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.738+0000 7f0b911c5640 1 -- 172.21.15.62:0/3971348607 wait complete. 2023-09-30T13:55:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 Processor -- start 2023-09-30T13:55:54.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 -- start start 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 0x7f0b8c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 0x7f0b8c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c157fe0 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1576b0 con 0x7f0b8c160160 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b911c5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c157990 con 0x7f0b8c0b5790 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b8a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49390/0 (socket says 172.21.15.62:49390) 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.740+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3637605725 learned_addr learned my addr 172.21.15.62:0/3637605725 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:54.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8b59e640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 0x7f0b8c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8ad9d640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 0x7f0b8c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 msgr2=0x7f0b8c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 0x7f0b8c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 msgr2=0x7f0b8c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 0x7f0b8c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 -- 172.21.15.62:0/3637605725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009400 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8ad9d640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 0x7f0b8c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8b59e640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 0x7f0b8c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b8a59c640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000c00 tx=0x7f0b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7403f070 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74004030 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740043e0 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c157c70 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.741+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c15bf90 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.742+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c158190 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.743+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0b74043070 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.743+0000 7f0b837fe640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 0x7f0b6c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.743+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0b740ab360 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.743+0000 7f0b8ad9d640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 0x7f0b6c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:54.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.744+0000 7f0b8ad9d640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 0x7f0b6c06cff0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b84007fd0 tx=0x7f0b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:54.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.747+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0b74076280 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.959+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0b8c073e70 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.959 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-09-30T13:55:54.959+0000 7f9b7f1be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T13:55:54.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.963+0000 7f0b837fe640 1 -- 172.21.15.62:0/3637605725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b74034090 con 0x7f0b8c0b5bf0 2023-09-30T13:55:54.962 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 msgr2=0x7f0b6c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 0x7f0b6c06cff0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b84007fd0 tx=0x7f0b84009040 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 msgr2=0x7f0b8c15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000c00 tx=0x7f0b740046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 shutdown_connections 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b6c06ab30 0x7f0b6c06cff0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8c160160 0x7f0b8c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b8c0b5bf0 0x7f0b8c15a0e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 --2- 172.21.15.62:0/3637605725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8c0b5790 0x7f0b8c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 >> 172.21.15.62:0/3637605725 conn(0x7f0b8c089fe0 msgr2=0x7f0b8c0cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:54.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 shutdown_connections 2023-09-30T13:55:54.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:54.965+0000 7f0b911c5640 1 -- 172.21.15.62:0/3637605725 wait complete. 2023-09-30T13:55:54.968 INFO:tasks.ceph.mds.b.smithi135.stderr: -4041> 2023-09-30T13:54:54.319+0000 7f28cf92a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T13:55:54.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T13:55:54.998 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-09-30T13:55:55.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.087+0000 7f09c4015640 1 Processor -- start 2023-09-30T13:55:55.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.087+0000 7f09c4015640 1 -- start start 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c4015640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09bc0cca40 0x7f09bc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c4015640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0cdb30 con 0x7f09bc15dc60 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c4015640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0ccf20 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c4015640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0cd200 con 0x7f09bc0cca40 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c1db1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f09bc15dc60 0x7f09bc0b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45754/0 (socket says 172.21.15.62:45754) 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c1db1640 1 -- 172.21.15.62:0/3279520460 learned_addr learned my addr 172.21.15.62:0/3279520460 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c15b0640 1 --2- 172.21.15.62:0/3279520460 >> v2:172.21.15.62:3300/0 conn(0x7f09bc0cca40 0x7f09bc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c15b0640 1 -- 172.21.15.62:0/3279520460 >> v1:172.21.15.135:6789/0 conn(0x7f09bc0cdfc0 legacy=0x7f09bc06ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c15b0640 1 -- 172.21.15.62:0/3279520460 >> v1:172.21.15.62:6789/0 conn(0x7f09bc15dc60 legacy=0x7f09bc0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c0daf640 1 -- 172.21.15.62:0/3279520460 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321810225 0 0) 0x7f09bc0cdb30 con 0x7f09bc15dc60 2023-09-30T13:55:55.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.088+0000 7f09c15b0640 1 -- 172.21.15.62:0/3279520460 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0cd4e0 con 0x7f09bc0cca40 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.089+0000 7f09c15b0640 1 --2- 172.21.15.62:0/3279520460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cca40 0x7f09bc06db70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f09b00097a0 tx=0x7f09b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d3771885156267 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.089+0000 7f09c0daf640 1 -- 172.21.15.62:0/3279520460 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0031830 con 0x7f09bc0cca40 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.089+0000 7f09c0daf640 1 -- 172.21.15.62:0/3279520460 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0031990 con 0x7f09bc0cca40 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.089+0000 7f09c0daf640 1 -- 172.21.15.62:0/3279520460 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0031d20 con 0x7f09bc0cca40 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 -- 172.21.15.62:0/3279520460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cca40 msgr2=0x7f09bc06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 --2- 172.21.15.62:0/3279520460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cca40 0x7f09bc06db70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f09b00097a0 tx=0x7f09b002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 -- 172.21.15.62:0/3279520460 shutdown_connections 2023-09-30T13:55:55.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 --2- 172.21.15.62:0/3279520460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cca40 0x7f09bc06db70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 -- 172.21.15.62:0/3279520460 >> 172.21.15.62:0/3279520460 conn(0x7f09bc070970 msgr2=0x7f09bc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 -- 172.21.15.62:0/3279520460 shutdown_connections 2023-09-30T13:55:55.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.090+0000 7f09c4015640 1 -- 172.21.15.62:0/3279520460 wait complete. 2023-09-30T13:55:55.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.091+0000 7f09c4015640 1 Processor -- start 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.091+0000 7f09c4015640 1 -- start start 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 0x7f09bc0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09bc15dc60 0x7f09bc14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15c6b0 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc155860 con 0x7f09bc0cca40 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c4015640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15b0d0 con 0x7f09bc15dc60 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49408/0 (socket says 172.21.15.62:49408) 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 -- 172.21.15.62:0/1099178856 learned_addr learned my addr 172.21.15.62:0/1099178856 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:55.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c1db1640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 0x7f09bc0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c25b2640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09bc15dc60 0x7f09bc14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 -- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09bc15dc60 msgr2=0x7f09bc14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09bc15dc60 0x7f09bc14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 -- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 msgr2=0x7f09bc0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 0x7f09bc0c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 -- 172.21.15.62:0/1099178856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0009400 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c1db1640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 0x7f09bc0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09c15b0640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000c00 tx=0x7f09b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.092+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b003ca00 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.093+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b003cb60 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.093+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc15b3b0 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.093+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0004030 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.093+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc15b970 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.093+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc0666d0 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.094+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f09b0004190 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.094+0000 7f09ba7fc640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 0x7f09a806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.094+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f09b00abd50 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.095+0000 7f09c1db1640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 0x7f09a806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:55.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.095+0000 7f09c1db1640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 0x7f09a806cff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0012e0 tx=0x7f09ac005c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:55.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.099+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f09b00af030 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.310+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09bc071690 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.966+0000 7f09ba7fc640 1 -- 172.21.15.62:0/1099178856 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09b0076c40 con 0x7f09bc0cdfc0 2023-09-30T13:55:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 msgr2=0x7f09a806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 0x7f09a806cff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0012e0 tx=0x7f09ac005c30 comp rx=0 tx=0).stop 2023-09-30T13:55:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 msgr2=0x7f09bc15c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f09b0000c00 tx=0x7f09b00046c0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 shutdown_connections 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f09a806ab30 0x7f09a806cff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09bc15dc60 0x7f09bc14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09bc0cdfc0 0x7f09bc15c170 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 --2- 172.21.15.62:0/1099178856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09bc0cca40 0x7f09bc0c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 >> 172.21.15.62:0/1099178856 conn(0x7f09bc070970 msgr2=0x7f09bc15c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 shutdown_connections 2023-09-30T13:55:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:55.968+0000 7f09c4015640 1 -- 172.21.15.62:0/1099178856 wait complete. 2023-09-30T13:55:55.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T13:55:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.097+0000 7f688e6e5640 1 Processor -- start 2023-09-30T13:55:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.097+0000 7f688e6e5640 1 -- start start 2023-09-30T13:55:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.097+0000 7f688e6e5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f688815cca0 0x7f68880d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f688e6e5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880d31a0 con 0x7f68880cf970 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f688e6e5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880cdf60 con 0x7f68880b20c0 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f688e6e5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68880cda90 con 0x7f688815cca0 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f6887fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f688815cca0 0x7f68880d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f688cc82640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f68880cf970 0x7f68880d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45770/0 (socket says 172.21.15.62:45770) 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f688cc82640 1 -- 172.21.15.62:0/3570706341 learned_addr learned my addr 172.21.15.62:0/3570706341 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f6887fff640 1 -- 172.21.15.62:0/3570706341 >> v1:172.21.15.135:6789/0 conn(0x7f68880b20c0 legacy=0x7f68880cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f6887fff640 1 -- 172.21.15.62:0/3570706341 >> v1:172.21.15.62:6789/0 conn(0x7f68880cf970 legacy=0x7f68880d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.098+0000 7f6887fff640 1 -- 172.21.15.62:0/3570706341 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880cdc80 con 0x7f688815cca0 2023-09-30T13:55:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f6887fff640 1 --2- 172.21.15.62:0/3570706341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f688815cca0 0x7f68880d3630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f68780097a0 tx=0x7f687802b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b7db9f70897b2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:56.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f6886ffd640 1 -- 172.21.15.62:0/3570706341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878030710 con 0x7f688815cca0 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f6886ffd640 1 -- 172.21.15.62:0/3570706341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687802e050 con 0x7f688815cca0 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f6886ffd640 1 -- 172.21.15.62:0/3570706341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878030a90 con 0x7f688815cca0 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f688e6e5640 1 -- 172.21.15.62:0/3570706341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f688815cca0 msgr2=0x7f68880d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f688e6e5640 1 --2- 172.21.15.62:0/3570706341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f688815cca0 0x7f68880d3630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f68780097a0 tx=0x7f687802b680 comp rx=0 tx=0).stop 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f688e6e5640 1 -- 172.21.15.62:0/3570706341 shutdown_connections 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.099+0000 7f688e6e5640 1 --2- 172.21.15.62:0/3570706341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f688815cca0 0x7f68880d3630 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.100+0000 7f688e6e5640 1 -- 172.21.15.62:0/3570706341 >> 172.21.15.62:0/3570706341 conn(0x7f6888071660 msgr2=0x7f6888071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.100+0000 7f688e6e5640 1 -- 172.21.15.62:0/3570706341 shutdown_connections 2023-09-30T13:55:56.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.100+0000 7f688e6e5640 1 -- 172.21.15.62:0/3570706341 wait complete. 2023-09-30T13:55:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.101+0000 7f688e6e5640 1 Processor -- start 2023-09-30T13:55:56.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.101+0000 7f688e6e5640 1 -- start start 2023-09-30T13:55:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68880b20c0 0x7f68880c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:56.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688815cca0 0x7f68880c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68881f3320 con 0x7f68880cf970 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880c84f0 con 0x7f688815cca0 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68881f26a0 con 0x7f68880b20c0 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49432/0 (socket says 172.21.15.62:49432) 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 -- 172.21.15.62:0/95016405 learned_addr learned my addr 172.21.15.62:0/95016405 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 -- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68880b20c0 msgr2=0x7f68880c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68880b20c0 0x7f68880c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 -- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688815cca0 msgr2=0x7f68880c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688815cca0 0x7f68880c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 -- 172.21.15.62:0/95016405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009400 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f68877fe640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c430 tx=0x7f687c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011790 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c0118f0 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68881f2980 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011ce0 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.102+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68881f2f40 con 0x7f68880cf970 2023-09-30T13:55:56.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.103+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6888073e70 con 0x7f68880cf970 2023-09-30T13:55:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.104+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f687c01c460 con 0x7f68880cf970 2023-09-30T13:55:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.104+0000 7f6884ff9640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 0x7f687406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.104+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f687c089580 con 0x7f68880cf970 2023-09-30T13:55:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.105+0000 7f6887fff640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 0x7f687406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.105+0000 7f6887fff640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 0x7f687406cff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6878034000 tx=0x7f687802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.109+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f687c054450 con 0x7f68880cf970 2023-09-30T13:55:56.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.285+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f688815c1b0 con 0x7f68880cf970 2023-09-30T13:55:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.967+0000 7f6884ff9640 1 -- 172.21.15.62:0/95016405 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f687c057a70 con 0x7f68880cf970 2023-09-30T13:55:56.967 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-09-30T13:55:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 msgr2=0x7f687406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 0x7f687406cff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6878034000 tx=0x7f687802f000 comp rx=0 tx=0).stop 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 msgr2=0x7f68880c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c430 tx=0x7f687c00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 shutdown_connections 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f687406ab30 0x7f687406cff0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6878034000 tx=0x7f687802f000 comp rx=0 tx=0).stop 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f688815cca0 0x7f68880c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68880cf970 0x7f68880c7fb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 --2- 172.21.15.62:0/95016405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68880b20c0 0x7f68880c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 >> 172.21.15.62:0/95016405 conn(0x7f6888071660 msgr2=0x7f68880b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 shutdown_connections 2023-09-30T13:55:56.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:56.973+0000 7f688e6e5640 1 -- 172.21.15.62:0/95016405 wait complete. 2023-09-30T13:55:56.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T13:55:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.104+0000 7f9e4cacf640 1 Processor -- start 2023-09-30T13:55:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.104+0000 7f9e4cacf640 1 -- start start 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e4cacf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e4815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e4cacf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4815b230 con 0x7f9e480ce7c0 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e4cacf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e48155200 con 0x7f9e4815c570 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e4cacf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4815bd00 con 0x7f9e480ce3e0 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e45d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9e480ce7c0 0x7f9e48070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45782/0 (socket says 172.21.15.62:45782) 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.105+0000 7f9e45d9b640 1 -- 172.21.15.62:0/1222929232 learned_addr learned my addr 172.21.15.62:0/1222929232 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4659c640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e4815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759408840 0 0) 0x7f9e4815b230 con 0x7f9e480ce7c0 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e34003520 con 0x7f9e480ce7c0 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035455763 0 0) 0x7f9e34003520 con 0x7f9e480ce7c0 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 msgr2=0x7f9e4815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e4815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 >> v1:172.21.15.135:6789/0 conn(0x7f9e4815c570 legacy=0x7f9e4815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4815b460 con 0x7f9e480ce7c0 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f9e30001670 con 0x7f9e480ce7c0 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 >> v1:172.21.15.62:6789/0 conn(0x7f9e480ce7c0 legacy=0x7f9e48070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e34004d00 0x7f9e34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4815bd00 con 0x7f9e34003f20 2023-09-30T13:55:57.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3400ba60 con 0x7f9e34004d00 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3400bc20 con 0x7f9e480ce3e0 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e4659c640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e46d9d640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e34004d00 0x7f9e34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 -- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 msgr2=0x7f9e340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e480ce3e0 0x7f9e340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 -- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e34004d00 msgr2=0x7f9e34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e34004d00 0x7f9e34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e45d9b640 1 -- 172.21.15.62:0/1222929232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34003520 con 0x7f9e34003f20 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.106+0000 7f9e46d9d640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e34004d00 0x7f9e34005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.107+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e340047c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c210 tx=0x7f9e340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e65760114bbcf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.107+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30005ad0 con 0x7f9e34003f20 2023-09-30T13:55:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.107+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30005c30 con 0x7f9e34003f20 2023-09-30T13:55:57.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.107+0000 7f9e4559a640 1 -- 172.21.15.62:0/1222929232 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3002cad0 con 0x7f9e34003f20 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 -- 172.21.15.62:0/1222929232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 msgr2=0x7f9e340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/1222929232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e340047c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c210 tx=0x7f9e340057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e46d9d640 1 -- 172.21.15.62:0/1222929232 reap_dead start 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 -- 172.21.15.62:0/1222929232 shutdown_connections 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 -- 172.21.15.62:0/1222929232 >> 172.21.15.62:0/1222929232 conn(0x7f9e4806a3b0 msgr2=0x7f9e480affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 -- 172.21.15.62:0/1222929232 shutdown_connections 2023-09-30T13:55:57.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.108+0000 7f9e4cacf640 1 -- 172.21.15.62:0/1222929232 wait complete. 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.109+0000 7f9e4cacf640 1 Processor -- start 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.109+0000 7f9e4cacf640 1 -- start start 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e48141890 0x7f9e481449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4815ca20 0x7f9e4815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48141cf0 con 0x7f9e34003f20 2023-09-30T13:55:57.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480c58d0 con 0x7f9e4815ca20 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4cacf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4815d3e0 con 0x7f9e48141890 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49446/0 (socket says 172.21.15.62:49446) 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 -- 172.21.15.62:0/2218360723 learned_addr learned my addr 172.21.15.62:0/2218360723 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e46d9d640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4815ca20 0x7f9e4815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e48141890 0x7f9e481449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 -- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e48141890 msgr2=0x7f9e481449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e48141890 0x7f9e481449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 -- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4815ca20 msgr2=0x7f9e4815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4815ca20 0x7f9e4815cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.110+0000 7f9e4659c640 1 -- 172.21.15.62:0/2218360723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48144ef0 con 0x7f9e34003f20 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e4659c640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9e400119a0 tx=0x7f9e40011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:57.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000f9d0 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000fb30 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000fea0 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e480c7ad0 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.111+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e480c8090 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.112+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e48073e70 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.112+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9e40014440 con 0x7f9e34003f20 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.113+0000 7f9e3effd640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 0x7f9e2806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:57.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.113+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f9e400898f0 con 0x7f9e34003f20 2023-09-30T13:55:57.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.113+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 0x7f9e2806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:57.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.114+0000 7f9e45d9b640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 0x7f9e2806d020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e30034000 tx=0x7f9e30009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:57.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.117+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9e400548e0 con 0x7f9e34003f20 2023-09-30T13:55:57.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.296+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e480b0e40 con 0x7f9e34003f20 2023-09-30T13:55:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.973+0000 7f9e3effd640 1 -- 172.21.15.62:0/2218360723 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9e40057f00 con 0x7f9e34003f20 2023-09-30T13:55:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-09-30T13:55:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.978+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 msgr2=0x7f9e2806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.978+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 0x7f9e2806d020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e30034000 tx=0x7f9e30009030 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.978+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 msgr2=0x7f9e480c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.978+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9e400119a0 tx=0x7f9e40011da0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 shutdown_connections 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9e2806ab60 0x7f9e2806d020 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e4815ca20 0x7f9e4815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e48141890 0x7f9e481449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 --2- 172.21.15.62:0/2218360723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e34003f20 0x7f9e480c74d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:57.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 >> 172.21.15.62:0/2218360723 conn(0x7f9e4806a3b0 msgr2=0x7f9e480b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:57.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.980+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 shutdown_connections 2023-09-30T13:55:57.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:57.981+0000 7f9e4cacf640 1 -- 172.21.15.62:0/2218360723 wait complete. 2023-09-30T13:55:57.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-09-30T13:55:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.109+0000 7f6864f16640 1 Processor -- start 2023-09-30T13:55:58.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.109+0000 7f6864f16640 1 -- start start 2023-09-30T13:55:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6864f16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f686015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6864f16640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f68600d0b60 0x7f68600c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6864f16640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686015f3c0 con 0x7f68600d06e0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6864f16640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68600cf220 con 0x7f68600d0b60 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6864f16640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68600cf500 con 0x7f686015ab70 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6855d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f68600d06e0 0x7f68600c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36110/0 (socket says 172.21.15.62:36110) 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f6855d9b640 1 -- 172.21.15.62:0/3085236473 learned_addr learned my addr 172.21.15.62:0/3085236473 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685e59c640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f686015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685ed9d640 1 --2- 172.21.15.62:0/3085236473 >> v2:172.21.15.135:3300/0 conn(0x7f68600d0b60 0x7f68600c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185116908 0 0) 0x7f686015f3c0 con 0x7f68600d06e0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f684c003520 con 0x7f68600d06e0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855123799 0 0) 0x7f684c003520 con 0x7f68600d06e0 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 msgr2=0x7f686015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f686015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 >> v2:172.21.15.135:3300/0 conn(0x7f68600d0b60 msgr2=0x7f68600c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 --2- 172.21.15.62:0/3085236473 >> v2:172.21.15.135:3300/0 conn(0x7f68600d0b60 0x7f68600c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68600cb350 con 0x7f68600d06e0 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f6848001670 con 0x7f68600d06e0 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685e59c640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f686015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685ed9d640 1 --2- 172.21.15.62:0/3085236473 >> v2:172.21.15.135:3300/0 conn(0x7f68600d0b60 0x7f68600c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 >> v1:172.21.15.62:6789/0 conn(0x7f68600d06e0 legacy=0x7f68600c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.110+0000 7f685dd9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f684c003970 0x7f684c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685dd9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f684c0047c0 0x7f684c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685dd9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f684c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600cf220 con 0x7f684c0047c0 2023-09-30T13:55:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68600cf500 con 0x7f684c003970 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c00b980 con 0x7f686015ab70 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f684c0047c0 0x7f684c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685e59c640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f684c003970 0x7f684c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685ed9d640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f684c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 -- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 msgr2=0x7f684c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f684c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 -- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f684c003970 msgr2=0x7f684c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f684c003970 0x7f684c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f6855d9b640 1 -- 172.21.15.62:0/3085236473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500093a0 con 0x7f684c0047c0 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.111+0000 7f685ed9d640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f686015ab70 0x7f684c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6855d9b640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f684c0047c0 0x7f684c004c40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f684800c240 tx=0x7f684c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1f8c7b3c05a1ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684802cb00 con 0x7f684c0047c0 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684802cc60 con 0x7f684c0047c0 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f685dd9b640 1 -- 172.21.15.62:0/3085236473 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005af0 con 0x7f684c0047c0 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 -- 172.21.15.62:0/3085236473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f684c0047c0 msgr2=0x7f684c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 --2- 172.21.15.62:0/3085236473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f684c0047c0 0x7f684c004c40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f684800c240 tx=0x7f684c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f685ed9d640 1 -- 172.21.15.62:0/3085236473 reap_dead start 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 -- 172.21.15.62:0/3085236473 shutdown_connections 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 -- 172.21.15.62:0/3085236473 >> 172.21.15.62:0/3085236473 conn(0x7f6860089fe0 msgr2=0x7f6860099c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 -- 172.21.15.62:0/3085236473 shutdown_connections 2023-09-30T13:55:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.112+0000 7f6864f16640 1 -- 172.21.15.62:0/3085236473 wait complete. 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.114+0000 7f6864f16640 1 Processor -- start 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.114+0000 7f6864f16640 1 -- start start 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f684c0047c0 0x7f68600c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 0x7f686006c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601f23d0 con 0x7f68600c5160 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601f25c0 con 0x7f68601f59c0 2023-09-30T13:55:58.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68601f6130 con 0x7f684c0047c0 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43502/0 (socket says 172.21.15.62:43502) 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 -- 172.21.15.62:0/4213828848 learned_addr learned my addr 172.21.15.62:0/4213828848 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685e59c640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f684c0047c0 0x7f68600c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6855d9b640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 0x7f686006c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 -- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f684c0047c0 msgr2=0x7f68600c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f684c0047c0 0x7f68600c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 -- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 msgr2=0x7f686006c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 0x7f686006c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 -- 172.21.15.62:0/4213828848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68601f6410 con 0x7f68600c5160 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6855d9b640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 0x7f686006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:55:58.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f685ed9d640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f68600ce380 tx=0x7f6858011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800e070 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858003990 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68601f66f0 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858003b40 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.115+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686006ca40 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.116+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68601f27e0 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.117+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6858003ca0 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.117+0000 7f68577fe640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 0x7f684006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.118+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f6858089ad0 con 0x7f68600c5160 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.118+0000 7f685e59c640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 0x7f684006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:58.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.118+0000 7f685e59c640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 0x7f684006cff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6850009370 tx=0x7f6850009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:58.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.122+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f68601f27e0 con 0x7f68600c5160 2023-09-30T13:55:58.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.301+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68601f27e0 con 0x7f68600c5160 2023-09-30T13:55:58.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.979+0000 7f68577fe640 1 -- 172.21.15.62:0/4213828848 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f68601f27e0 con 0x7f68600c5160 2023-09-30T13:55:58.979 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' removed 2023-09-30T13:55:58.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 msgr2=0x7f684006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 0x7f684006cff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6850009370 tx=0x7f6850009110 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 msgr2=0x7f68600c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f68600ce380 tx=0x7f6858011890 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 shutdown_connections 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f684006ab30 0x7f684006cff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68600c5160 0x7f68600c55e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68601f59c0 0x7f686006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 --2- 172.21.15.62:0/4213828848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f684c0047c0 0x7f68600c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.983+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 >> 172.21.15.62:0/4213828848 conn(0x7f6860089fe0 msgr2=0x7f68600728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:58.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.986+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 shutdown_connections 2023-09-30T13:55:58.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:58.986+0000 7f6864f16640 1 -- 172.21.15.62:0/4213828848 wait complete. 2023-09-30T13:55:59.001 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T13:55:59.001 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T13:55:59.001 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T13:55:59.002 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:59.002 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T13:55:59.002 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T13:55:59.002 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T13:55:59.002 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:59.002 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T13:55:59.002 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T13:55:59.003 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T13:55:59.003 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:59.003 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T13:55:59.003 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T13:55:59.003 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T13:55:59.003 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:55:59.012 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T13:55:59.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T13:55:59.013 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T13:55:59.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T13:55:59.014 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T13:55:59.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T13:55:59.015 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T13:55:59.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T13:55:59.055 INFO:tasks.ceph.mds.a:Started 2023-09-30T13:55:59.055 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:59.056 INFO:tasks.ceph.mds.c:Started 2023-09-30T13:55:59.056 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:59.057 INFO:tasks.ceph.mds.b:Started 2023-09-30T13:55:59.057 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:59.058 INFO:tasks.ceph.mds.d:Started 2023-09-30T13:55:59.058 DEBUG:teuthology.parallel:result is None 2023-09-30T13:55:59.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T13:55:59.138 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-09-30T13:55:59.138 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-09-30T13:55:59.140 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-09-30T13:55:59.141 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-09-30T13:55:59.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.173+0000 7f5b4e95a640 1 Processor -- start 2023-09-30T13:55:59.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.173+0000 7f5b4e95a640 1 -- start start 2023-09-30T13:55:59.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b48160160 0x7f5b480d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b480d3600 0x7f5b480b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b480b5cd0 0x7f5b480cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480cda60 con 0x7f5b48160160 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480d18a0 con 0x7f5b480b5cd0 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.174+0000 7f5b4e95a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48160540 con 0x7f5b480d3600 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b48160160 0x7f5b480d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b48160160 0x7f5b480d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43544/0 (socket says 172.21.15.62:43544) 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 -- 172.21.15.62:0/3891224688 learned_addr learned my addr 172.21.15.62:0/3891224688 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b477fe640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b480d3600 0x7f5b480b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b4cef7640 1 --2- 172.21.15.62:0/3891224688 >> v2:172.21.15.135:3300/0 conn(0x7f5b480b5cd0 0x7f5b480cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 -- 172.21.15.62:0/3891224688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b480d3600 msgr2=0x7f5b480b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b480d3600 0x7f5b480b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 -- 172.21.15.62:0/3891224688 >> v2:172.21.15.135:3300/0 conn(0x7f5b480b5cd0 msgr2=0x7f5b480cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:55:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 --2- 172.21.15.62:0/3891224688 >> v2:172.21.15.135:3300/0 conn(0x7f5b480b5cd0 0x7f5b480cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.175+0000 7f5b47fff640 1 -- 172.21.15.62:0/3891224688 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480cd450 con 0x7f5b48160160 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.176+0000 7f5b47fff640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b48160160 0x7f5b480d30c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd9d0 tx=0x7f5b4002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9ecb57ddf68613 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.176+0000 7f5b46ffd640 1 -- 172.21.15.62:0/3891224688 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4002cb00 con 0x7f5b48160160 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.176+0000 7f5b46ffd640 1 -- 172.21.15.62:0/3891224688 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4002cc60 con 0x7f5b48160160 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.176+0000 7f5b46ffd640 1 -- 172.21.15.62:0/3891224688 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400343f0 con 0x7f5b48160160 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 -- 172.21.15.62:0/3891224688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b48160160 msgr2=0x7f5b480d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b48160160 0x7f5b480d30c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd9d0 tx=0x7f5b4002bf60 comp rx=0 tx=0).stop 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 -- 172.21.15.62:0/3891224688 shutdown_connections 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/3891224688 >> v2:172.21.15.135:3300/0 conn(0x7f5b480b5cd0 0x7f5b480cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b480d3600 0x7f5b480b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/3891224688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b48160160 0x7f5b480d30c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 -- 172.21.15.62:0/3891224688 >> 172.21.15.62:0/3891224688 conn(0x7f5b48089fe0 msgr2=0x7f5b480d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:59.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 -- 172.21.15.62:0/3891224688 shutdown_connections 2023-09-30T13:55:59.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.177+0000 7f5b4e95a640 1 -- 172.21.15.62:0/3891224688 wait complete. 2023-09-30T13:55:59.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.178+0000 7f5b4e95a640 1 Processor -- start 2023-09-30T13:55:59.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.179+0000 7f5b4e95a640 1 -- start start 2023-09-30T13:55:59.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.179+0000 7f5b4e95a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 0x7f5b4815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.179+0000 7f5b4e95a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.179+0000 7f5b4e95a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b48160160 0x7f5b48156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.179+0000 7f5b4e95a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815dd40 con 0x7f5b480d3600 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b4e95a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480c8e00 con 0x7f5b480b5cd0 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b4e95a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815ce20 con 0x7f5b48160160 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43550/0 (socket says 172.21.15.62:43550) 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 -- 172.21.15.62:0/1962053177 learned_addr learned my addr 172.21.15.62:0/1962053177 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b47fff640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 0x7f5b4815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 -- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b48160160 msgr2=0x7f5b48156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b4cef7640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b48160160 0x7f5b48156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b48160160 0x7f5b48156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 -- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 msgr2=0x7f5b4815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:59.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 0x7f5b4815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 -- 172.21.15.62:0/1962053177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009b30 con 0x7f5b480d3600 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b47fff640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 0x7f5b4815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b477fe640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e870 tx=0x7f5b3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0094f0 con 0x7f5b480d3600 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4815d0c0 con 0x7f5b480d3600 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4815d680 con 0x7f5b480d3600 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00c940 con 0x7f5b480d3600 2023-09-30T13:55:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.180+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00ccd0 con 0x7f5b480d3600 2023-09-30T13:55:59.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.181+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b28005250 con 0x7f5b480d3600 2023-09-30T13:55:59.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.182+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5b3c013470 con 0x7f5b480d3600 2023-09-30T13:55:59.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.182+0000 7f5b44ff9640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 0x7f5b3406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:55:59.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.182+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5b3c089130 con 0x7f5b480d3600 2023-09-30T13:55:59.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.182+0000 7f5b47fff640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 0x7f5b3406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:55:59.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.183+0000 7f5b47fff640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 0x7f5b3406cff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b40035000 tx=0x7f5b40030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:55:59.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.186+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5b3c0544b0 con 0x7f5b480d3600 2023-09-30T13:55:59.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.376+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5b28005500 con 0x7f5b480d3600 2023-09-30T13:55:59.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.996+0000 7f5b44ff9640 1 -- 172.21.15.62:0/1962053177 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5b3c057ad0 con 0x7f5b480d3600 2023-09-30T13:55:59.996 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blocklist entries 2023-09-30T13:55:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.998+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 msgr2=0x7f5b3406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.998+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 0x7f5b3406cff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b40035000 tx=0x7f5b40030000 comp rx=0 tx=0).stop 2023-09-30T13:55:59.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.998+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 msgr2=0x7f5b48155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.998+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e870 tx=0x7f5b3c00ed30 comp rx=0 tx=0).stop 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 shutdown_connections 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b3406ab30 0x7f5b3406cff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b48160160 0x7f5b48156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b480d3600 0x7f5b48155d00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 --2- 172.21.15.62:0/1962053177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b480b5cd0 0x7f5b4815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 >> 172.21.15.62:0/1962053177 conn(0x7f5b48089fe0 msgr2=0x7f5b480d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 shutdown_connections 2023-09-30T13:55:59.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:55:59.999+0000 7f5b4e95a640 1 -- 172.21.15.62:0/1962053177 wait complete. 2023-09-30T13:56:00.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T13:56:00.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.122+0000 7fedfd1a0640 1 Processor -- start 2023-09-30T13:56:00.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.122+0000 7fedfd1a0640 1 -- start start 2023-09-30T13:56:00.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfd1a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80cd900 0x7fedf80cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfd1a0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fedf80b23a0 0x7fedf80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfd1a0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf80b3140 con 0x7fedf815cff0 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfd1a0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80cf800 con 0x7fedf80b23a0 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfd1a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80ce500 con 0x7fedf80cd900 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfc99f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fedf80b23a0 0x7fedf80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfc99f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fedf80b23a0 0x7fedf80b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43562/0 (socket says 172.21.15.62:43562) 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.123+0000 7fedfc99f640 1 -- 172.21.15.62:0/762062680 learned_addr learned my addr 172.21.15.62:0/762062680 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.124+0000 7fedf77fe640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80cd900 0x7fedf80cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.124+0000 7fedfc99f640 1 -- 172.21.15.62:0/762062680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80cd900 msgr2=0x7fedf80cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.124+0000 7fedfc99f640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80cd900 0x7fedf80cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.124+0000 7fedfc99f640 1 -- 172.21.15.62:0/762062680 >> v1:172.21.15.135:6789/0 conn(0x7fedf815cff0 legacy=0x7fedf80cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.124+0000 7fedfc99f640 1 -- 172.21.15.62:0/762062680 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80ce7e0 con 0x7fedf80b23a0 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfc99f640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf80b23a0 0x7fedf80b2850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009e50 tx=0x7fedf002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165d39862b62ccf9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedf6ffd640 1 -- 172.21.15.62:0/762062680 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf002ca70 con 0x7fedf80b23a0 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedf6ffd640 1 -- 172.21.15.62:0/762062680 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf002cbd0 con 0x7fedf80b23a0 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedf6ffd640 1 -- 172.21.15.62:0/762062680 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00343f0 con 0x7fedf80b23a0 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 -- 172.21.15.62:0/762062680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf80b23a0 msgr2=0x7fedf80b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf80b23a0 0x7fedf80b2850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009e50 tx=0x7fedf002bed0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 -- 172.21.15.62:0/762062680 shutdown_connections 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf80b23a0 0x7fedf80b2850 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/762062680 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80cd900 0x7fedf80cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 -- 172.21.15.62:0/762062680 >> 172.21.15.62:0/762062680 conn(0x7fedf806fd50 msgr2=0x7fedf8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 -- 172.21.15.62:0/762062680 shutdown_connections 2023-09-30T13:56:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.125+0000 7fedfd1a0640 1 -- 172.21.15.62:0/762062680 wait complete. 2023-09-30T13:56:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.126+0000 7fedfd1a0640 1 Processor -- start 2023-09-30T13:56:00.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 -- start start 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80b23a0 0x7fedf81f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 0x7fedf80b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80b6140 con 0x7fedf815cff0 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81f2810 con 0x7fedf80cd900 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.127+0000 7fedfd1a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80c5520 con 0x7fedf80b23a0 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43572/0 (socket says 172.21.15.62:43572) 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 -- 172.21.15.62:0/2787771549 learned_addr learned my addr 172.21.15.62:0/2787771549 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf7fff640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80b23a0 0x7fedf81f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf77fe640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 0x7fedf80b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 -- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80b23a0 msgr2=0x7fedf81f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80b23a0 0x7fedf81f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 -- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 msgr2=0x7fedf80b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 0x7fedf80b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 -- 172.21.15.62:0/2787771549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009b30 con 0x7fedf815cff0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf77fe640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 0x7fedf80b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfc99f640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fedf0036040 tx=0x7fedf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0009510 con 0x7fedf815cff0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf003e450 con 0x7fedf815cff0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf80ca290 con 0x7fedf815cff0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf003e7e0 con 0x7fedf815cff0 2023-09-30T13:56:00.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.128+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf80c5aa0 con 0x7fedf815cff0 2023-09-30T13:56:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.129+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8073e70 con 0x7fedf815cff0 2023-09-30T13:56:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.130+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fedf003e940 con 0x7fedf815cff0 2023-09-30T13:56:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.130+0000 7fedf4ff9640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 0x7fede406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.130+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fedf00abd80 con 0x7fedf815cff0 2023-09-30T13:56:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.130+0000 7fedf7fff640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 0x7fede406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.131+0000 7fedf7fff640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 0x7fede406cff0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fede8001640 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.135+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fedf00771e0 con 0x7fedf815cff0 2023-09-30T13:56:00.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.375+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fedf80cf180 con 0x7fedf815cff0 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.376+0000 7fedf4ff9640 1 -- 172.21.15.62:0/2787771549 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fedf007a800 con 0x7fedf815cff0 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2023-09-30T13:56:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlxpAwJhAA9S96yMqtQkbHvOBPtH7FDQ==", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlwt1mMxAAofjPTwT8sJ6h6ZLq7/TL+Q==", 2023-09-30T13:56:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.c", 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlnvIqLhAA9wCFwL4CWvsyndpi2EmT0g==", 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.d", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhleb65OhAAfneFfCzo7tFsfl5yQGo51A==", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:56:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBzKBhly/ZyJhAARwfNM6QjXO7wBi9+nBIkCQ==", 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB2KBhl96G/JRAAxiscRxTjKnlMCxKQPlgUKQ==", 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB5KBhl8vUpJRAACE+BodmpiCvUUCab7G/9CQ==", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB8KBhlup4BJBAAa/xRihBaMU0E3jbIequ7+w==", 2023-09-30T13:56:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCCKBhldMiBKBAA4DVzsMmj+BvYOXB2Ru6nKg==", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCFKBhl1KPEJhAArDc6YiyFATnvUAmfT6/+pQ==", 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCIKBhlAn3MJRAA0zhhsqrXFNWJOguc/5FKHQ==", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCLKBhlA731IxAAOkK1g+EUEGh4FhLGqxqRbA==", 2023-09-30T13:56:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ==", 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhlQ5EMCxAAzPZ3IeIR0UJAwlX3mZtKXA==", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:56:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl4m9uBxAAGa9B6FqGeq+Wa8UIms5SSQ==", 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.3", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl7G7dEBAAlufHYOxr3XBzPYX1Z7L03w==", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2023-09-30T13:56:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlwZfiBxAAncD4peTWhuN5pf+B3LQP2A==", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mds", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhlNCoLIhAAaYqaGmJ2y9oiKtM0/rMltQ==", 2023-09-30T13:56:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mds" 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mgr", 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhlhzMLIhAAhcNiix+MW/qEoHthihOOMg==", 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-osd", 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhlHzsLIhAA7YFv/etwlYmJfV2aYbPJAw==", 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-osd" 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd", 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhlYkILIhAANjJV9fGS68+YlfK3fVOU5g==", 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-30T13:56:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhl60kLIhAAnR41bntm/As9a6qUdjh/Ag==", 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rgw", 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCRKBhlolELIhAA7RC4Ic9eDgBeQrw9vSvrfg==", 2023-09-30T13:56:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlS3lWIhAAiURVPGSV0bvLZYk/SlHvvg==", 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhltKb8HRAATthRYp02RhUU2XOjqOo0Ug==", 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-09-30T13:56:00.395 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:56:00.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 msgr2=0x7fede406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 0x7fede406cff0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fede8001640 tx=0x7fede8009040 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 msgr2=0x7fedf80b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fedf0036040 tx=0x7fedf0004a40 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 shutdown_connections 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fede406ab30 0x7fede406cff0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf815cff0 0x7fedf80b07a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedf80cd900 0x7fedf80b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 --2- 172.21.15.62:0/2787771549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf80b23a0 0x7fedf81f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 >> 172.21.15.62:0/2787771549 conn(0x7fedf806fd50 msgr2=0x7fedf806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 shutdown_connections 2023-09-30T13:56:00.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.378+0000 7fedfd1a0640 1 -- 172.21.15.62:0/2787771549 wait complete. 2023-09-30T13:56:00.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-30T13:56:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.506+0000 7f36f3db0640 1 Processor -- start 2023-09-30T13:56:00.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.506+0000 7f36f3db0640 1 -- start start 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec0cac00 0x7f36ec065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f36ec06d570 0x7f36ec0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36ec0ce530 0x7f36ec069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec06d150 con 0x7f36ec0ce530 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0cafe0 con 0x7f36ec06d570 2023-09-30T13:56:00.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f3db0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0cb510 con 0x7f36ec0cac00 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36ec0ce530 0x7f36ec069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36ec0ce530 0x7f36ec069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43574/0 (socket says 172.21.15.62:43574) 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 -- 172.21.15.62:0/3233456649 learned_addr learned my addr 172.21.15.62:0/3233456649 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f134b640 1 --2- 172.21.15.62:0/3233456649 >> v2:172.21.15.135:3300/0 conn(0x7f36ec06d570 0x7f36ec0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f1b4c640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec0cac00 0x7f36ec065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 -- 172.21.15.62:0/3233456649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec0cac00 msgr2=0x7f36ec065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec0cac00 0x7f36ec065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 -- 172.21.15.62:0/3233456649 >> v2:172.21.15.135:3300/0 conn(0x7f36ec06d570 msgr2=0x7f36ec0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 --2- 172.21.15.62:0/3233456649 >> v2:172.21.15.135:3300/0 conn(0x7f36ec06d570 0x7f36ec0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.507+0000 7f36f234d640 1 -- 172.21.15.62:0/3233456649 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec06cb20 con 0x7f36ec0ce530 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.508+0000 7f36f234d640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec069d50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f36ec066860 tx=0x7f36e802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdeebe02128891 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.508+0000 7f36f0b4a640 1 -- 172.21.15.62:0/3233456649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e802c950 con 0x7f36ec0ce530 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.508+0000 7f36f0b4a640 1 -- 172.21.15.62:0/3233456649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e802cab0 con 0x7f36ec0ce530 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.508+0000 7f36f0b4a640 1 -- 172.21.15.62:0/3233456649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e802ce40 con 0x7f36ec0ce530 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 -- 172.21.15.62:0/3233456649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 msgr2=0x7f36ec069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec069d50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f36ec066860 tx=0x7f36e802bdb0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 -- 172.21.15.62:0/3233456649 shutdown_connections 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec069d50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3233456649 >> v2:172.21.15.135:3300/0 conn(0x7f36ec06d570 0x7f36ec0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3233456649 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec0cac00 0x7f36ec065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 -- 172.21.15.62:0/3233456649 >> 172.21.15.62:0/3233456649 conn(0x7f36ec0b0850 msgr2=0x7f36ec0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 -- 172.21.15.62:0/3233456649 shutdown_connections 2023-09-30T13:56:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.509+0000 7f36f3db0640 1 -- 172.21.15.62:0/3233456649 wait complete. 2023-09-30T13:56:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.510+0000 7f36f3db0640 1 Processor -- start 2023-09-30T13:56:00.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.510+0000 7f36f3db0640 1 -- start start 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec06d570 0x7f36ec0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ec0cac00 0x7f36ec0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0c79e0 con 0x7f36ec0ce530 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b4b60 con 0x7f36ec0cac00 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f3db0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1f2270 con 0x7f36ec06d570 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43584/0 (socket says 172.21.15.62:43584) 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 -- 172.21.15.62:0/3730689417 learned_addr learned my addr 172.21.15.62:0/3730689417 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:00.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f1b4c640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec06d570 0x7f36ec0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f134b640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ec0cac00 0x7f36ec0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 -- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec06d570 msgr2=0x7f36ec0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec06d570 0x7f36ec0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 -- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ec0cac00 msgr2=0x7f36ec0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ec0cac00 0x7f36ec0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.511+0000 7f36f234d640 1 -- 172.21.15.62:0/3730689417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009b30 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36f234d640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f36e8036040 tx=0x7f36e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8009510 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e803e450 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec0c8610 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e803e800 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.512+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec0c8bd0 con 0x7f36ec0ce530 2023-09-30T13:56:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.513+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec06cd50 con 0x7f36ec0ce530 2023-09-30T13:56:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.513+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f36e803e960 con 0x7f36ec0ce530 2023-09-30T13:56:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.514+0000 7f36e27fc640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 0x7f36d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.514+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f36e80abc60 con 0x7f36ec0ce530 2023-09-30T13:56:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.514+0000 7f36f1b4c640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 0x7f36d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.514+0000 7f36f1b4c640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 0x7f36d006cff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36e40079a0 tx=0x7f36e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.518+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f36ec06cd50 con 0x7f36ec0ce530 2023-09-30T13:56:00.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.766+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f36ec06cd50 con 0x7f36ec0ce530 2023-09-30T13:56:00.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.768+0000 7f36e27fc640 1 -- 172.21.15.62:0/3730689417 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f36ec06cd50 con 0x7f36ec0ce530 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 msgr2=0x7f36d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 0x7f36d006cff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36e40079a0 tx=0x7f36e4008040 comp rx=0 tx=0).stop 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 msgr2=0x7f36ec0c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f36e8036040 tx=0x7f36e8004a40 comp rx=0 tx=0).stop 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 shutdown_connections 2023-09-30T13:56:00.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f36d006ab30 0x7f36d006cff0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ec0ce530 0x7f36ec0c9e50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ec0cac00 0x7f36ec0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 --2- 172.21.15.62:0/3730689417 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ec06d570 0x7f36ec0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 >> 172.21.15.62:0/3730689417 conn(0x7f36ec0b0850 msgr2=0x7f36ec072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 shutdown_connections 2023-09-30T13:56:00.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.770+0000 7f36f3db0640 1 -- 172.21.15.62:0/3730689417 wait complete. 2023-09-30T13:56:00.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-30T13:56:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.887+0000 7f14a6d53640 1 Processor -- start 2023-09-30T13:56:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.887+0000 7f14a6d53640 1 -- start start 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a6d53640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14a0156cb0 0x7f14a00ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a6d53640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14a00c8b30 0x7f14a00c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a6d53640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a0159890 con 0x7f14a01568d0 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a6d53640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00c9500 con 0x7f14a00c8b30 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a6d53640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a0159b70 con 0x7f14a0156cb0 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a52f0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14a00c8b30 0x7f14a00c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a4aef640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f14a01568d0 0x7f14a00c9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36130/0 (socket says 172.21.15.62:36130) 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a4aef640 1 -- 172.21.15.62:0/98137353 learned_addr learned my addr 172.21.15.62:0/98137353 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f149ffff640 1 --2- 172.21.15.62:0/98137353 >> v2:172.21.15.135:3300/0 conn(0x7f14a0156cb0 0x7f14a00ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a52f0640 1 -- 172.21.15.62:0/98137353 >> v2:172.21.15.135:3300/0 conn(0x7f14a0156cb0 msgr2=0x7f14a00ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a52f0640 1 --2- 172.21.15.62:0/98137353 >> v2:172.21.15.135:3300/0 conn(0x7f14a0156cb0 0x7f14a00ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a52f0640 1 -- 172.21.15.62:0/98137353 >> v1:172.21.15.62:6789/0 conn(0x7f14a01568d0 legacy=0x7f14a00c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.888+0000 7f14a52f0640 1 -- 172.21.15.62:0/98137353 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0159e50 con 0x7f14a00c8b30 2023-09-30T13:56:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.889+0000 7f14a52f0640 1 --2- 172.21.15.62:0/98137353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a00c8fc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f14a00cd330 tx=0x7f149802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cb3027be61ce79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.889+0000 7f149f7fe640 1 -- 172.21.15.62:0/98137353 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149802cc80 con 0x7f14a00c8b30 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.889+0000 7f149f7fe640 1 -- 172.21.15.62:0/98137353 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149802cde0 con 0x7f14a00c8b30 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.889+0000 7f149f7fe640 1 -- 172.21.15.62:0/98137353 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498034660 con 0x7f14a00c8b30 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 -- 172.21.15.62:0/98137353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 msgr2=0x7f14a00c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 --2- 172.21.15.62:0/98137353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a00c8fc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f14a00cd330 tx=0x7f149802bed0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 -- 172.21.15.62:0/98137353 shutdown_connections 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 --2- 172.21.15.62:0/98137353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a00c8fc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 --2- 172.21.15.62:0/98137353 >> v2:172.21.15.135:3300/0 conn(0x7f14a0156cb0 0x7f14a00ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 -- 172.21.15.62:0/98137353 >> 172.21.15.62:0/98137353 conn(0x7f14a006a430 msgr2=0x7f14a006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 -- 172.21.15.62:0/98137353 shutdown_connections 2023-09-30T13:56:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.890+0000 7f14a6d53640 1 -- 172.21.15.62:0/98137353 wait complete. 2023-09-30T13:56:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.891+0000 7f14a6d53640 1 Processor -- start 2023-09-30T13:56:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.891+0000 7f14a6d53640 1 -- start start 2023-09-30T13:56:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a01568d0 0x7f14a01557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14a0156cb0 0x7f14a015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a01541f0 con 0x7f14a00c8b30 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a015c500 con 0x7f14a01568d0 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0154440 con 0x7f14a0156cb0 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43592/0 (socket says 172.21.15.62:43592) 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 -- 172.21.15.62:0/1549886345 learned_addr learned my addr 172.21.15.62:0/1549886345 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f149ffff640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a01568d0 0x7f14a01557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a52f0640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14a0156cb0 0x7f14a015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 -- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14a0156cb0 msgr2=0x7f14a015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14a0156cb0 0x7f14a015b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 -- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a01568d0 msgr2=0x7f14a01557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a01568d0 0x7f14a01557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 -- 172.21.15.62:0/1549886345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498009a70 con 0x7f14a00c8b30 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a4aef640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f149400c4a0 tx=0x7f149400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494005ce0 con 0x7f14a00c8b30 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1494005e40 con 0x7f14a00c8b30 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a0154720 con 0x7f14a00c8b30 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.892+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494007270 con 0x7f14a00c8b30 2023-09-30T13:56:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.893+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a0154f20 con 0x7f14a00c8b30 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.894+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a0073e70 con 0x7f14a00c8b30 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.894+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f14940073d0 con 0x7f14a00c8b30 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.895+0000 7f149d7fa640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 0x7f148406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.895+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1494088420 con 0x7f14a00c8b30 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.895+0000 7f149ffff640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 0x7f148406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.895+0000 7f149ffff640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 0x7f148406d020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f148c006fd0 tx=0x7f148c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:00.899+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1494053930 con 0x7f14a00c8b30 2023-09-30T13:56:01.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.146+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f14a00b0dc0 con 0x7f14a00c8b30 2023-09-30T13:56:01.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.148+0000 7f149d7fa640 1 -- 172.21.15.62:0/1549886345 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1494056f50 con 0x7f14a00c8b30 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 msgr2=0x7f148406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 0x7f148406d020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f148c006fd0 tx=0x7f148c008040 comp rx=0 tx=0).stop 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 msgr2=0x7f14a01552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f149400c4a0 tx=0x7f149400c960 comp rx=0 tx=0).stop 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 shutdown_connections 2023-09-30T13:56:01.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f148406ab60 0x7f148406d020 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14a0156cb0 0x7f14a015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a01568d0 0x7f14a01557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 --2- 172.21.15.62:0/1549886345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14a00c8b30 0x7f14a01552a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 >> 172.21.15.62:0/1549886345 conn(0x7f14a006a430 msgr2=0x7f14a0158660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 shutdown_connections 2023-09-30T13:56:01.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.150+0000 7f14a6d53640 1 -- 172.21.15.62:0/1549886345 wait complete. 2023-09-30T13:56:01.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-30T13:56:01.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.267+0000 7f9815683640 1 Processor -- start 2023-09-30T13:56:01.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.267+0000 7f9815683640 1 -- start start 2023-09-30T13:56:01.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f9815683640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98100b5790 0x7f98100cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f9815683640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100cda60 con 0x7f9810160160 2023-09-30T13:56:01.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f9815683640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100d18a0 con 0x7f98100b5bf0 2023-09-30T13:56:01.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f9815683640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9810160540 con 0x7f98100b5790 2023-09-30T13:56:01.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f980e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98100b5790 0x7f98100cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f980effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9810160160 0x7f98100d30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36132/0 (socket says 172.21.15.62:36132) 2023-09-30T13:56:01.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.268+0000 7f980effd640 1 -- 172.21.15.62:0/3080713787 learned_addr learned my addr 172.21.15.62:0/3080713787 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:01.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.269+0000 7f980e7fc640 1 -- 172.21.15.62:0/3080713787 >> v1:172.21.15.135:6789/0 conn(0x7f98100b5bf0 legacy=0x7f98100cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:01.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.269+0000 7f980e7fc640 1 -- 172.21.15.62:0/3080713787 >> v1:172.21.15.62:6789/0 conn(0x7f9810160160 legacy=0x7f98100d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.269+0000 7f980e7fc640 1 -- 172.21.15.62:0/3080713787 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100cd450 con 0x7f98100b5790 2023-09-30T13:56:01.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.269+0000 7f980e7fc640 1 --2- 172.21.15.62:0/3080713787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100cdef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f97f80097a0 tx=0x7f97f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d817bdfa9d5d8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f980dffb640 1 -- 172.21.15.62:0/3080713787 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8031830 con 0x7f98100b5790 2023-09-30T13:56:01.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f980dffb640 1 -- 172.21.15.62:0/3080713787 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8031990 con 0x7f98100b5790 2023-09-30T13:56:01.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f980dffb640 1 -- 172.21.15.62:0/3080713787 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8031d20 con 0x7f98100b5790 2023-09-30T13:56:01.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 -- 172.21.15.62:0/3080713787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 msgr2=0x7f98100cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 --2- 172.21.15.62:0/3080713787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100cdef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f97f80097a0 tx=0x7f97f802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 -- 172.21.15.62:0/3080713787 shutdown_connections 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 --2- 172.21.15.62:0/3080713787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100cdef0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 -- 172.21.15.62:0/3080713787 >> 172.21.15.62:0/3080713787 conn(0x7f9810089fe0 msgr2=0x7f98100d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 -- 172.21.15.62:0/3080713787 shutdown_connections 2023-09-30T13:56:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.270+0000 7f9815683640 1 -- 172.21.15.62:0/3080713787 wait complete. 2023-09-30T13:56:01.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 Processor -- start 2023-09-30T13:56:01.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 -- start start 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 0x7f9810156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 0x7f9810157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101542e0 con 0x7f98100b5790 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810155410 con 0x7f98100b5bf0 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f9815683640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101556f0 con 0x7f9810160160 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f980effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f980effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43614/0 (socket says 172.21.15.62:43614) 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.272+0000 7f980effd640 1 -- 172.21.15.62:0/2374269363 learned_addr learned my addr 172.21.15.62:0/2374269363 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:01.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 -- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 msgr2=0x7f9810157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980f7fe640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 0x7f9810157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980e7fc640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 0x7f9810156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 0x7f9810157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 -- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 msgr2=0x7f9810156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 0x7f9810156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 -- 172.21.15.62:0/2374269363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009400 con 0x7f98100b5790 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980f7fe640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 0x7f9810157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980e7fc640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 0x7f9810156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f980effd640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f980800c400 tx=0x7f980800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808005ce0 con 0x7f98100b5790 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808005e40 con 0x7f98100b5790 2023-09-30T13:56:01.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98101559d0 con 0x7f98100b5790 2023-09-30T13:56:01.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080072d0 con 0x7f98100b5790 2023-09-30T13:56:01.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.273+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9810155f90 con 0x7f98100b5790 2023-09-30T13:56:01.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.274+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9810073e70 con 0x7f98100b5790 2023-09-30T13:56:01.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.274+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f98080074f0 con 0x7f98100b5790 2023-09-30T13:56:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.275+0000 7f98077fe640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 0x7f97f006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.275+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9808088670 con 0x7f98100b5790 2023-09-30T13:56:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.275+0000 7f980e7fc640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 0x7f97f006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.276+0000 7f980e7fc640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 0x7f97f006cff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f97f8036000 tx=0x7f97f803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.279+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9808053ad0 con 0x7f98100b5790 2023-09-30T13:56:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.525+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f98100cfef0 con 0x7f98100b5790 2023-09-30T13:56:01.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.527+0000 7f98077fe640 1 -- 172.21.15.62:0/2374269363 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f98080170a0 con 0x7f98100b5790 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 msgr2=0x7f97f006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 0x7f97f006cff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f97f8036000 tx=0x7f97f803c040 comp rx=0 tx=0).stop 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 msgr2=0x7f98100c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f980800c400 tx=0x7f980800c8c0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 shutdown_connections 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f97f006ab30 0x7f97f006cff0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9810160160 0x7f9810157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98100b5bf0 0x7f9810156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 --2- 172.21.15.62:0/2374269363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100b5790 0x7f98100c8870 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 >> 172.21.15.62:0/2374269363 conn(0x7f9810089fe0 msgr2=0x7f98100d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:01.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 shutdown_connections 2023-09-30T13:56:01.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.529+0000 7f9815683640 1 -- 172.21.15.62:0/2374269363 wait complete. 2023-09-30T13:56:01.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-30T13:56:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.647+0000 7f6804c0e640 1 Processor -- start 2023-09-30T13:56:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.647+0000 7f6804c0e640 1 -- start start 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f6804c0e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f68000cac00 0x7f6800065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f6804c0e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f680006d570 0x7f68000cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f6804c0e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000cafe0 con 0x7f68000ce530 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f6804c0e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680006d150 con 0x7f680006d570 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f6804c0e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000cb510 con 0x7f68000cac00 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f680006d570 0x7f68000cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f680006d570 0x7f68000cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43620/0 (socket says 172.21.15.62:43620) 2023-09-30T13:56:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 -- 172.21.15.62:0/3429140155 learned_addr learned my addr 172.21.15.62:0/3429140155 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67fe59c640 1 --2- 172.21.15.62:0/3429140155 >> v2:172.21.15.135:3300/0 conn(0x7f68000cac00 0x7f6800065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 -- 172.21.15.62:0/3429140155 >> v2:172.21.15.135:3300/0 conn(0x7f68000cac00 msgr2=0x7f6800065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 --2- 172.21.15.62:0/3429140155 >> v2:172.21.15.135:3300/0 conn(0x7f68000cac00 0x7f6800065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 -- 172.21.15.62:0/3429140155 >> v1:172.21.15.135:6789/0 conn(0x7f68000ce530 legacy=0x7f6800069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.648+0000 7f67f7fff640 1 -- 172.21.15.62:0/3429140155 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680006cb20 con 0x7f680006d570 2023-09-30T13:56:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.649+0000 7f67f7fff640 1 --2- 172.21.15.62:0/3429140155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000cdff0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6800066cd0 tx=0x7f67e802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8f2e82bc31df62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.649+0000 7f67fdd9b640 1 -- 172.21.15.62:0/3429140155 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80317e0 con 0x7f680006d570 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.649+0000 7f67fdd9b640 1 -- 172.21.15.62:0/3429140155 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8031940 con 0x7f680006d570 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.649+0000 7f67fdd9b640 1 -- 172.21.15.62:0/3429140155 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8031cd0 con 0x7f680006d570 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 -- 172.21.15.62:0/3429140155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 msgr2=0x7f68000cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3429140155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000cdff0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6800066cd0 tx=0x7f67e802b880 comp rx=0 tx=0).stop 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 -- 172.21.15.62:0/3429140155 shutdown_connections 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3429140155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000cdff0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3429140155 >> v2:172.21.15.135:3300/0 conn(0x7f68000cac00 0x7f6800065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 -- 172.21.15.62:0/3429140155 >> 172.21.15.62:0/3429140155 conn(0x7f68000b0850 msgr2=0x7f68000b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 -- 172.21.15.62:0/3429140155 shutdown_connections 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.650+0000 7f6804c0e640 1 -- 172.21.15.62:0/3429140155 wait complete. 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.651+0000 7f6804c0e640 1 Processor -- start 2023-09-30T13:56:01.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.651+0000 7f6804c0e640 1 -- start start 2023-09-30T13:56:01.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68000cac00 0x7f68000c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68000ce530 0x7f68000b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c6180 con 0x7f680006d570 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680015ff40 con 0x7f68000cac00 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f6804c0e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c7910 con 0x7f68000ce530 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43624/0 (socket says 172.21.15.62:43624) 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 -- 172.21.15.62:0/3395206069 learned_addr learned my addr 172.21.15.62:0/3395206069 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67f7fff640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68000cac00 0x7f68000c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fed9d640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68000ce530 0x7f68000b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 -- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68000ce530 msgr2=0x7f68000b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68000ce530 0x7f68000b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 -- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68000cac00 msgr2=0x7f68000c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68000cac00 0x7f68000c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 -- 172.21.15.62:0/3395206069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80094d0 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67fe59c640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f67f000d5f0 tx=0x7f67f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.652+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00125f0 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.653+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0012750 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.653+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68000c8350 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.653+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0012b00 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.653+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68000c8910 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.653+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6800073e70 con 0x7f680006d570 2023-09-30T13:56:01.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.654+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f67f0012c60 con 0x7f680006d570 2023-09-30T13:56:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.654+0000 7f67f6ffd640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 0x7f67e006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.654+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f67f0089510 con 0x7f680006d570 2023-09-30T13:56:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.655+0000 7f67f7fff640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 0x7f67e006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:01.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.655+0000 7f67f7fff640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 0x7f67e006cff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67e8036000 tx=0x7f67e803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:01.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.659+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f67f0054970 con 0x7f680006d570 2023-09-30T13:56:01.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.899+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f68000b1400 con 0x7f680006d570 2023-09-30T13:56:01.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.902+0000 7f67f6ffd640 1 -- 172.21.15.62:0/3395206069 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f67f0057f90 con 0x7f680006d570 2023-09-30T13:56:01.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 msgr2=0x7f67e006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 0x7f67e006cff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67e8036000 tx=0x7f67e803d040 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 msgr2=0x7f68000c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f67f000d5f0 tx=0x7f67f000dab0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 shutdown_connections 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67e006ab30 0x7f67e006cff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68000ce530 0x7f68000b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68000cac00 0x7f68000c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 --2- 172.21.15.62:0/3395206069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f680006d570 0x7f68000c6d20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 >> 172.21.15.62:0/3395206069 conn(0x7f68000b0850 msgr2=0x7f6800072720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 shutdown_connections 2023-09-30T13:56:01.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:01.904+0000 7f6804c0e640 1 -- 172.21.15.62:0/3395206069 wait complete. 2023-09-30T13:56:01.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-30T13:56:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.022+0000 7fda6fc68640 1 Processor -- start 2023-09-30T13:56:02.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.022+0000 7fda6fc68640 1 -- start start 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6fc68640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda680cfb00 0x7fda680cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6fc68640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fda680b2640 0x7fda680b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6fc68640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda681608f0 con 0x7fda6815cb80 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6fc68640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda68161570 con 0x7fda680cfb00 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6fc68640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680d04d0 con 0x7fda680b2640 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda680cfb00 0x7fda680cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fda680cfb00 0x7fda680cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43630/0 (socket says 172.21.15.62:43630) 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 -- 172.21.15.62:0/2943917049 learned_addr learned my addr 172.21.15.62:0/2943917049 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:02.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6e205640 1 --2- 172.21.15.62:0/2943917049 >> v2:172.21.15.135:3300/0 conn(0x7fda680b2640 0x7fda680b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 -- 172.21.15.62:0/2943917049 >> v2:172.21.15.135:3300/0 conn(0x7fda680b2640 msgr2=0x7fda680b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 --2- 172.21.15.62:0/2943917049 >> v2:172.21.15.135:3300/0 conn(0x7fda680b2640 0x7fda680b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 -- 172.21.15.62:0/2943917049 >> v1:172.21.15.135:6789/0 conn(0x7fda6815cb80 legacy=0x7fda680b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.023+0000 7fda6d203640 1 -- 172.21.15.62:0/2943917049 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68160bd0 con 0x7fda680cfb00 2023-09-30T13:56:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.024+0000 7fda6d203640 1 --2- 172.21.15.62:0/2943917049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda680cfb00 0x7fda680cff90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fda6806ada0 tx=0x7fda6402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16de62c5e8d43858 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.024+0000 7fda6ca02640 1 -- 172.21.15.62:0/2943917049 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64030860 con 0x7fda680cfb00 2023-09-30T13:56:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.024+0000 7fda6ca02640 1 -- 172.21.15.62:0/2943917049 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda640309c0 con 0x7fda680cfb00 2023-09-30T13:56:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.024+0000 7fda6ca02640 1 -- 172.21.15.62:0/2943917049 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64030d50 con 0x7fda680cfb00 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 -- 172.21.15.62:0/2943917049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda680cfb00 msgr2=0x7fda680cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 --2- 172.21.15.62:0/2943917049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda680cfb00 0x7fda680cff90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fda6806ada0 tx=0x7fda6402b9a0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 -- 172.21.15.62:0/2943917049 shutdown_connections 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 --2- 172.21.15.62:0/2943917049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda680cfb00 0x7fda680cff90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 --2- 172.21.15.62:0/2943917049 >> v2:172.21.15.135:3300/0 conn(0x7fda680b2640 0x7fda680b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 -- 172.21.15.62:0/2943917049 >> 172.21.15.62:0/2943917049 conn(0x7fda6806b250 msgr2=0x7fda6806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 -- 172.21.15.62:0/2943917049 shutdown_connections 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.025+0000 7fda6fc68640 1 -- 172.21.15.62:0/2943917049 wait complete. 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.026+0000 7fda6fc68640 1 Processor -- start 2023-09-30T13:56:02.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.026+0000 7fda6fc68640 1 -- start start 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda680b2640 0x7fda6815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680cfb00 0x7fda681f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680ad280 con 0x7fda6815cb80 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680ad560 con 0x7fda680b2640 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6fc68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda681f3400 con 0x7fda680cfb00 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43640/0 (socket says 172.21.15.62:43640) 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 -- 172.21.15.62:0/1603358347 learned_addr learned my addr 172.21.15.62:0/1603358347 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6d203640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680cfb00 0x7fda681f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 -- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680cfb00 msgr2=0x7fda681f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6da04640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda680b2640 0x7fda6815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680cfb00 0x7fda681f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 -- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda680b2640 msgr2=0x7fda6815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda680b2640 0x7fda6815fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 -- 172.21.15.62:0/1603358347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640094d0 con 0x7fda6815cb80 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda6e205640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.027+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60014480 con 0x7fda6815cb80 2023-09-30T13:56:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.028+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6000f040 con 0x7fda6815cb80 2023-09-30T13:56:02.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.028+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60014820 con 0x7fda6815cb80 2023-09-30T13:56:02.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.028+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda681f36e0 con 0x7fda6815cb80 2023-09-30T13:56:02.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.028+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda680ac510 con 0x7fda6815cb80 2023-09-30T13:56:02.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.029+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68073e70 con 0x7fda6815cb80 2023-09-30T13:56:02.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.029+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fda60014980 con 0x7fda6815cb80 2023-09-30T13:56:02.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.029+0000 7fda5e7fc640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 0x7fda4c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.030+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fda60089c70 con 0x7fda6815cb80 2023-09-30T13:56:02.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.030+0000 7fda6da04640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 0x7fda4c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.030+0000 7fda6da04640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 0x7fda4c06cff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f60 tx=0x7fda58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.034+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fda600550d0 con 0x7fda6815cb80 2023-09-30T13:56:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.278+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fda680ad720 con 0x7fda6815cb80 2023-09-30T13:56:02.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.280+0000 7fda5e7fc640 1 -- 172.21.15.62:0/1603358347 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda600180a0 con 0x7fda6815cb80 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 msgr2=0x7fda4c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 0x7fda4c06cff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda58000f60 tx=0x7fda58009040 comp rx=0 tx=0).stop 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 msgr2=0x7fda681f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c490 comp rx=0 tx=0).stop 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 shutdown_connections 2023-09-30T13:56:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fda4c06ab30 0x7fda4c06cff0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda6815cb80 0x7fda681f2550 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda680cfb00 0x7fda681f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 --2- 172.21.15.62:0/1603358347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda680b2640 0x7fda6815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 >> 172.21.15.62:0/1603358347 conn(0x7fda6806b250 msgr2=0x7fda68071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 shutdown_connections 2023-09-30T13:56:02.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.282+0000 7fda6fc68640 1 -- 172.21.15.62:0/1603358347 wait complete. 2023-09-30T13:56:02.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-30T13:56:02.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.399+0000 7ff7c4690640 1 Processor -- start 2023-09-30T13:56:02.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.400+0000 7ff7c4690640 1 -- start start 2023-09-30T13:56:02.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.400+0000 7ff7c4690640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.400+0000 7ff7c4690640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c4690640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0cafe0 con 0x7ff7bc06d570 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c4690640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc06d150 con 0x7ff7bc0cac00 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c4690640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0cb510 con 0x7ff7bc0ce700 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c242c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c242c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:36368/0 (socket says 172.21.15.62:36368) 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:47618/0 (socket says 172.21.15.62:47618) 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c242c640 1 -- 172.21.15.62:0/1012638463 learned_addr learned my addr 172.21.15.62:0/1012638463 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:02.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c1c2b640 1 --1- 172.21.15.62:0/1012638463 >> v1:172.21.15.135:6789/0 conn(0x7ff7bc06d570 0x7ff7bc0cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35314/0 (socket says 172.21.15.62:35314) 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 -- 172.21.15.62:0/1012638463 >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 msgr2=0x7ff7bc065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 --2- 172.21.15.62:0/1012638463 >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 -- 172.21.15.62:0/1012638463 >> v1:172.21.15.135:6789/0 conn(0x7ff7bc06d570 legacy=0x7ff7bc0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c2c2d640 1 -- 172.21.15.62:0/1012638463 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc06cb20 con 0x7ff7bc0ce700 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.401+0000 7ff7c242c640 1 --2- 172.21.15.62:0/1012638463 >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.402+0000 7ff7c2c2d640 1 --2- 172.21.15.62:0/1012638463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009d90 tx=0x7ff7ac02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2484713c54cd44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.402+0000 7ff7c142a640 1 -- 172.21.15.62:0/1012638463 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac02cb30 con 0x7ff7bc0ce700 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.402+0000 7ff7c142a640 1 -- 172.21.15.62:0/1012638463 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac02cc90 con 0x7ff7bc0ce700 2023-09-30T13:56:02.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.402+0000 7ff7c142a640 1 -- 172.21.15.62:0/1012638463 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac034440 con 0x7ff7bc0ce700 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 -- 172.21.15.62:0/1012638463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 msgr2=0x7ff7bc069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 --2- 172.21.15.62:0/1012638463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009d90 tx=0x7ff7ac02bd80 comp rx=0 tx=0).stop 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 -- 172.21.15.62:0/1012638463 shutdown_connections 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 --2- 172.21.15.62:0/1012638463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc069d50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 --2- 172.21.15.62:0/1012638463 >> v2:172.21.15.135:3300/0 conn(0x7ff7bc0cac00 0x7ff7bc065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 -- 172.21.15.62:0/1012638463 >> 172.21.15.62:0/1012638463 conn(0x7ff7bc0b0850 msgr2=0x7ff7bc0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 -- 172.21.15.62:0/1012638463 shutdown_connections 2023-09-30T13:56:02.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.403+0000 7ff7c4690640 1 -- 172.21.15.62:0/1012638463 wait complete. 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.404+0000 7ff7c4690640 1 Processor -- start 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.404+0000 7ff7c4690640 1 -- start start 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 0x7ff7bc1e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc15c0c0 con 0x7ff7bc06d570 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1e8200 con 0x7ff7bc0cac00 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c4690640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1e84e0 con 0x7ff7bc0ce700 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43650/0 (socket says 172.21.15.62:43650) 2023-09-30T13:56:02.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 -- 172.21.15.62:0/782286768 learned_addr learned my addr 172.21.15.62:0/782286768 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c1c2b640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 0x7ff7bc1e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c2c2d640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 -- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 msgr2=0x7ff7bc1f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc1f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 -- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 msgr2=0x7ff7bc1e79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.405+0000 7ff7c242c640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 0x7ff7bc1e79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7c242c640 1 -- 172.21.15.62:0/782286768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40094d0 con 0x7ff7bc06d570 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7c1c2b640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 0x7ff7bc1e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7c242c640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e9b0 tx=0x7ff7b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400c9a0 con 0x7ff7bc06d570 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400cb00 con 0x7ff7bc06d570 2023-09-30T13:56:02.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac009a70 con 0x7ff7bc06d570 2023-09-30T13:56:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400ce70 con 0x7ff7bc06d570 2023-09-30T13:56:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.406+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1e7f10 con 0x7ff7bc06d570 2023-09-30T13:56:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.407+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc1e8a00 con 0x7ff7bc06d570 2023-09-30T13:56:02.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.407+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff7b4013470 con 0x7ff7bc06d570 2023-09-30T13:56:02.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.408+0000 7ff7baffd640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 0x7ff7a806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.408+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff7b40895a0 con 0x7ff7bc06d570 2023-09-30T13:56:02.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.408+0000 7ff7c1c2b640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 0x7ff7a806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.409+0000 7ff7c1c2b640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 0x7ff7a806cff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15ff30 tx=0x7ff7b0007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.412+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff7b4054a30 con 0x7ff7bc06d570 2023-09-30T13:56:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.655+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff7bc15be70 con 0x7ff7bc06d570 2023-09-30T13:56:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.656+0000 7ff7baffd640 1 -- 172.21.15.62:0/782286768 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff7b4058050 con 0x7ff7bc06d570 2023-09-30T13:56:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 msgr2=0x7ff7a806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 0x7ff7a806cff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15ff30 tx=0x7ff7b0007e20 comp rx=0 tx=0).stop 2023-09-30T13:56:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 msgr2=0x7ff7bc1e5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e9b0 tx=0x7ff7b400ee70 comp rx=0 tx=0).stop 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 shutdown_connections 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff7a806ab30 0x7ff7a806cff0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7bc0ce700 0x7ff7bc1f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7bc0cac00 0x7ff7bc1e79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 --2- 172.21.15.62:0/782286768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc06d570 0x7ff7bc1e5680 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 >> 172.21.15.62:0/782286768 conn(0x7ff7bc0b0850 msgr2=0x7ff7bc09ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 shutdown_connections 2023-09-30T13:56:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.658+0000 7ff7c4690640 1 -- 172.21.15.62:0/782286768 wait complete. 2023-09-30T13:56:02.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:56:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 Processor -- start 2023-09-30T13:56:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 -- start start 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85100d06b0 0x7f851006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100d0b20 con 0x7f85100d1410 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100cf450 con 0x7f851015cbe0 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.775+0000 7f8515b2c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100cfcf0 con 0x7f85100d06b0 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f85100d1410 0x7f851006b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36142/0 (socket says 172.21.15.62:36142) 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850effd640 1 -- 172.21.15.62:0/136403894 learned_addr learned my addr 172.21.15.62:0/136403894 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850ffff640 1 --2- 172.21.15.62:0/136403894 >> v2:172.21.15.62:3300/0 conn(0x7f85100d06b0 0x7f851006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850e7fc640 1 -- 172.21.15.62:0/136403894 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609456427 0 0) 0x7f85100d0b20 con 0x7f85100d1410 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850e7fc640 1 -- 172.21.15.62:0/136403894 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f8003520 con 0x7f85100d1410 2023-09-30T13:56:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850ffff640 1 -- 172.21.15.62:0/136403894 >> v1:172.21.15.135:6789/0 conn(0x7f851015cbe0 legacy=0x7f85100d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850ffff640 1 -- 172.21.15.62:0/136403894 >> v1:172.21.15.62:6789/0 conn(0x7f85100d1410 legacy=0x7f851006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.776+0000 7f850ffff640 1 -- 172.21.15.62:0/136403894 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100cf730 con 0x7f85100d06b0 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f850ffff640 1 --2- 172.21.15.62:0/136403894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d06b0 0x7f851006bd60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f850802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6dd3c7011f607e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f850e7fc640 1 -- 172.21.15.62:0/136403894 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850802cd80 con 0x7f85100d06b0 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f850e7fc640 1 -- 172.21.15.62:0/136403894 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8508034440 con 0x7f85100d06b0 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f850e7fc640 1 -- 172.21.15.62:0/136403894 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080347d0 con 0x7f85100d06b0 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 -- 172.21.15.62:0/136403894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d06b0 msgr2=0x7f851006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 --2- 172.21.15.62:0/136403894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d06b0 0x7f851006bd60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8508009d90 tx=0x7f850802bfd0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 -- 172.21.15.62:0/136403894 shutdown_connections 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 --2- 172.21.15.62:0/136403894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d06b0 0x7f851006bd60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 -- 172.21.15.62:0/136403894 >> 172.21.15.62:0/136403894 conn(0x7f8510089fe0 msgr2=0x7f85100d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 -- 172.21.15.62:0/136403894 shutdown_connections 2023-09-30T13:56:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.777+0000 7f8515b2c640 1 -- 172.21.15.62:0/136403894 wait complete. 2023-09-30T13:56:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 Processor -- start 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 -- start start 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 0x7f85100b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f851015cbe0 0x7f85100cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100b3fe0 con 0x7f85100d1410 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100b41f0 con 0x7f85100d06b0 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.779+0000 7f8515b2c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85100b44d0 con 0x7f851015cbe0 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43674/0 (socket says 172.21.15.62:43674) 2023-09-30T13:56:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 -- 172.21.15.62:0/1066226823 learned_addr learned my addr 172.21.15.62:0/1066226823 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850f7fe640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 0x7f85100b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850ffff640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f851015cbe0 0x7f85100cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 -- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f851015cbe0 msgr2=0x7f85100cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f851015cbe0 0x7f85100cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 -- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 msgr2=0x7f85100b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 0x7f85100b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 -- 172.21.15.62:0/1066226823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508009a70 con 0x7f85100d1410 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850f7fe640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 0x7f85100b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f850effd640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f850400c500 tx=0x7f850400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504005ce0 con 0x7f85100d1410 2023-09-30T13:56:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8504005e40 con 0x7f85100d1410 2023-09-30T13:56:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85100b47b0 con 0x7f85100d1410 2023-09-30T13:56:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504007330 con 0x7f85100d1410 2023-09-30T13:56:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.780+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85100b6400 con 0x7f85100d1410 2023-09-30T13:56:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.781+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851004e0d0 con 0x7f85100d1410 2023-09-30T13:56:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.782+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8504007550 con 0x7f85100d1410 2023-09-30T13:56:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.782+0000 7f84f7fff640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 0x7f84fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.782+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8504088650 con 0x7f85100d1410 2023-09-30T13:56:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.782+0000 7f850f7fe640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 0x7f84fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.783+0000 7f850f7fe640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 0x7f84fc06cff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8500000fb0 tx=0x7f8500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.786+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8504053c00 con 0x7f85100d1410 2023-09-30T13:56:02.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.963+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85100cce00 con 0x7f85100d1410 2023-09-30T13:56:02.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.964+0000 7f84f7fff640 1 -- 172.21.15.62:0/1066226823 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13038 (secure 0 0 0) 0x7f8504017090 con 0x7f85100d1410 2023-09-30T13:56:02.963 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:02.963 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:00.005713+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:56:02.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.965+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 msgr2=0x7f84fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.965+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 0x7f84fc06cff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8500000fb0 tx=0x7f8500009040 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.965+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 msgr2=0x7f85101f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.965+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f850400c500 tx=0x7f850400c9c0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 shutdown_connections 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f84fc06ab30 0x7f84fc06cff0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f851015cbe0 0x7f85100cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85100d1410 0x7f85101f1e30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 --2- 172.21.15.62:0/1066226823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85100d06b0 0x7f85100b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 >> 172.21.15.62:0/1066226823 conn(0x7f8510089fe0 msgr2=0x7f85100af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 shutdown_connections 2023-09-30T13:56:02.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:02.966+0000 7f8515b2c640 1 -- 172.21.15.62:0/1066226823 wait complete. 2023-09-30T13:56:02.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:56:02.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:56:03.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.086+0000 7fd5efb33640 1 Processor -- start 2023-09-30T13:56:03.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 -- start start 2023-09-30T13:56:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5e815d2e0 0x7fd5e815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e806c9d0 0x7fd5e806ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e806c540 con 0x7fd5e8153d20 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e815dc90 con 0x7fd5e815d2e0 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.087+0000 7fd5efb33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80b29c0 con 0x7fd5e806c9d0 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed8cf640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd5e8153d20 0x7fd5e80ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36156/0 (socket says 172.21.15.62:36156) 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed8cf640 1 -- 172.21.15.62:0/1710252790 learned_addr learned my addr 172.21.15.62:0/1710252790 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed0ce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd5e815d2e0 0x7fd5e815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ee0d0640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e806c9d0 0x7fd5e806ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed0ce640 1 -- 172.21.15.62:0/1710252790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e806c9d0 msgr2=0x7fd5e806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed0ce640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e806c9d0 0x7fd5e806ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed0ce640 1 -- 172.21.15.62:0/1710252790 >> v1:172.21.15.62:6789/0 conn(0x7fd5e8153d20 legacy=0x7fd5e80ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ec8cd640 1 -- 172.21.15.62:0/1710252790 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825866921 0 0) 0x7fd5e806c540 con 0x7fd5e8153d20 2023-09-30T13:56:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.088+0000 7fd5ed0ce640 1 -- 172.21.15.62:0/1710252790 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80aecd0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5ed0ce640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e815d750 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80097a0 tx=0x7fd5d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e7c08416838814 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5ec8cd640 1 -- 172.21.15.62:0/1710252790 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8031830 con 0x7fd5e815d2e0 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5ec8cd640 1 -- 172.21.15.62:0/1710252790 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8031990 con 0x7fd5e815d2e0 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5ec8cd640 1 -- 172.21.15.62:0/1710252790 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8031d20 con 0x7fd5e815d2e0 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 -- 172.21.15.62:0/1710252790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 msgr2=0x7fd5e815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e815d750 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80097a0 tx=0x7fd5d802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 -- 172.21.15.62:0/1710252790 shutdown_connections 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e806c9d0 0x7fd5e806ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 --2- 172.21.15.62:0/1710252790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e815d750 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.089+0000 7fd5efb33640 1 -- 172.21.15.62:0/1710252790 >> 172.21.15.62:0/1710252790 conn(0x7fd5e80cb720 msgr2=0x7fd5e80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.090+0000 7fd5efb33640 1 -- 172.21.15.62:0/1710252790 shutdown_connections 2023-09-30T13:56:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.090+0000 7fd5efb33640 1 -- 172.21.15.62:0/1710252790 wait complete. 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 Processor -- start 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 -- start start 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5e806c9d0 0x7fd5e814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 0x7fd5e814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e814f280 con 0x7fd5e815d2e0 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e814d520 con 0x7fd5e806c9d0 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.091+0000 7fd5efb33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e814d040 con 0x7fd5e8153d20 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43692/0 (socket says 172.21.15.62:43692) 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 -- 172.21.15.62:0/238898874 learned_addr learned my addr 172.21.15.62:0/238898874 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ed8cf640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5e806c9d0 0x7fd5e814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ed0ce640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 0x7fd5e814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 -- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 msgr2=0x7fd5e814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 0x7fd5e814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 -- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5e806c9d0 msgr2=0x7fd5e814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5e806c9d0 0x7fd5e814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 -- 172.21.15.62:0/238898874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8009400 con 0x7fd5e815d2e0 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ed0ce640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 0x7fd5e814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5ee0d0640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007e60 tx=0x7fd5e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0014420 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e00145a0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0014950 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e814e600 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.092+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e814ebc0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.093+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e814f3c0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.094+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd5e0014ab0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.094+0000 7fd5de7fc640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 0x7fd5cc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.094+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd5e0089950 con 0x7fd5e815d2e0 2023-09-30T13:56:03.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.094+0000 7fd5ed8cf640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 0x7fd5cc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.095+0000 7fd5ed8cf640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 0x7fd5cc06cff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4000f60 tx=0x7fd5e4007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.098+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd5e814f3c0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.272+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5e814f3c0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.272+0000 7fd5de7fc640 1 -- 172.21.15.62:0/238898874 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5e814f3c0 con 0x7fd5e815d2e0 2023-09-30T13:56:03.272 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:56:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 msgr2=0x7fd5cc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 0x7fd5cc06cff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4000f60 tx=0x7fd5e4007c00 comp rx=0 tx=0).stop 2023-09-30T13:56:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 msgr2=0x7fd5e814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0007e60 tx=0x7fd5e000e4b0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 shutdown_connections 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd5cc06ab30 0x7fd5cc06cff0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5e815d2e0 0x7fd5e814dff0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5e8153d20 0x7fd5e814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 --2- 172.21.15.62:0/238898874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5e806c9d0 0x7fd5e814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 >> 172.21.15.62:0/238898874 conn(0x7fd5e80cb720 msgr2=0x7fd5e80ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.274+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 shutdown_connections 2023-09-30T13:56:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.275+0000 7fd5efb33640 1 -- 172.21.15.62:0/238898874 wait complete. 2023-09-30T13:56:03.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T13:56:03.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.391+0000 7f7222565640 1 Processor -- start 2023-09-30T13:56:03.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.391+0000 7f7222565640 1 -- start start 2023-09-30T13:56:03.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7222565640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7222565640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7222565640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0cf3d0 con 0x7f721c0cdc20 2023-09-30T13:56:03.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7222565640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0b2e50 con 0x7f721c0cea30 2023-09-30T13:56:03.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7222565640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0ac2d0 con 0x7f721c0ab250 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f721b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f7220b02640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f721b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:36406/0 (socket says 172.21.15.62:36406) 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f721b7fe640 1 -- 172.21.15.62:0/3262284210 learned_addr learned my addr 172.21.15.62:0/3262284210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.392+0000 7f721bfff640 1 --1- 172.21.15.62:0/3262284210 >> v1:172.21.15.135:6789/0 conn(0x7f721c0cdc20 0x7f721c0b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35330/0 (socket says 172.21.15.62:35330) 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f7220b02640 1 -- 172.21.15.62:0/3262284210 >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 msgr2=0x7f721c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f7220b02640 1 --2- 172.21.15.62:0/3262284210 >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f7220b02640 1 -- 172.21.15.62:0/3262284210 >> v1:172.21.15.135:6789/0 conn(0x7f721c0cdc20 legacy=0x7f721c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f7220b02640 1 -- 172.21.15.62:0/3262284210 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0cc340 con 0x7f721c0ab250 2023-09-30T13:56:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f721b7fe640 1 --2- 172.21.15.62:0/3262284210 >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.393+0000 7f7220b02640 1 --2- 172.21.15.62:0/3262284210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c0ab6e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7214009d90 tx=0x7f721402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f69421a9140f04ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f721affd640 1 -- 172.21.15.62:0/3262284210 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721402cbd0 con 0x7f721c0ab250 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f721affd640 1 -- 172.21.15.62:0/3262284210 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721402cd30 con 0x7f721c0ab250 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f721affd640 1 -- 172.21.15.62:0/3262284210 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721402cea0 con 0x7f721c0ab250 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 -- 172.21.15.62:0/3262284210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 msgr2=0x7f721c0ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 --2- 172.21.15.62:0/3262284210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c0ab6e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7214009d90 tx=0x7f721402be20 comp rx=0 tx=0).stop 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 -- 172.21.15.62:0/3262284210 shutdown_connections 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 --2- 172.21.15.62:0/3262284210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c0ab6e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 --2- 172.21.15.62:0/3262284210 >> v2:172.21.15.135:3300/0 conn(0x7f721c0cea30 0x7f721c0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 -- 172.21.15.62:0/3262284210 >> 172.21.15.62:0/3262284210 conn(0x7f721c06a170 msgr2=0x7f721c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:03.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 -- 172.21.15.62:0/3262284210 shutdown_connections 2023-09-30T13:56:03.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.394+0000 7f7222565640 1 -- 172.21.15.62:0/3262284210 wait complete. 2023-09-30T13:56:03.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.395+0000 7f7222565640 1 Processor -- start 2023-09-30T13:56:03.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 -- start start 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c14e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721c0cea30 0x7f721c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14ebc0 con 0x7f721c0cdc20 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c5a60 con 0x7f721c0cea30 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f7222565640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c5d40 con 0x7f721c0ab250 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43698/0 (socket says 172.21.15.62:43698) 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.396+0000 7f721b7fe640 1 -- 172.21.15.62:0/2414925433 learned_addr learned my addr 172.21.15.62:0/2414925433 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7220b02640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721c0cea30 0x7f721c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721bfff640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 -- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 msgr2=0x7f721c14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c14e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 -- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721c0cea30 msgr2=0x7f721c0c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721c0cea30 0x7f721c0c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 -- 172.21.15.62:0/2414925433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0094d0 con 0x7f721c0cdc20 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f721b7fe640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e9d0 tx=0x7f720c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00ca60 con 0x7f721c0cdc20 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00cbc0 con 0x7f721c0cdc20 2023-09-30T13:56:03.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c013470 con 0x7f721c0cdc20 2023-09-30T13:56:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7214009a70 con 0x7f721c0cdc20 2023-09-30T13:56:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.397+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c0c6300 con 0x7f721c0cdc20 2023-09-30T13:56:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.398+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c04e0d0 con 0x7f721c0cdc20 2023-09-30T13:56:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.399+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f720c0135d0 con 0x7f721c0cdc20 2023-09-30T13:56:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.399+0000 7f7218ff9640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 0x7f720806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.399+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f720c089360 con 0x7f721c0cdc20 2023-09-30T13:56:03.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.399+0000 7f721bfff640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 0x7f720806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.400+0000 7f721bfff640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 0x7f720806cff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7210000fb0 tx=0x7f7210007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.403+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f720c0547f0 con 0x7f721c0cdc20 2023-09-30T13:56:03.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.580+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f721c0b21e0 con 0x7f721c0cdc20 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.580+0000 7f7218ff9640 1 -- 172.21.15.62:0/2414925433 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f720c057e10 con 0x7f721c0cdc20 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:03.580 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 msgr2=0x7f720806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 0x7f720806cff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7210000fb0 tx=0x7f7210007e30 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 msgr2=0x7f721c0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e9d0 tx=0x7f720c00ee90 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 shutdown_connections 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f720806ab30 0x7f720806cff0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721c0cea30 0x7f721c0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f721c0cdc20 0x7f721c0cb350 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 --2- 172.21.15.62:0/2414925433 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f721c0ab250 0x7f721c14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 >> 172.21.15.62:0/2414925433 conn(0x7f721c06a170 msgr2=0x7f721c070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:03.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 shutdown_connections 2023-09-30T13:56:03.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.582+0000 7f7222565640 1 -- 172.21.15.62:0/2414925433 wait complete. 2023-09-30T13:56:03.592 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T13:56:03.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T13:56:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.702+0000 7fd979305640 1 Processor -- start 2023-09-30T13:56:03.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.702+0000 7fd979305640 1 -- start start 2023-09-30T13:56:03.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd979305640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd97415cca0 0x7fd9740d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd979305640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9740d31a0 con 0x7fd9740cf970 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd979305640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9740cdf60 con 0x7fd9740b20c0 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd979305640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740cda90 con 0x7fd97415cca0 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd9737fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9740cf970 0x7fd9740d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36164/0 (socket says 172.21.15.62:36164) 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd9737fe640 1 -- 172.21.15.62:0/45857603 learned_addr learned my addr 172.21.15.62:0/45857603 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd972ffd640 1 --2- 172.21.15.62:0/45857603 >> v2:172.21.15.135:3300/0 conn(0x7fd97415cca0 0x7fd9740d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569898759 0 0) 0x7fd9740d31a0 con 0x7fd9740cf970 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.703+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd960003520 con 0x7fd9740cf970 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208248860 0 0) 0x7fd9740cdf60 con 0x7fd9740b20c0 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9740d31a0 con 0x7fd9740b20c0 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161075025 0 0) 0x7fd960003520 con 0x7fd9740cf970 2023-09-30T13:56:03.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 >> v2:172.21.15.135:3300/0 conn(0x7fd97415cca0 msgr2=0x7fd9740d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 --2- 172.21.15.62:0/45857603 >> v2:172.21.15.135:3300/0 conn(0x7fd97415cca0 0x7fd9740d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 >> v1:172.21.15.135:6789/0 conn(0x7fd9740b20c0 legacy=0x7fd9740cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740cdc80 con 0x7fd9740cf970 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd9640019f0 con 0x7fd9740cf970 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 >> v1:172.21.15.62:6789/0 conn(0x7fd9740cf970 legacy=0x7fd9740d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd960003b50 0x7fd960003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600047c0 0x7fd960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd96000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96000c0d0 con 0x7fd9600051d0 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96000c240 con 0x7fd960003b50 2023-09-30T13:56:03.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96000c400 con 0x7fd9600047c0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd96000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd972ffd640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd960003b50 0x7fd960003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9727fc640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600047c0 0x7fd960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 -- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600047c0 msgr2=0x7fd960004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600047c0 0x7fd960004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 -- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd960003b50 msgr2=0x7fd960003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd960003b50 0x7fd960003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.704+0000 7fd9737fe640 1 -- 172.21.15.62:0/45857603 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960003520 con 0x7fd9600051d0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.705+0000 7fd9737fe640 1 -- 172.21.15.62:0/45857603 reap_dead start 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.705+0000 7fd9737fe640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd96000b980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd96400a710 tx=0x7fd9600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c8029b252669cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.705+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964034630 con 0x7fd9600051d0 2023-09-30T13:56:03.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.705+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96402f070 con 0x7fd9600051d0 2023-09-30T13:56:03.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.705+0000 7fd971ffb640 1 -- 172.21.15.62:0/45857603 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964034a10 con 0x7fd9600051d0 2023-09-30T13:56:03.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 -- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 msgr2=0x7fd96000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd96000b980 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd96400a710 tx=0x7fd9600057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 -- 172.21.15.62:0/45857603 shutdown_connections 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 --2- 172.21.15.62:0/45857603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd96000b980 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 -- 172.21.15.62:0/45857603 >> 172.21.15.62:0/45857603 conn(0x7fd974071660 msgr2=0x7fd974071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 -- 172.21.15.62:0/45857603 shutdown_connections 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.706+0000 7fd979305640 1 -- 172.21.15.62:0/45857603 wait complete. 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.707+0000 7fd979305640 1 Processor -- start 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.707+0000 7fd979305640 1 -- start start 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97415ac80 0x7fd9741f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 0x7fd9740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740cd770 con 0x7fd9600051d0 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97415b0e0 con 0x7fd9740ccdb0 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741f2a30 con 0x7fd97415ac80 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43716/0 (socket says 172.21.15.62:43716) 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 -- 172.21.15.62:0/2291446086 learned_addr learned my addr 172.21.15.62:0/2291446086 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd9737fe640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 0x7fd9740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd9727fc640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97415ac80 0x7fd9741f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 -- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97415ac80 msgr2=0x7fd9741f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97415ac80 0x7fd9741f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 -- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 msgr2=0x7fd9740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:03.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 0x7fd9740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 -- 172.21.15.62:0/2291446086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9741f2d10 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd9737fe640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 0x7fd9740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd972ffd640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0118e0 tx=0x7fd96c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00faf0 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c00fc50 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9741f2ff0 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c014440 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.708+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9741f32d0 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.709+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974073e70 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.710+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd96c0145a0 con 0x7fd9600051d0 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.710+0000 7fd96b7fe640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 0x7fd95406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:03.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.710+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd96c089920 con 0x7fd9600051d0 2023-09-30T13:56:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.710+0000 7fd9727fc640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 0x7fd95406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.711+0000 7fd9727fc640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 0x7fd95406cff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c9670 tx=0x7fd95c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:03.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.714+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd96c054d80 con 0x7fd9600051d0 2023-09-30T13:56:03.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:03.889+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd9740b2b40 con 0x7fd9600051d0 2023-09-30T13:56:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.004+0000 7fd96b7fe640 1 -- 172.21.15.62:0/2291446086 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd96c0583a0 con 0x7fd9600051d0 2023-09-30T13:56:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-09-30T13:56:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 msgr2=0x7fd95406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 0x7fd95406cff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c9670 tx=0x7fd95c009040 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 msgr2=0x7fd97415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0118e0 tx=0x7fd96c011da0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 shutdown_connections 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd95406ab30 0x7fd95406cff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.007+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9740ccdb0 0x7fd9740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.008+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97415ac80 0x7fd9741f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.008+0000 7fd979305640 1 --2- 172.21.15.62:0/2291446086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9600051d0 0x7fd97415e6e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.008+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 >> 172.21.15.62:0/2291446086 conn(0x7fd974071660 msgr2=0x7fd97415bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:04.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.008+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 shutdown_connections 2023-09-30T13:56:04.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.008+0000 7fd979305640 1 -- 172.21.15.62:0/2291446086 wait complete. 2023-09-30T13:56:04.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T13:56:04.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.134+0000 7f9d5e246640 1 Processor -- start 2023-09-30T13:56:04.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.134+0000 7f9d5e246640 1 -- start start 2023-09-30T13:56:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d5e246640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d5e246640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d5e246640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d58069df0 con 0x7f9d58065dc0 2023-09-30T13:56:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d5e246640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580ce990 con 0x7f9d580c9570 2023-09-30T13:56:04.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d5e246640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5806a060 con 0x7f9d5815ccf0 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d57fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:47696/0 (socket says 172.21.15.62:47696) 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d57fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:36436/0 (socket says 172.21.15.62:36436) 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d577fe640 1 -- 172.21.15.62:0/3205230462 learned_addr learned my addr 172.21.15.62:0/3205230462 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.135+0000 7f9d56ffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9d58065dc0 0x7f9d5806c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35350/0 (socket says 172.21.15.62:35350) 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d577fe640 1 -- 172.21.15.62:0/3205230462 >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 msgr2=0x7f9d5806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d577fe640 1 --2- 172.21.15.62:0/3205230462 >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d577fe640 1 -- 172.21.15.62:0/3205230462 >> v1:172.21.15.135:6789/0 conn(0x7f9d58065dc0 legacy=0x7f9d5806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d577fe640 1 -- 172.21.15.62:0/3205230462 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5806a340 con 0x7f9d5815ccf0 2023-09-30T13:56:04.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d57fff640 1 --2- 172.21.15.62:0/3205230462 >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:56:04.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.136+0000 7f9d577fe640 1 --2- 172.21.15.62:0/3205230462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d4802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4409b698a369eab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:04.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d567fc640 1 -- 172.21.15.62:0/3205230462 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4802f840 con 0x7f9d5815ccf0 2023-09-30T13:56:04.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d567fc640 1 -- 172.21.15.62:0/3205230462 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4802f9a0 con 0x7f9d5815ccf0 2023-09-30T13:56:04.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d567fc640 1 -- 172.21.15.62:0/3205230462 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4802fd30 con 0x7f9d5815ccf0 2023-09-30T13:56:04.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 -- 172.21.15.62:0/3205230462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 msgr2=0x7f9d5806dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 --2- 172.21.15.62:0/3205230462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d4802ba20 comp rx=0 tx=0).stop 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 -- 172.21.15.62:0/3205230462 shutdown_connections 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 --2- 172.21.15.62:0/3205230462 >> v2:172.21.15.135:3300/0 conn(0x7f9d580c9570 0x7f9d5806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 --2- 172.21.15.62:0/3205230462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5815ccf0 0x7f9d5806dac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 -- 172.21.15.62:0/3205230462 >> 172.21.15.62:0/3205230462 conn(0x7f9d580cb9a0 msgr2=0x7f9d580cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 -- 172.21.15.62:0/3205230462 shutdown_connections 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.137+0000 7f9d5e246640 1 -- 172.21.15.62:0/3205230462 wait complete. 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.138+0000 7f9d5e246640 1 Processor -- start 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 -- start start 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d58065dc0 0x7f9d58158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5815ccf0 0x7f9d580b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c3760 con 0x7f9d580c9570 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c3d20 con 0x7f9d5815ccf0 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d5e246640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580b3a00 con 0x7f9d58065dc0 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d56ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d56ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43724/0 (socket says 172.21.15.62:43724) 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d56ffd640 1 -- 172.21.15.62:0/4103345452 learned_addr learned my addr 172.21.15.62:0/4103345452 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.139+0000 7f9d577fe640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d58065dc0 0x7f9d58158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d57fff640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5815ccf0 0x7f9d580b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 -- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d58065dc0 msgr2=0x7f9d58158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d58065dc0 0x7f9d58158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 -- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5815ccf0 msgr2=0x7f9d580b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5815ccf0 0x7f9d580b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 -- 172.21.15.62:0/4103345452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d50009a70 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d56ffd640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c3e0 tx=0x7f9d4c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0074e0 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c007640 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0049e0 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480094d0 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.140+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580c39b0 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.141+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d580cec50 con 0x7f9d580c9570 2023-09-30T13:56:04.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.142+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9d4c004b40 con 0x7f9d580c9570 2023-09-30T13:56:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.142+0000 7f9d3ffff640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 0x7f9d4406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.142+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f9d4c088ed0 con 0x7f9d580c9570 2023-09-30T13:56:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.143+0000 7f9d577fe640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 0x7f9d4406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.143+0000 7f9d577fe640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 0x7f9d4406cff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d48036000 tx=0x7f9d48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:04.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.146+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9d4c054330 con 0x7f9d580c9570 2023-09-30T13:56:04.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:04.323+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9d580cec50 con 0x7f9d580c9570 2023-09-30T13:56:05.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.007+0000 7f9d3ffff640 1 -- 172.21.15.62:0/4103345452 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9d580cec50 con 0x7f9d580c9570 2023-09-30T13:56:05.007 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-09-30T13:56:05.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 msgr2=0x7f9d4406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 0x7f9d4406cff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d48036000 tx=0x7f9d48008030 comp rx=0 tx=0).stop 2023-09-30T13:56:05.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 msgr2=0x7f9d580b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c3e0 tx=0x7f9d4c00c7e0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 shutdown_connections 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d4406ab30 0x7f9d4406cff0 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d48036000 tx=0x7f9d48008030 comp rx=0 tx=0).stop 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5815ccf0 0x7f9d580b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.012+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d580c9570 0x7f9d580b2e60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.013+0000 7f9d5e246640 1 --2- 172.21.15.62:0/4103345452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d58065dc0 0x7f9d58158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.013+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 >> 172.21.15.62:0/4103345452 conn(0x7f9d580cb9a0 msgr2=0x7f9d580afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.014+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 shutdown_connections 2023-09-30T13:56:05.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.015+0000 7f9d5e246640 1 -- 172.21.15.62:0/4103345452 wait complete. 2023-09-30T13:56:05.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T13:56:05.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.151+0000 7f008a5a0640 1 Processor -- start 2023-09-30T13:56:05.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.151+0000 7f008a5a0640 1 -- start start 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f008a5a0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f008415c9c0 0x7f00840d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f008a5a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f00840d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f008a5a0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00840d1870 con 0x7f00841604c0 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f008a5a0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840d0090 con 0x7f008415c9c0 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f008a5a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840cf1e0 con 0x7f00840d0ed0 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f0089d9f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f00841604c0 0x7f0084160950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36176/0 (socket says 172.21.15.62:36176) 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.152+0000 7f0089d9f640 1 -- 172.21.15.62:0/1069313645 learned_addr learned my addr 172.21.15.62:0/1069313645 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109461559 0 0) 0x7f00840d1870 con 0x7f00841604c0 2023-09-30T13:56:05.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f00840d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003520 con 0x7f00841604c0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f008959e640 1 --2- 172.21.15.62:0/1069313645 >> v2:172.21.15.135:3300/0 conn(0x7f008415c9c0 0x7f00840d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344005807 0 0) 0x7f006c003520 con 0x7f00841604c0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 msgr2=0x7f00840d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f00840d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 >> v2:172.21.15.135:3300/0 conn(0x7f008415c9c0 msgr2=0x7f00840d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 --2- 172.21.15.62:0/1069313645 >> v2:172.21.15.135:3300/0 conn(0x7f008415c9c0 0x7f00840d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008415cda0 con 0x7f00841604c0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f008959e640 1 --2- 172.21.15.62:0/1069313645 >> v2:172.21.15.135:3300/0 conn(0x7f008415c9c0 0x7f00840d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f00740019f0 con 0x7f00841604c0 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 >> v1:172.21.15.62:6789/0 conn(0x7f00841604c0 legacy=0x7f0084160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f006c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f006c003ef0 0x7f006c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006c004d00 0x7f006c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840d0090 con 0x7f006c003ef0 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840cf1e0 con 0x7f006c004d00 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c00b9d0 con 0x7f00840d0ed0 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f006c003ef0 0x7f006c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f008959e640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f006c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0089d9f640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006c004d00 0x7f006c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 -- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 msgr2=0x7f006c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00840d0ed0 0x7f006c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 -- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006c004d00 msgr2=0x7f006c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:05.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.153+0000 7f0088d9d640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006c004d00 0x7f006c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.154+0000 7f0088d9d640 1 -- 172.21.15.62:0/1069313645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c003520 con 0x7f006c003ef0 2023-09-30T13:56:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.154+0000 7f0088d9d640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f006c003ef0 0x7f006c0047c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ac0 tx=0x7f006c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5afee52ebd21423 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.154+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802c6b0 con 0x7f006c003ef0 2023-09-30T13:56:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.154+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007802c810 con 0x7f006c003ef0 2023-09-30T13:56:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.154+0000 7f0083fff640 1 -- 172.21.15.62:0/1069313645 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802cba0 con 0x7f006c003ef0 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 -- 172.21.15.62:0/1069313645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f006c003ef0 msgr2=0x7f006c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 --2- 172.21.15.62:0/1069313645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f006c003ef0 0x7f006c0047c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ac0 tx=0x7f006c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f0089d9f640 1 -- 172.21.15.62:0/1069313645 reap_dead start 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 -- 172.21.15.62:0/1069313645 shutdown_connections 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 -- 172.21.15.62:0/1069313645 >> 172.21.15.62:0/1069313645 conn(0x7f0084089fe0 msgr2=0x7f008409bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 -- 172.21.15.62:0/1069313645 shutdown_connections 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.155+0000 7f008a5a0640 1 -- 172.21.15.62:0/1069313645 wait complete. 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.156+0000 7f008a5a0640 1 Processor -- start 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.156+0000 7f008a5a0640 1 -- start start 2023-09-30T13:56:05.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f006c003ef0 0x7f008415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00841531b0 0x7f008415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c9dd0 con 0x7f008409c5e0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008415e030 con 0x7f00841531b0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008a5a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0084153630 con 0x7f006c003ef0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43732/0 (socket says 172.21.15.62:43732) 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 -- 172.21.15.62:0/3129576211 learned_addr learned my addr 172.21.15.62:0/3129576211 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0088d9d640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00841531b0 0x7f008415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f008959e640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f006c003ef0 0x7f008415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 -- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f006c003ef0 msgr2=0x7f008415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f006c003ef0 0x7f008415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 -- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00841531b0 msgr2=0x7f008415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00841531b0 0x7f008415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.157+0000 7f0089d9f640 1 -- 172.21.15.62:0/3129576211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008415e2b0 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f0089d9f640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00840d0e20 tx=0x7f0074007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400aba0 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400ad40 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008415e590 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074013630 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.158+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008415e870 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.159+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084073e70 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.159+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0074013790 con 0x7f008409c5e0 2023-09-30T13:56:05.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.160+0000 7f0081ffb640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 0x7f007006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.160+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f0074089790 con 0x7f008409c5e0 2023-09-30T13:56:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.160+0000 7f008959e640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 0x7f007006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:05.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.161+0000 7f008959e640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 0x7f007006cff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f007c009a60 tx=0x7f007c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:05.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.164+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f00740549b0 con 0x7f008409c5e0 2023-09-30T13:56:05.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:05.377+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f008408ca20 con 0x7f008409c5e0 2023-09-30T13:56:06.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.017+0000 7f0081ffb640 1 -- 172.21.15.62:0/3129576211 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0074057fd0 con 0x7f008409c5e0 2023-09-30T13:56:06.017 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 5 and data pool 6 2023-09-30T13:56:06.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 msgr2=0x7f007006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 0x7f007006cff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f007c009a60 tx=0x7f007c008040 comp rx=0 tx=0).stop 2023-09-30T13:56:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 msgr2=0x7f00840ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00840d0e20 tx=0x7f0074007a90 comp rx=0 tx=0).stop 2023-09-30T13:56:06.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 shutdown_connections 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f007006ab30 0x7f007006cff0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f008409c5e0 0x7f00840ca260 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00841531b0 0x7f008415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 --2- 172.21.15.62:0/3129576211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f006c003ef0 0x7f008415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 >> 172.21.15.62:0/3129576211 conn(0x7f0084089fe0 msgr2=0x7f0084157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.019+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 shutdown_connections 2023-09-30T13:56:06.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.020+0000 7f008a5a0640 1 -- 172.21.15.62:0/3129576211 wait complete. 2023-09-30T13:56:06.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:56:06.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.143+0000 7fc6cb54e640 1 Processor -- start 2023-09-30T13:56:06.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.144+0000 7fc6cb54e640 1 -- start start 2023-09-30T13:56:06.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.144+0000 7fc6cb54e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6c41598c0 0x7fc6c40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.144+0000 7fc6cb54e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40b1e20 con 0x7fc6c40ceea0 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.144+0000 7fc6cb54e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c415e340 con 0x7fc6c40cea30 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.144+0000 7fc6cb54e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40b1530 con 0x7fc6c41598c0 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c92ea640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6c41598c0 0x7fc6c40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c9aeb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6c40ceea0 0x7fc6c415dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36180/0 (socket says 172.21.15.62:36180) 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c92ea640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6c41598c0 0x7fc6c40ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43740/0 (socket says 172.21.15.62:43740) 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c9aeb640 1 -- 172.21.15.62:0/3690316267 learned_addr learned my addr 172.21.15.62:0/3690316267 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c92ea640 1 -- 172.21.15.62:0/3690316267 >> v1:172.21.15.135:6789/0 conn(0x7fc6c40cea30 legacy=0x7fc6c415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c92ea640 1 -- 172.21.15.62:0/3690316267 >> v1:172.21.15.62:6789/0 conn(0x7fc6c40ceea0 legacy=0x7fc6c415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6bbfff640 1 -- 172.21.15.62:0/3690316267 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992466007 0 0) 0x7fc6c40b1e20 con 0x7fc6c40ceea0 2023-09-30T13:56:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.145+0000 7fc6c92ea640 1 -- 172.21.15.62:0/3690316267 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40b17d0 con 0x7fc6c41598c0 2023-09-30T13:56:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6c92ea640 1 --2- 172.21.15.62:0/3690316267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c41598c0 0x7fc6c40ccc20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000d080 tx=0x7fc6c002e1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2425cff0cc56d565 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6bbfff640 1 -- 172.21.15.62:0/3690316267 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c002eb40 con 0x7fc6c41598c0 2023-09-30T13:56:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6bbfff640 1 -- 172.21.15.62:0/3690316267 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c002eca0 con 0x7fc6c41598c0 2023-09-30T13:56:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6bbfff640 1 -- 172.21.15.62:0/3690316267 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0009760 con 0x7fc6c41598c0 2023-09-30T13:56:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 -- 172.21.15.62:0/3690316267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c41598c0 msgr2=0x7fc6c40ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/3690316267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c41598c0 0x7fc6c40ccc20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000d080 tx=0x7fc6c002e1a0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 -- 172.21.15.62:0/3690316267 shutdown_connections 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/3690316267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c41598c0 0x7fc6c40ccc20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 -- 172.21.15.62:0/3690316267 >> 172.21.15.62:0/3690316267 conn(0x7fc6c406a170 msgr2=0x7fc6c406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 -- 172.21.15.62:0/3690316267 shutdown_connections 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.146+0000 7fc6cb54e640 1 -- 172.21.15.62:0/3690316267 wait complete. 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 Processor -- start 2023-09-30T13:56:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 -- start start 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6c40ceea0 0x7fc6c4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6c41598c0 0x7fc6c40b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c415a480 con 0x7fc6c40cea30 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4153a60 con 0x7fc6c41598c0 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6cb54e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41edf30 con 0x7fc6c40ceea0 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6c92ea640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6c92ea640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43744/0 (socket says 172.21.15.62:43744) 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.148+0000 7fc6c92ea640 1 -- 172.21.15.62:0/1275664206 learned_addr learned my addr 172.21.15.62:0/1275664206 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 -- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6c40ceea0 msgr2=0x7fc6c4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6c40ceea0 0x7fc6c4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 -- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6c41598c0 msgr2=0x7fc6c40b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6c41598c0 0x7fc6c40b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 -- 172.21.15.62:0/1275664206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c000bc80 con 0x7fc6c40cea30 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6c92ea640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0038040 tx=0x7fc6c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c003f890 con 0x7fc6c40cea30 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c003f9f0 con 0x7fc6c40cea30 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c003fda0 con 0x7fc6c40cea30 2023-09-30T13:56:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c41eef40 con 0x7fc6c40cea30 2023-09-30T13:56:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.149+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c41ee180 con 0x7fc6c40cea30 2023-09-30T13:56:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.150+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c404e0d0 con 0x7fc6c40cea30 2023-09-30T13:56:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.151+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc6c0041470 con 0x7fc6c40cea30 2023-09-30T13:56:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.151+0000 7fc6b9ffb640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 0x7fc6a806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.151+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6c00ae8a0 con 0x7fc6c40cea30 2023-09-30T13:56:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.151+0000 7fc6c8ae9640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 0x7fc6a806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.152+0000 7fc6c8ae9640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 0x7fc6a806cff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000f60 tx=0x7fc6b40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.155+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc6c0079930 con 0x7fc6c40cea30 2023-09-30T13:56:06.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.334+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c40cbab0 con 0x7fc6c40cea30 2023-09-30T13:56:06.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.335+0000 7fc6b9ffb640 1 -- 172.21.15.62:0/1275664206 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16763 (secure 0 0 0) 0x7fc6c007cf50 con 0x7fc6c40cea30 2023-09-30T13:56:06.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:06.335 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:05.378797+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 msgr2=0x7fc6a806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 0x7fc6a806cff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000f60 tx=0x7fc6b40079b0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 msgr2=0x7fc6c4153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0038040 tx=0x7fc6c0004a40 comp rx=0 tx=0).stop 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 shutdown_connections 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc6a806ab30 0x7fc6a806cff0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6c41598c0 0x7fc6c40b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6c40ceea0 0x7fc6c4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 --2- 172.21.15.62:0/1275664206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c40cea30 0x7fc6c4153520 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 >> 172.21.15.62:0/1275664206 conn(0x7fc6c406a170 msgr2=0x7fc6c40ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 shutdown_connections 2023-09-30T13:56:06.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.337+0000 7fc6cb54e640 1 -- 172.21.15.62:0/1275664206 wait complete. 2023-09-30T13:56:06.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:56:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.455+0000 7f0e6b7c7640 1 Processor -- start 2023-09-30T13:56:06.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.455+0000 7f0e6b7c7640 1 -- start start 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e6b7c7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e6415cbb0 0x7f0e6406b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e6b7c7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640cb810 con 0x7f0e640d1410 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e6b7c7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640cccb0 con 0x7f0e6406b070 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e6b7c7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6406c230 con 0x7f0e6415cbb0 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69563640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e6415cbb0 0x7f0e6406b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69d64640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0e640d1410 0x7f0e640af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36194/0 (socket says 172.21.15.62:36194) 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69d64640 1 -- 172.21.15.62:0/3398697202 learned_addr learned my addr 172.21.15.62:0/3398697202 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69563640 1 -- 172.21.15.62:0/3398697202 >> v1:172.21.15.135:6789/0 conn(0x7f0e6406b070 legacy=0x7f0e6406bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69563640 1 -- 172.21.15.62:0/3398697202 >> v1:172.21.15.62:6789/0 conn(0x7f0e640d1410 legacy=0x7f0e640af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e5bfff640 1 -- 172.21.15.62:0/3398697202 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542639003 0 0) 0x7f0e640cb810 con 0x7f0e640d1410 2023-09-30T13:56:06.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.456+0000 7f0e69563640 1 -- 172.21.15.62:0/3398697202 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640caee0 con 0x7f0e6415cbb0 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e69563640 1 --2- 172.21.15.62:0/3398697202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6415cbb0 0x7f0e6406b5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a3719ae262db62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e5bfff640 1 -- 172.21.15.62:0/3398697202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60031830 con 0x7f0e6415cbb0 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e5bfff640 1 -- 172.21.15.62:0/3398697202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60031990 con 0x7f0e6415cbb0 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e5bfff640 1 -- 172.21.15.62:0/3398697202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60031d20 con 0x7f0e6415cbb0 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/3398697202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6415cbb0 msgr2=0x7f0e6406b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.457+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/3398697202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6415cbb0 0x7f0e6406b5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097a0 tx=0x7f0e6002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.458+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/3398697202 shutdown_connections 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.458+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/3398697202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6415cbb0 0x7f0e6406b5e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.458+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/3398697202 >> 172.21.15.62:0/3398697202 conn(0x7f0e64089fe0 msgr2=0x7f0e640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.458+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/3398697202 shutdown_connections 2023-09-30T13:56:06.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.458+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/3398697202 wait complete. 2023-09-30T13:56:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 Processor -- start 2023-09-30T13:56:06.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 -- start start 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 0x7f0e641f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e6415cbb0 0x7f0e640c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e641f32d0 con 0x7f0e6406b070 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64156290 con 0x7f0e640d1410 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.459+0000 7f0e6b7c7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e641f2a30 con 0x7f0e6415cbb0 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43748/0 (socket says 172.21.15.62:43748) 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 -- 172.21.15.62:0/726164383 learned_addr learned my addr 172.21.15.62:0/726164383 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 -- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e6415cbb0 msgr2=0x7f0e640c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e6415cbb0 0x7f0e640c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e68d62640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 0x7f0e641f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 -- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 msgr2=0x7f0e641f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 0x7f0e641f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 -- 172.21.15.62:0/726164383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009400 con 0x7f0e6406b070 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e68d62640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 0x7f0e641f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e69563640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098c0 tx=0x7f0e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6003ba70 con 0x7f0e6406b070 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6003bbd0 con 0x7f0e6406b070 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e641f2d10 con 0x7f0e6406b070 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.460+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600453f0 con 0x7f0e6406b070 2023-09-30T13:56:06.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.461+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e641f5a30 con 0x7f0e6406b070 2023-09-30T13:56:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.462+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e641f5890 con 0x7f0e6406b070 2023-09-30T13:56:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.462+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0e6004e450 con 0x7f0e6406b070 2023-09-30T13:56:06.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.463+0000 7f0e59ffb640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 0x7f0e4806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.463+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e600ab5a0 con 0x7f0e6406b070 2023-09-30T13:56:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.463+0000 7f0e68d62640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 0x7f0e4806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.463+0000 7f0e68d62640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 0x7f0e4806d020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e6406cb60 tx=0x7f0e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.467+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0e641f5890 con 0x7f0e6406b070 2023-09-30T13:56:06.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.643+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e641f5890 con 0x7f0e6406b070 2023-09-30T13:56:06.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.644+0000 7f0e59ffb640 1 -- 172.21.15.62:0/726164383 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f0e641f5890 con 0x7f0e6406b070 2023-09-30T13:56:06.644 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:06.644 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":38,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:06.404307+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 msgr2=0x7f0e4806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 0x7f0e4806d020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e6406cb60 tx=0x7f0e54008040 comp rx=0 tx=0).stop 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 msgr2=0x7f0e640b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098c0 tx=0x7f0e600046c0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 shutdown_connections 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0e4806ab60 0x7f0e4806d020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0e6415cbb0 0x7f0e640c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e640d1410 0x7f0e641f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 --2- 172.21.15.62:0/726164383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e6406b070 0x7f0e640b5d90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 >> 172.21.15.62:0/726164383 conn(0x7f0e64089fe0 msgr2=0x7f0e640d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 shutdown_connections 2023-09-30T13:56:06.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.646+0000 7f0e6b7c7640 1 -- 172.21.15.62:0/726164383 wait complete. 2023-09-30T13:56:06.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T13:56:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.765+0000 7f4c8978e640 1 Processor -- start 2023-09-30T13:56:06.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 -- start start 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c8406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c84070060 0x7f4c840704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8415a3e0 con 0x7f4c84159480 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c84070a20 con 0x7f4c84070060 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.766+0000 7f4c8978e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8406de80 con 0x7f4c84156b20 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c827fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c84070060 0x7f4c840704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c837fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4c84159480 0x7f4c84159910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36198/0 (socket says 172.21.15.62:36198) 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c837fe640 1 -- 172.21.15.62:0/4047183464 learned_addr learned my addr 172.21.15.62:0/4047183464 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c82ffd640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c8406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c827fc640 1 -- 172.21.15.62:0/4047183464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 msgr2=0x7f4c8406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c827fc640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c8406ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c827fc640 1 -- 172.21.15.62:0/4047183464 >> v1:172.21.15.62:6789/0 conn(0x7f4c84159480 legacy=0x7f4c84159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c827fc640 1 -- 172.21.15.62:0/4047183464 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8415a100 con 0x7f4c84070060 2023-09-30T13:56:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c81ffb640 1 -- 172.21.15.62:0/4047183464 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667494784 0 0) 0x7f4c8415a3e0 con 0x7f4c84159480 2023-09-30T13:56:06.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.767+0000 7f4c82ffd640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c8406ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:06.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c827fc640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c840704e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0097a0 tx=0x7f4c6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ddc89c17c68c86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c81ffb640 1 -- 172.21.15.62:0/4047183464 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c02e070 con 0x7f4c84070060 2023-09-30T13:56:06.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c81ffb640 1 -- 172.21.15.62:0/4047183464 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0315a0 con 0x7f4c84070060 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c81ffb640 1 -- 172.21.15.62:0/4047183464 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c031930 con 0x7f4c84070060 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 -- 172.21.15.62:0/4047183464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 msgr2=0x7f4c840704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c840704e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0097a0 tx=0x7f4c6c02b840 comp rx=0 tx=0).stop 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 -- 172.21.15.62:0/4047183464 shutdown_connections 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c840704e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 --2- 172.21.15.62:0/4047183464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c8406ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 -- 172.21.15.62:0/4047183464 >> 172.21.15.62:0/4047183464 conn(0x7f4c840cb720 msgr2=0x7f4c840ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 -- 172.21.15.62:0/4047183464 shutdown_connections 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.768+0000 7f4c8978e640 1 -- 172.21.15.62:0/4047183464 wait complete. 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 Processor -- start 2023-09-30T13:56:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 -- start start 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c841f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 0x7f4c841f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840b2f10 con 0x7f4c84070060 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840c42a0 con 0x7f4c84159480 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.770+0000 7f4c8978e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c840b25b0 con 0x7f4c84156b20 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43768/0 (socket says 172.21.15.62:43768) 2023-09-30T13:56:06.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 -- 172.21.15.62:0/447633314 learned_addr learned my addr 172.21.15.62:0/447633314 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c827fc640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c841f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 -- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 msgr2=0x7f4c841f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c837fe640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 0x7f4c841f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c841f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 -- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 msgr2=0x7f4c841f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 0x7f4c841f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 -- 172.21.15.62:0/447633314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009400 con 0x7f4c84070060 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c827fc640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c841f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c837fe640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 0x7f4c841f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:06.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c82ffd640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00d100 tx=0x7f4c7c00d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c003b90 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00f040 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c004030 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c840b2850 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.771+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8415bf30 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.772+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8404e0d0 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.773+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4c7c004190 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.773+0000 7f4c7b7fe640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 0x7f4c6406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.773+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c7c0895b0 con 0x7f4c84070060 2023-09-30T13:56:06.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.773+0000 7f4c827fc640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 0x7f4c6406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:06.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.774+0000 7f4c827fc640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 0x7f4c6406cff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c036000 tx=0x7f4c6c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:06.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.777+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4c7c054770 con 0x7f4c84070060 2023-09-30T13:56:06.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:06.988+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c840b3180 con 0x7f4c84070060 2023-09-30T13:56:07.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.022+0000 7f4c7b7fe640 1 -- 172.21.15.62:0/447633314 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c7c057d90 con 0x7f4c84070060 2023-09-30T13:56:07.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.024+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 msgr2=0x7f4c6406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.024+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 0x7f4c6406cff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c036000 tx=0x7f4c6c03d040 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.024+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 msgr2=0x7f4c84153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.024+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00d100 tx=0x7f4c7c00d5c0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 shutdown_connections 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4c6406ab30 0x7f4c6406cff0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c84159480 0x7f4c841f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c84156b20 0x7f4c841f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 --2- 172.21.15.62:0/447633314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c84070060 0x7f4c84153690 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 >> 172.21.15.62:0/447633314 conn(0x7f4c840cb720 msgr2=0x7f4c840ac690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 shutdown_connections 2023-09-30T13:56:07.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.025+0000 7f4c8978e640 1 -- 172.21.15.62:0/447633314 wait complete. 2023-09-30T13:56:07.035 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T13:56:07.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T13:56:07.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.144+0000 7ff633056640 1 Processor -- start 2023-09-30T13:56:07.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.144+0000 7ff633056640 1 -- start start 2023-09-30T13:56:07.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff633056640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff62c0b8760 0x7ff62c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:07.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff633056640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0d1410 con 0x7ff62c15cbc0 2023-09-30T13:56:07.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff633056640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0d16f0 con 0x7ff62c0cd8c0 2023-09-30T13:56:07.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff633056640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c0d19d0 con 0x7ff62c0b8760 2023-09-30T13:56:07.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff630df2640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff62c15cbc0 0x7ff62c0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36202/0 (socket says 172.21.15.62:36202) 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff630df2640 1 -- 172.21.15.62:0/1225636414 learned_addr learned my addr 172.21.15.62:0/1225636414 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62bfff640 1 --2- 172.21.15.62:0/1225636414 >> v2:172.21.15.135:3300/0 conn(0x7ff62c0b8760 0x7ff62c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62b7fe640 1 -- 172.21.15.62:0/1225636414 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822338942 0 0) 0x7ff62c0d1410 con 0x7ff62c15cbc0 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62b7fe640 1 -- 172.21.15.62:0/1225636414 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff614003520 con 0x7ff62c15cbc0 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62bfff640 1 -- 172.21.15.62:0/1225636414 >> v1:172.21.15.135:6789/0 conn(0x7ff62c0cd8c0 legacy=0x7ff62c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62bfff640 1 -- 172.21.15.62:0/1225636414 >> v1:172.21.15.62:6789/0 conn(0x7ff62c15cbc0 legacy=0x7ff62c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.145+0000 7ff62bfff640 1 -- 172.21.15.62:0/1225636414 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0d1cb0 con 0x7ff62c0b8760 2023-09-30T13:56:07.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.146+0000 7ff62bfff640 1 --2- 172.21.15.62:0/1225636414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0d24b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6200097a0 tx=0x7ff62002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922565a9e1d7c298 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:07.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.146+0000 7ff62b7fe640 1 -- 172.21.15.62:0/1225636414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620030610 con 0x7ff62c0b8760 2023-09-30T13:56:07.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff62b7fe640 1 -- 172.21.15.62:0/1225636414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620030770 con 0x7ff62c0b8760 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff62b7fe640 1 -- 172.21.15.62:0/1225636414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620030b00 con 0x7ff62c0b8760 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 -- 172.21.15.62:0/1225636414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 msgr2=0x7ff62c0d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 --2- 172.21.15.62:0/1225636414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0d24b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6200097a0 tx=0x7ff62002b960 comp rx=0 tx=0).stop 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 -- 172.21.15.62:0/1225636414 shutdown_connections 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 --2- 172.21.15.62:0/1225636414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0d24b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 -- 172.21.15.62:0/1225636414 >> 172.21.15.62:0/1225636414 conn(0x7ff62c0718a0 msgr2=0x7ff62c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 -- 172.21.15.62:0/1225636414 shutdown_connections 2023-09-30T13:56:07.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.147+0000 7ff633056640 1 -- 172.21.15.62:0/1225636414 wait complete. 2023-09-30T13:56:07.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.148+0000 7ff633056640 1 Processor -- start 2023-09-30T13:56:07.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.148+0000 7ff633056640 1 -- start start 2023-09-30T13:56:07.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:07.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 0x7ff62c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0b3200 con 0x7ff62c15cbc0 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0b4ee0 con 0x7ff62c0b8760 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff633056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0b51c0 con 0x7ff62c0cd8c0 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff6315f3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff6315f3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43770/0 (socket says 172.21.15.62:43770) 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff6315f3640 1 -- 172.21.15.62:0/2588142741 learned_addr learned my addr 172.21.15.62:0/2588142741 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff630df2640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.149+0000 7ff62bfff640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 0x7ff62c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 -- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 msgr2=0x7ff62c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 0x7ff62c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 -- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 msgr2=0x7ff62c0b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 -- 172.21.15.62:0/2588142741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620009400 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff62bfff640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 0x7ff62c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6315f3640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c7a0 tx=0x7ff62400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003b70 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff624003cf0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c0c77b0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003ea0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.150+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c0b4bd0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.151+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c0c7cd0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.151+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff62400aa90 con 0x7ff62c15cbc0 2023-09-30T13:56:07.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.152+0000 7ff6297fa640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 0x7ff61806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:07.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.152+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6240890b0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.152+0000 7ff630df2640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 0x7ff61806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:07.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.152+0000 7ff630df2640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 0x7ff61806cff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0011e0 tx=0x7ff61c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:07.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.156+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff62c0c7cd0 con 0x7ff62c15cbc0 2023-09-30T13:56:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:07.369+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff62c0c7cd0 con 0x7ff62c15cbc0 2023-09-30T13:56:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.034+0000 7ff6297fa640 1 -- 172.21.15.62:0/2588142741 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff62c0c7cd0 con 0x7ff62c15cbc0 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 msgr2=0x7ff61806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 0x7ff61806cff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0011e0 tx=0x7ff61c007d30 comp rx=0 tx=0).stop 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 msgr2=0x7ff62c151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c7a0 tx=0x7ff62400cc60 comp rx=0 tx=0).stop 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 shutdown_connections 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff61806ab30 0x7ff61806cff0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff62c15cbc0 0x7ff62c151ff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff62c0cd8c0 0x7ff62c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 --2- 172.21.15.62:0/2588142741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff62c0b8760 0x7ff62c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 >> 172.21.15.62:0/2588142741 conn(0x7ff62c0718a0 msgr2=0x7ff62c0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 shutdown_connections 2023-09-30T13:56:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.037+0000 7ff633056640 1 -- 172.21.15.62:0/2588142741 wait complete. 2023-09-30T13:56:08.049 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T13:56:08.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:56:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.161+0000 7fb72379e640 1 Processor -- start 2023-09-30T13:56:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.161+0000 7fb72379e640 1 -- start start 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb72379e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb71c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb72379e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c15b9a0 con 0x7fb71c0cf140 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb72379e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0cc950 con 0x7fb71c0b31c0 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb72379e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0b2e50 con 0x7fb71c0ace50 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb721d3b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb71c0cf140 0x7fb71c0ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55404/0 (socket says 172.21.15.62:55404) 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb721d3b640 1 -- 172.21.15.62:0/1047235490 learned_addr learned my addr 172.21.15.62:0/1047235490 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb72153a640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb71c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637817461 0 0) 0x7fb71c15b9a0 con 0x7fb71c0cf140 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708003520 con 0x7fb71c0cf140 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272698458 0 0) 0x7fb71c0cc950 con 0x7fb71c0b31c0 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb71c15b9a0 con 0x7fb71c0b31c0 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517301299 0 0) 0x7fb708003520 con 0x7fb71c0cf140 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 msgr2=0x7fb71c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb71c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 >> v1:172.21.15.135:6789/0 conn(0x7fb71c0b31c0 legacy=0x7fb71c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c15add0 con 0x7fb71c0cf140 2023-09-30T13:56:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb7140019f0 con 0x7fb71c0cf140 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 >> v1:172.21.15.62:6789/0 conn(0x7fb71c0cf140 legacy=0x7fb71c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.162+0000 7fb713fff640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb708003b30 0x7fb708003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb713fff640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb7080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb713fff640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb708004d00 0x7fb708005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0b2e50 con 0x7fb708004d00 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70800ba80 con 0x7fb708003b30 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70800bc40 con 0x7fb71c0ace50 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb708004d00 0x7fb708005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb72153a640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb708003b30 0x7fb708003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb720d39640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb7080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 -- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 msgr2=0x7fb7080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb7080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 -- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb708003b30 msgr2=0x7fb708003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb708003b30 0x7fb708003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb721d3b640 1 -- 172.21.15.62:0/1047235490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708003520 con 0x7fb708004d00 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.163+0000 7fb720d39640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb71c0ace50 0x7fb7080047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb721d3b640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb708004d00 0x7fb708005180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a7a0 tx=0x7fb7080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3257b4946ec2e75d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714034630 con 0x7fb708004d00 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71402f070 con 0x7fb708004d00 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb713fff640 1 -- 172.21.15.62:0/1047235490 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140349f0 con 0x7fb708004d00 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 -- 172.21.15.62:0/1047235490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb708004d00 msgr2=0x7fb708005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 --2- 172.21.15.62:0/1047235490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb708004d00 0x7fb708005180 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a7a0 tx=0x7fb7080057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb721d3b640 1 -- 172.21.15.62:0/1047235490 reap_dead start 2023-09-30T13:56:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 -- 172.21.15.62:0/1047235490 shutdown_connections 2023-09-30T13:56:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 -- 172.21.15.62:0/1047235490 >> 172.21.15.62:0/1047235490 conn(0x7fb71c06a170 msgr2=0x7fb71c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 -- 172.21.15.62:0/1047235490 shutdown_connections 2023-09-30T13:56:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.164+0000 7fb72379e640 1 -- 172.21.15.62:0/1047235490 wait complete. 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 Processor -- start 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 -- start start 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb708004d00 0x7fb71c0c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb71c0ae0a0 0x7fb71c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c4890 con 0x7fb71c15d870 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c15e230 con 0x7fb71c0ae0a0 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb72379e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0aee60 con 0x7fb708004d00 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.166+0000 7fb720d39640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56838/0 (socket says 172.21.15.62:56838) 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 -- 172.21.15.62:0/600157851 learned_addr learned my addr 172.21.15.62:0/600157851 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb721d3b640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb71c0ae0a0 0x7fb71c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb72153a640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb708004d00 0x7fb71c0c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 -- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb708004d00 msgr2=0x7fb71c0c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb708004d00 0x7fb71c0c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 -- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb71c0ae0a0 msgr2=0x7fb71c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb71c0ae0a0 0x7fb71c0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 -- 172.21.15.62:0/600157851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0af140 con 0x7fb71c15d870 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb720d39640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e780 tx=0x7fb70c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c017070 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c0050d0 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c0af420 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c005240 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.167+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c0aea60 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.168+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c0aec20 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.169+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb70c007020 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.169+0000 7fb711ffb640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 0x7fb70006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.169+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb70c088a40 con 0x7fb71c15d870 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.170+0000 7fb72153a640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 0x7fb70006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.170+0000 7fb72153a640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 0x7fb70006cff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb71c1f30b0 tx=0x7fb718009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.174+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb71c0aec20 con 0x7fb71c15d870 2023-09-30T13:56:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.384+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb71c0aec20 con 0x7fb71c15d870 2023-09-30T13:56:08.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.384+0000 7fb711ffb640 1 -- 172.21.15.62:0/600157851 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fb71c0aec20 con 0x7fb71c15d870 2023-09-30T13:56:08.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:08.384 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:56:08.384 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 msgr2=0x7fb70006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 0x7fb70006cff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb71c1f30b0 tx=0x7fb718009110 comp rx=0 tx=0).stop 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 msgr2=0x7fb71c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e780 tx=0x7fb70c00eb80 comp rx=0 tx=0).stop 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 shutdown_connections 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb70006ab30 0x7fb70006cff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb71c0ae0a0 0x7fb71c0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb71c15d870 0x7fb71c15dcf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 --2- 172.21.15.62:0/600157851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb708004d00 0x7fb71c0c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 >> 172.21.15.62:0/600157851 conn(0x7fb71c06a170 msgr2=0x7fb71c15a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 shutdown_connections 2023-09-30T13:56:08.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.386+0000 7fb72379e640 1 -- 172.21.15.62:0/600157851 wait complete. 2023-09-30T13:56:08.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:56:08.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 Processor -- start 2023-09-30T13:56:08.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 -- start start 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040ace50 0x7f1d040b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d040b31c0 0x7f1d040cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0415b9a0 con 0x7f1d040cef70 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040cf400 con 0x7f1d040b31c0 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0ab01640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b2e50 con 0x7f1d040ace50 2023-09-30T13:56:08.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0909e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1d040cef70 0x7f1d0415e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55406/0 (socket says 172.21.15.62:55406) 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d0909e640 1 -- 172.21.15.62:0/1634696047 learned_addr learned my addr 172.21.15.62:0/1634696047 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.503+0000 7f1d03fff640 1 --2- 172.21.15.62:0/1634696047 >> v2:172.21.15.62:3300/0 conn(0x7f1d040b31c0 0x7f1d040cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d0889d640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040ace50 0x7f1d040b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d037fe640 1 -- 172.21.15.62:0/1634696047 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063124408 0 0) 0x7f1d0415b9a0 con 0x7f1d040cef70 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d037fe640 1 -- 172.21.15.62:0/1634696047 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003520 con 0x7f1d040cef70 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d03fff640 1 -- 172.21.15.62:0/1634696047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040ace50 msgr2=0x7f1d040b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d03fff640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040ace50 0x7f1d040b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d03fff640 1 -- 172.21.15.62:0/1634696047 >> v1:172.21.15.62:6789/0 conn(0x7f1d040cef70 legacy=0x7f1d0415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.504+0000 7f1d03fff640 1 -- 172.21.15.62:0/1634696047 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040cc950 con 0x7f1d040b31c0 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d03fff640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040b31c0 0x7f1d040cea30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097a0 tx=0x7f1cf802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dfbae3b752845a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d037fe640 1 -- 172.21.15.62:0/1634696047 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf802e070 con 0x7f1d040b31c0 2023-09-30T13:56:08.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d037fe640 1 -- 172.21.15.62:0/1634696047 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80315a0 con 0x7f1d040b31c0 2023-09-30T13:56:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d037fe640 1 -- 172.21.15.62:0/1634696047 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8031930 con 0x7f1d040b31c0 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 -- 172.21.15.62:0/1634696047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040b31c0 msgr2=0x7f1d040cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040b31c0 0x7f1d040cea30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097a0 tx=0x7f1cf802b840 comp rx=0 tx=0).stop 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 -- 172.21.15.62:0/1634696047 shutdown_connections 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040b31c0 0x7f1d040cea30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/1634696047 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040ace50 0x7f1d040b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 -- 172.21.15.62:0/1634696047 >> 172.21.15.62:0/1634696047 conn(0x7f1d0406a170 msgr2=0x7f1d0406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 -- 172.21.15.62:0/1634696047 shutdown_connections 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.505+0000 7f1d0ab01640 1 -- 172.21.15.62:0/1634696047 wait complete. 2023-09-30T13:56:08.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.506+0000 7f1d0ab01640 1 Processor -- start 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.506+0000 7f1d0ab01640 1 -- start start 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d040ace50 0x7f1d040c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040b31c0 0x7f1d0415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0415ea80 con 0x7f1d040cef70 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0415ecd0 con 0x7f1d040ace50 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0ab01640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0415efb0 con 0x7f1d040b31c0 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0909e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0909e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56860/0 (socket says 172.21.15.62:56860) 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.507+0000 7f1d0909e640 1 -- 172.21.15.62:0/3807856882 learned_addr learned my addr 172.21.15.62:0/3807856882 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0889d640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d040ace50 0x7f1d040c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d03fff640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040b31c0 0x7f1d0415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 -- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040b31c0 msgr2=0x7f1d0415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040b31c0 0x7f1d0415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 -- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d040ace50 msgr2=0x7f1d040c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d040ace50 0x7f1d040c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 -- 172.21.15.62:0/3807856882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009400 con 0x7f1d040cef70 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0909e640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c390 tx=0x7f1cf400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4005ce0 con 0x7f1d040cef70 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf4005e40 con 0x7f1d040cef70 2023-09-30T13:56:08.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0415f290 con 0x7f1d040cef70 2023-09-30T13:56:08.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4007310 con 0x7f1d040cef70 2023-09-30T13:56:08.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.508+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d040c49b0 con 0x7f1d040cef70 2023-09-30T13:56:08.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.509+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0415adb0 con 0x7f1d040cef70 2023-09-30T13:56:08.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.510+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1cf4007470 con 0x7f1d040cef70 2023-09-30T13:56:08.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.510+0000 7f1d017fa640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 0x7f1cf006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.510+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1cf4088900 con 0x7f1d040cef70 2023-09-30T13:56:08.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.510+0000 7f1d0889d640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 0x7f1cf006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.511+0000 7f1d0889d640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 0x7f1cf006cff0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009fd0 tx=0x7f1cfc009920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.515+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1d0415adb0 con 0x7f1d040cef70 2023-09-30T13:56:08.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.691+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d041533c0 con 0x7f1d040cef70 2023-09-30T13:56:08.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.692+0000 7f1d017fa640 1 -- 172.21.15.62:0/3807856882 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f1d041533c0 con 0x7f1d040cef70 2023-09-30T13:56:08.691 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:08.692 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":38,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:06.404307+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:56:08.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.693+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 msgr2=0x7f1cf006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.693+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 0x7f1cf006cff0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009fd0 tx=0x7f1cfc009920 comp rx=0 tx=0).stop 2023-09-30T13:56:08.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.693+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 msgr2=0x7f1d0415d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.693+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c390 tx=0x7f1cf400c850 comp rx=0 tx=0).stop 2023-09-30T13:56:08.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 shutdown_connections 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cf006ab30 0x7f1cf006cff0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d040cef70 0x7f1d0415d4a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d040b31c0 0x7f1d0415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 --2- 172.21.15.62:0/3807856882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d040ace50 0x7f1d040c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 >> 172.21.15.62:0/3807856882 conn(0x7f1d0406a170 msgr2=0x7f1d0415af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 shutdown_connections 2023-09-30T13:56:08.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.694+0000 7f1d0ab01640 1 -- 172.21.15.62:0/3807856882 wait complete. 2023-09-30T13:56:08.704 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T13:56:08.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:56:08.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.810+0000 7fe271916640 1 Processor -- start 2023-09-30T13:56:08.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.810+0000 7fe271916640 1 -- start start 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe271916640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe26c0d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe271916640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c0d0aa0 con 0x7fe26c15c9e0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe271916640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c0d0d80 con 0x7fe26c0cf2e0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe271916640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0d1060 con 0x7fe26c15cdc0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe26affd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe26c15c9e0 0x7fe26c0ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55418/0 (socket says 172.21.15.62:55418) 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe26affd640 1 -- 172.21.15.62:0/2380627681 learned_addr learned my addr 172.21.15.62:0/2380627681 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe26a7fc640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe26c0d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201841278 0 0) 0x7fe26c0d0aa0 con 0x7fe26c15c9e0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.811+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe258003520 con 0x7fe26c15c9e0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429401209 0 0) 0x7fe258003520 con 0x7fe26c15c9e0 2023-09-30T13:56:08.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 msgr2=0x7fe26c0d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe26c0d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 >> v1:172.21.15.135:6789/0 conn(0x7fe26c0cf2e0 legacy=0x7fe26c0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0d1340 con 0x7fe26c15c9e0 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fe25c001b90 con 0x7fe26c15c9e0 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 >> v1:172.21.15.62:6789/0 conn(0x7fe26c15c9e0 legacy=0x7fe26c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe2580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe258003ee0 0x7fe2580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe258004d00 0x7fe258005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0d1060 con 0x7fe258004d00 2023-09-30T13:56:08.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25800b9e0 con 0x7fe258003ee0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25800bba0 con 0x7fe26c15cdc0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe258004d00 0x7fe258005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26affd640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe2580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26a7fc640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe258003ee0 0x7fe2580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 -- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 msgr2=0x7fe2580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe26c15cdc0 0x7fe2580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 -- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe258003ee0 msgr2=0x7fe2580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe258003ee0 0x7fe2580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.812+0000 7fe26b7fe640 1 -- 172.21.15.62:0/2380627681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258003520 con 0x7fe258004d00 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.813+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe258004d00 0x7fe258005180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe264001910 tx=0x7fe2580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5a8486cdfcca61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.813+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264032620 con 0x7fe258004d00 2023-09-30T13:56:08.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.813+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264032780 con 0x7fe258004d00 2023-09-30T13:56:08.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.813+0000 7fe269ffb640 1 -- 172.21.15.62:0/2380627681 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264032b50 con 0x7fe258004d00 2023-09-30T13:56:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 -- 172.21.15.62:0/2380627681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe258004d00 msgr2=0x7fe258005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 --2- 172.21.15.62:0/2380627681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe258004d00 0x7fe258005180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe264001910 tx=0x7fe2580057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe26b7fe640 1 -- 172.21.15.62:0/2380627681 reap_dead start 2023-09-30T13:56:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 -- 172.21.15.62:0/2380627681 shutdown_connections 2023-09-30T13:56:08.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 -- 172.21.15.62:0/2380627681 >> 172.21.15.62:0/2380627681 conn(0x7fe26c089fe0 msgr2=0x7fe26c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 -- 172.21.15.62:0/2380627681 shutdown_connections 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.814+0000 7fe271916640 1 -- 172.21.15.62:0/2380627681 wait complete. 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.815+0000 7fe271916640 1 Processor -- start 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.815+0000 7fe271916640 1 -- start start 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe258004d00 0x7fe26c0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 0x7fe26c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c156640 con 0x7fe26c15f710 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c156800 con 0x7fe26c1561c0 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe271916640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c1600d0 con 0x7fe258004d00 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56886/0 (socket says 172.21.15.62:56886) 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 -- 172.21.15.62:0/1420783387 learned_addr learned my addr 172.21.15.62:0/1420783387 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26affd640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe258004d00 0x7fe26c0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26a7fc640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 0x7fe26c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 -- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe258004d00 msgr2=0x7fe26c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe258004d00 0x7fe26c0cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 -- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 msgr2=0x7fe26c1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 0x7fe26c1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 -- 172.21.15.62:0/1420783387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c1f2800 con 0x7fe26c15f710 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26a7fc640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 0x7fe26c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.816+0000 7fe26b7fe640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe264034040 tx=0x7fe2640012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.817+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264005270 con 0x7fe26c15f710 2023-09-30T13:56:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.817+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2640053d0 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.817+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c1f2ae0 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.817+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640069d0 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.817+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c156a10 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.818+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c156c00 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.818+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe264042070 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.818+0000 7fe263fff640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 0x7fe24c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.819+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2640aac70 con 0x7fe26c15f710 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.819+0000 7fe26affd640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 0x7fe24c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:08.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.819+0000 7fe26affd640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 0x7fe24c06cff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe25c001550 tx=0x7fe25c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:08.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.823+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe264075ea0 con 0x7fe26c15f710 2023-09-30T13:56:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:08.995+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe26c0d1620 con 0x7fe24c06ab30 2023-09-30T13:56:09.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.003+0000 7fe263fff640 1 -- 172.21.15.62:0/1420783387 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274953 (secure 0 0 0) 0x7fe25c001fe0 con 0x7fe24c06ab30 2023-09-30T13:56:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:09.006 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 msgr2=0x7fe24c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 0x7fe24c06cff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe25c001550 tx=0x7fe25c009040 comp rx=0 tx=0).stop 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 msgr2=0x7fe26c15fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe264034040 tx=0x7fe2640012b0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 shutdown_connections 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe24c06ab30 0x7fe24c06cff0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe26c15f710 0x7fe26c15fb90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c1561c0 0x7fe26c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 --2- 172.21.15.62:0/1420783387 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe258004d00 0x7fe26c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 >> 172.21.15.62:0/1420783387 conn(0x7fe26c089fe0 msgr2=0x7fe26c0c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 shutdown_connections 2023-09-30T13:56:09.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.006+0000 7fe271916640 1 -- 172.21.15.62:0/1420783387 wait complete. 2023-09-30T13:56:09.016 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-09-30T13:56:07.692788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220428,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4300800,"data_stored":2482504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-30T13:55:59.564663+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:55:59.564663+0000","last_peered":"2023-09-30T13:55:59.564663+0000","last_clean":"2023-09-30T13:55:59.564663+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:55:59.564663+0000","last_undegraded":"2023-09-30T13:55:59.564663+0000","last_fullsized":"2023-09-30T13:55:59.564663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.378},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.626}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.436}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.38},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27000000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.502},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.313},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.27300000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.24199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.371},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:56:09.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:56:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.163+0000 7efea16a2640 1 Processor -- start 2023-09-30T13:56:09.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.163+0000 7efea16a2640 1 -- start start 2023-09-30T13:56:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efea16a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe9c15acc0 0x7efe9c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efea16a2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efe9c0cf4e0 0x7efe9c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efea16a2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c06e3b0 con 0x7efe9c0cb840 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efea16a2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c0cbd00 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efea16a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c0cbfe0 con 0x7efe9c15acc0 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efe9b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efe9c0cf4e0 0x7efe9c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efe93fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efe9c0cb840 0x7efe9c0cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55420/0 (socket says 172.21.15.62:55420) 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.164+0000 7efe93fff640 1 -- 172.21.15.62:0/716387774 learned_addr learned my addr 172.21.15.62:0/716387774 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9affd640 1 --2- 172.21.15.62:0/716387774 >> v2:172.21.15.135:3300/0 conn(0x7efe9c15acc0 0x7efe9c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9b7fe640 1 -- 172.21.15.62:0/716387774 >> v2:172.21.15.135:3300/0 conn(0x7efe9c15acc0 msgr2=0x7efe9c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9b7fe640 1 --2- 172.21.15.62:0/716387774 >> v2:172.21.15.135:3300/0 conn(0x7efe9c15acc0 0x7efe9c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9b7fe640 1 -- 172.21.15.62:0/716387774 >> v1:172.21.15.62:6789/0 conn(0x7efe9c0cb840 legacy=0x7efe9c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9b7fe640 1 -- 172.21.15.62:0/716387774 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0cc2c0 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9a7fc640 1 -- 172.21.15.62:0/716387774 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577654173 0 0) 0x7efe9c06e3b0 con 0x7efe9c0cb840 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.165+0000 7efe9b7fe640 1 --2- 172.21.15.62:0/716387774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c06e840 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efe9c06dc60 tx=0x7efe9402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880653038e512095 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efe9a7fc640 1 -- 172.21.15.62:0/716387774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9402cc80 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efe9a7fc640 1 -- 172.21.15.62:0/716387774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9402cde0 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efe9a7fc640 1 -- 172.21.15.62:0/716387774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94034660 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 -- 172.21.15.62:0/716387774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c0cf4e0 msgr2=0x7efe9c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 --2- 172.21.15.62:0/716387774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c06e840 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efe9c06dc60 tx=0x7efe9402bed0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 -- 172.21.15.62:0/716387774 shutdown_connections 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 --2- 172.21.15.62:0/716387774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c06e840 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 --2- 172.21.15.62:0/716387774 >> v2:172.21.15.135:3300/0 conn(0x7efe9c15acc0 0x7efe9c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 -- 172.21.15.62:0/716387774 >> 172.21.15.62:0/716387774 conn(0x7efe9c089fe0 msgr2=0x7efe9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 -- 172.21.15.62:0/716387774 shutdown_connections 2023-09-30T13:56:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.166+0000 7efea16a2640 1 -- 172.21.15.62:0/716387774 wait complete. 2023-09-30T13:56:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.167+0000 7efea16a2640 1 Processor -- start 2023-09-30T13:56:09.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.167+0000 7efea16a2640 1 -- start start 2023-09-30T13:56:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 0x7efe9c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0c6800 con 0x7efe9c15acc0 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c159350 con 0x7efe9c0cf4e0 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efea16a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0c6a10 con 0x7efe9c0cb840 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56908/0 (socket says 172.21.15.62:56908) 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 -- 172.21.15.62:0/2885915968 learned_addr learned my addr 172.21.15.62:0/2885915968 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe93fff640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9affd640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 0x7efe9c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 -- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 msgr2=0x7efe9c158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 0x7efe9c158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 -- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe9c0cf4e0 msgr2=0x7efe9c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9b7fe640 1 -- 172.21.15.62:0/2885915968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94009a70 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.168+0000 7efe9affd640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 0x7efe9c158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efe9b7fe640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e80 tx=0x7efe94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94040650 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940407b0 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c0c6cf0 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94040b60 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.169+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c0c72b0 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.170+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c0cec40 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.170+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efe94040cc0 con 0x7efe9c15acc0 2023-09-30T13:56:09.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.171+0000 7efe937fe640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 0x7efe7c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.171+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efe940ac100 con 0x7efe9c15acc0 2023-09-30T13:56:09.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.171+0000 7efe9affd640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 0x7efe7c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.172+0000 7efe9affd640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 0x7efe7c06cff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe8c006fd0 tx=0x7efe8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.175+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efe94077210 con 0x7efe9c15acc0 2023-09-30T13:56:09.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.348+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe9c0cc5a0 con 0x7efe7c06ab30 2023-09-30T13:56:09.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.355+0000 7efe937fe640 1 -- 172.21.15.62:0/2885915968 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274953 (secure 0 0 0) 0x7efe8c0095f0 con 0x7efe7c06ab30 2023-09-30T13:56:09.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:09.359 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 msgr2=0x7efe7c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 0x7efe7c06cff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe8c006fd0 tx=0x7efe8c008040 comp rx=0 tx=0).stop 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 msgr2=0x7efe9c15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e80 tx=0x7efe94004a40 comp rx=0 tx=0).stop 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 shutdown_connections 2023-09-30T13:56:09.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe7c06ab30 0x7efe7c06cff0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe9c15acc0 0x7efe9c15d7a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe9c0cf4e0 0x7efe9c15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 --2- 172.21.15.62:0/2885915968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe9c0cb840 0x7efe9c158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 >> 172.21.15.62:0/2885915968 conn(0x7efe9c089fe0 msgr2=0x7efe9c0aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.358+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 shutdown_connections 2023-09-30T13:56:09.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.359+0000 7efea16a2640 1 -- 172.21.15.62:0/2885915968 wait complete. 2023-09-30T13:56:09.368 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-09-30T13:56:07.692788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220428,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754292,"statfs":{"total":773094113280,"available":772868395008,"internally_reserved":0,"allocated":4300800,"data_stored":2482504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:05.005566+0000","last_change":"2023-09-30T13:56:05.005566+0000","last_active":"2023-09-30T13:56:05.005566+0000","last_peered":"2023-09-30T13:56:05.005566+0000","last_clean":"2023-09-30T13:56:05.005566+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:05.005566+0000","last_undegraded":"2023-09-30T13:56:05.005566+0000","last_fullsized":"2023-09-30T13:56:05.005566+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T13:56:04.001537+0000","last_change":"2023-09-30T13:56:04.001537+0000","last_active":"2023-09-30T13:56:04.001537+0000","last_peered":"2023-09-30T13:56:04.001537+0000","last_clean":"2023-09-30T13:56:04.001537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T13:56:04.001537+0000","last_undegraded":"2023-09-30T13:56:04.001537+0000","last_fullsized":"2023-09-30T13:56:04.001537+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-09-30T13:55:59.564663+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:55:59.564663+0000","last_peered":"2023-09-30T13:55:59.564663+0000","last_clean":"2023-09-30T13:55:59.564663+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:55:59.564663+0000","last_undegraded":"2023-09-30T13:55:59.564663+0000","last_fullsized":"2023-09-30T13:55:59.564663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.378},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.432},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.626}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.436}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35799999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45400000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.38},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27000000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.502},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.313},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.27300000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.24199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.371},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:56:09.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:56:09.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.515+0000 7f30b0a51640 1 Processor -- start 2023-09-30T13:56:09.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.515+0000 7f30b0a51640 1 -- start start 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30b0a51640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30ac158c20 0x7f30ac0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30b0a51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30ac0cc210 0x7f30ac159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30b0a51640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac159540 con 0x7f30ac0caea0 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30b0a51640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac0b1ea0 con 0x7f30ac0cc210 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30b0a51640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac06ddf0 con 0x7f30ac158c20 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30a3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30ac0cc210 0x7f30ac159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30aad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30ac0caea0 0x7f30ac0cb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55426/0 (socket says 172.21.15.62:55426) 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30aad9d640 1 -- 172.21.15.62:0/2063479262 learned_addr learned my addr 172.21.15.62:0/2063479262 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30aa59c640 1 --2- 172.21.15.62:0/2063479262 >> v2:172.21.15.135:3300/0 conn(0x7f30ac158c20 0x7f30ac0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30a3fff640 1 -- 172.21.15.62:0/2063479262 >> v2:172.21.15.135:3300/0 conn(0x7f30ac158c20 msgr2=0x7f30ac0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30a3fff640 1 --2- 172.21.15.62:0/2063479262 >> v2:172.21.15.135:3300/0 conn(0x7f30ac158c20 0x7f30ac0b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30a3fff640 1 -- 172.21.15.62:0/2063479262 >> v1:172.21.15.62:6789/0 conn(0x7f30ac0caea0 legacy=0x7f30ac0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.516+0000 7f30a3fff640 1 -- 172.21.15.62:0/2063479262 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0cdf30 con 0x7f30ac0cc210 2023-09-30T13:56:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.517+0000 7f30a3fff640 1 --2- 172.21.15.62:0/2063479262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac0cc210 0x7f30ac159000 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f30ac06e490 tx=0x7f309402c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b606668de460525 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.517+0000 7f30a9d9b640 1 -- 172.21.15.62:0/2063479262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094030800 con 0x7f30ac0cc210 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.517+0000 7f30a9d9b640 1 -- 172.21.15.62:0/2063479262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094030960 con 0x7f30ac0cc210 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.517+0000 7f30a9d9b640 1 -- 172.21.15.62:0/2063479262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094030cf0 con 0x7f30ac0cc210 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 -- 172.21.15.62:0/2063479262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac0cc210 msgr2=0x7f30ac159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2063479262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac0cc210 0x7f30ac159000 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f30ac06e490 tx=0x7f309402c9e0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 -- 172.21.15.62:0/2063479262 shutdown_connections 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2063479262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac0cc210 0x7f30ac159000 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2063479262 >> v2:172.21.15.135:3300/0 conn(0x7f30ac158c20 0x7f30ac0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 -- 172.21.15.62:0/2063479262 >> 172.21.15.62:0/2063479262 conn(0x7f30ac06a170 msgr2=0x7f30ac06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 -- 172.21.15.62:0/2063479262 shutdown_connections 2023-09-30T13:56:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.518+0000 7f30b0a51640 1 -- 172.21.15.62:0/2063479262 wait complete. 2023-09-30T13:56:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.519+0000 7f30b0a51640 1 Processor -- start 2023-09-30T13:56:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.519+0000 7f30b0a51640 1 -- start start 2023-09-30T13:56:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30ac0caea0 0x7f30ac1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 0x7f30ac0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c63e0 con 0x7f30ac158c20 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac1567f0 con 0x7f30ac0cc210 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30b0a51640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c8250 con 0x7f30ac0caea0 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56926/0 (socket says 172.21.15.62:56926) 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 -- 172.21.15.62:0/2207194159 learned_addr learned my addr 172.21.15.62:0/2207194159 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aa59c640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30ac0caea0 0x7f30ac1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30a3fff640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 0x7f30ac0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 -- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30ac0caea0 msgr2=0x7f30ac1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30ac0caea0 0x7f30ac1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 -- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 msgr2=0x7f30ac0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 0x7f30ac0c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30aad9d640 1 -- 172.21.15.62:0/2207194159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094009400 con 0x7f30ac158c20 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.520+0000 7f30a3fff640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 0x7f30ac0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30aad9d640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f30a400cae0 tx=0x7f30a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400ac40 con 0x7f30ac158c20 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400ada0 con 0x7f30ac158c20 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0c8530 con 0x7f30ac158c20 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4012620 con 0x7f30ac158c20 2023-09-30T13:56:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.521+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0ab3f0 con 0x7f30ac158c20 2023-09-30T13:56:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.522+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac0ab250 con 0x7f30ac158c20 2023-09-30T13:56:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.522+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f30a4007070 con 0x7f30ac158c20 2023-09-30T13:56:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.522+0000 7f30a2ffd640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 0x7f308c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.523+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f30a40891e0 con 0x7f30ac158c20 2023-09-30T13:56:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.523+0000 7f30aa59c640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 0x7f308c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.523+0000 7f30aa59c640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 0x7f308c06d020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f309c00b9f0 tx=0x7f309c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.527+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f30ac0ab250 con 0x7f30ac158c20 2023-09-30T13:56:09.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.697+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30ac0ce210 con 0x7f308c06ab60 2023-09-30T13:56:09.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.705+0000 7f30a2ffd640 1 -- 172.21.15.62:0/2207194159 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289728 (secure 0 0 0) 0x7f309c00b690 con 0x7f308c06ab60 2023-09-30T13:56:09.707 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:09.708 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:56:09.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 msgr2=0x7f308c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 0x7f308c06d020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f309c00b9f0 tx=0x7f309c008040 comp rx=0 tx=0).stop 2023-09-30T13:56:09.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 msgr2=0x7f30ac0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f30a400cae0 tx=0x7f30a400a060 comp rx=0 tx=0).stop 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 shutdown_connections 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f308c06ab60 0x7f308c06d020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30ac158c20 0x7f30ac0b0090 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30ac0cc210 0x7f30ac0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 --2- 172.21.15.62:0/2207194159 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30ac0caea0 0x7f30ac1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 >> 172.21.15.62:0/2207194159 conn(0x7f30ac06a170 msgr2=0x7f30ac070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 shutdown_connections 2023-09-30T13:56:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.708+0000 7f30b0a51640 1 -- 172.21.15.62:0/2207194159 wait complete. 2023-09-30T13:56:09.718 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-09-30T13:56:09.693209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220780,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753940,"statfs":{"total":773094113280,"available":772868034560,"internally_reserved":0,"allocated":4710400,"data_stored":2672420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.686913"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411627+0000","last_change":"2023-09-30T13:56:05.420040+0000","last_active":"2023-09-30T13:56:06.411627+0000","last_peered":"2023-09-30T13:56:06.411627+0000","last_clean":"2023-09-30T13:56:06.411627+0000","last_became_active":"2023-09-30T13:56:05.419799+0000","last_became_peered":"2023-09-30T13:56:05.419799+0000","last_unstale":"2023-09-30T13:56:06.411627+0000","last_undegraded":"2023-09-30T13:56:06.411627+0000","last_fullsized":"2023-09-30T13:56:06.411627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411410+0000","last_change":"2023-09-30T13:56:05.417471+0000","last_active":"2023-09-30T13:56:06.411410+0000","last_peered":"2023-09-30T13:56:06.411410+0000","last_clean":"2023-09-30T13:56:06.411410+0000","last_became_active":"2023-09-30T13:56:05.416791+0000","last_became_peered":"2023-09-30T13:56:05.416791+0000","last_unstale":"2023-09-30T13:56:06.411410+0000","last_undegraded":"2023-09-30T13:56:06.411410+0000","last_fullsized":"2023-09-30T13:56:06.411410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106158+0000","last_change":"2023-09-30T13:56:05.426264+0000","last_active":"2023-09-30T13:56:07.106158+0000","last_peered":"2023-09-30T13:56:07.106158+0000","last_clean":"2023-09-30T13:56:07.106158+0000","last_became_active":"2023-09-30T13:56:05.425996+0000","last_became_peered":"2023-09-30T13:56:05.425996+0000","last_unstale":"2023-09-30T13:56:07.106158+0000","last_undegraded":"2023-09-30T13:56:07.106158+0000","last_fullsized":"2023-09-30T13:56:07.106158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412164+0000","last_change":"2023-09-30T13:56:05.415699+0000","last_active":"2023-09-30T13:56:06.412164+0000","last_peered":"2023-09-30T13:56:06.412164+0000","last_clean":"2023-09-30T13:56:06.412164+0000","last_became_active":"2023-09-30T13:56:05.415434+0000","last_became_peered":"2023-09-30T13:56:05.415434+0000","last_unstale":"2023-09-30T13:56:06.412164+0000","last_undegraded":"2023-09-30T13:56:06.412164+0000","last_fullsized":"2023-09-30T13:56:06.412164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:51:29.923797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411958+0000","last_change":"2023-09-30T13:56:05.414021+0000","last_active":"2023-09-30T13:56:06.411958+0000","last_peered":"2023-09-30T13:56:06.411958+0000","last_clean":"2023-09-30T13:56:06.411958+0000","last_became_active":"2023-09-30T13:56:05.412524+0000","last_became_peered":"2023-09-30T13:56:05.412524+0000","last_unstale":"2023-09-30T13:56:06.411958+0000","last_undegraded":"2023-09-30T13:56:06.411958+0000","last_fullsized":"2023-09-30T13:56:06.411958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:07:22.395707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231454+0000","last_change":"2023-09-30T13:56:05.422130+0000","last_active":"2023-09-30T13:56:07.231454+0000","last_peered":"2023-09-30T13:56:07.231454+0000","last_clean":"2023-09-30T13:56:07.231454+0000","last_became_active":"2023-09-30T13:56:05.421855+0000","last_became_peered":"2023-09-30T13:56:05.421855+0000","last_unstale":"2023-09-30T13:56:07.231454+0000","last_undegraded":"2023-09-30T13:56:07.231454+0000","last_fullsized":"2023-09-30T13:56:07.231454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232217+0000","last_change":"2023-09-30T13:56:05.431278+0000","last_active":"2023-09-30T13:56:07.232217+0000","last_peered":"2023-09-30T13:56:07.232217+0000","last_clean":"2023-09-30T13:56:07.232217+0000","last_became_active":"2023-09-30T13:56:05.429588+0000","last_became_peered":"2023-09-30T13:56:05.429588+0000","last_unstale":"2023-09-30T13:56:07.232217+0000","last_undegraded":"2023-09-30T13:56:07.232217+0000","last_fullsized":"2023-09-30T13:56:07.232217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411112+0000","last_change":"2023-09-30T13:56:05.425541+0000","last_active":"2023-09-30T13:56:06.411112+0000","last_peered":"2023-09-30T13:56:06.411112+0000","last_clean":"2023-09-30T13:56:06.411112+0000","last_became_active":"2023-09-30T13:56:05.425266+0000","last_became_peered":"2023-09-30T13:56:05.425266+0000","last_unstale":"2023-09-30T13:56:06.411112+0000","last_undegraded":"2023-09-30T13:56:06.411112+0000","last_fullsized":"2023-09-30T13:56:06.411112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106368+0000","last_change":"2023-09-30T13:56:05.426569+0000","last_active":"2023-09-30T13:56:07.106368+0000","last_peered":"2023-09-30T13:56:07.106368+0000","last_clean":"2023-09-30T13:56:07.106368+0000","last_became_active":"2023-09-30T13:56:05.426275+0000","last_became_peered":"2023-09-30T13:56:05.426275+0000","last_unstale":"2023-09-30T13:56:07.106368+0000","last_undegraded":"2023-09-30T13:56:07.106368+0000","last_fullsized":"2023-09-30T13:56:07.106368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232736+0000","last_change":"2023-09-30T13:56:05.430304+0000","last_active":"2023-09-30T13:56:07.232736+0000","last_peered":"2023-09-30T13:56:07.232736+0000","last_clean":"2023-09-30T13:56:07.232736+0000","last_became_active":"2023-09-30T13:56:05.430014+0000","last_became_peered":"2023-09-30T13:56:05.430014+0000","last_unstale":"2023-09-30T13:56:07.232736+0000","last_undegraded":"2023-09-30T13:56:07.232736+0000","last_fullsized":"2023-09-30T13:56:07.232736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232605+0000","last_change":"2023-09-30T13:56:05.428773+0000","last_active":"2023-09-30T13:56:07.232605+0000","last_peered":"2023-09-30T13:56:07.232605+0000","last_clean":"2023-09-30T13:56:07.232605+0000","last_became_active":"2023-09-30T13:56:05.428505+0000","last_became_peered":"2023-09-30T13:56:05.428505+0000","last_unstale":"2023-09-30T13:56:07.232605+0000","last_undegraded":"2023-09-30T13:56:07.232605+0000","last_fullsized":"2023-09-30T13:56:07.232605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106147+0000","last_change":"2023-09-30T13:56:05.425127+0000","last_active":"2023-09-30T13:56:07.106147+0000","last_peered":"2023-09-30T13:56:07.106147+0000","last_clean":"2023-09-30T13:56:07.106147+0000","last_became_active":"2023-09-30T13:56:05.424756+0000","last_became_peered":"2023-09-30T13:56:05.424756+0000","last_unstale":"2023-09-30T13:56:07.106147+0000","last_undegraded":"2023-09-30T13:56:07.106147+0000","last_fullsized":"2023-09-30T13:56:07.106147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:28:55.098378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232522+0000","last_change":"2023-09-30T13:56:05.430863+0000","last_active":"2023-09-30T13:56:07.232522+0000","last_peered":"2023-09-30T13:56:07.232522+0000","last_clean":"2023-09-30T13:56:07.232522+0000","last_became_active":"2023-09-30T13:56:05.430318+0000","last_became_peered":"2023-09-30T13:56:05.430318+0000","last_unstale":"2023-09-30T13:56:07.232522+0000","last_undegraded":"2023-09-30T13:56:07.232522+0000","last_fullsized":"2023-09-30T13:56:07.232522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231695+0000","last_change":"2023-09-30T13:56:05.423606+0000","last_active":"2023-09-30T13:56:07.231695+0000","last_peered":"2023-09-30T13:56:07.231695+0000","last_clean":"2023-09-30T13:56:07.231695+0000","last_became_active":"2023-09-30T13:56:05.421905+0000","last_became_peered":"2023-09-30T13:56:05.421905+0000","last_unstale":"2023-09-30T13:56:07.231695+0000","last_undegraded":"2023-09-30T13:56:07.231695+0000","last_fullsized":"2023-09-30T13:56:07.231695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:54.420405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232309+0000","last_change":"2023-09-30T13:56:05.431457+0000","last_active":"2023-09-30T13:56:07.232309+0000","last_peered":"2023-09-30T13:56:07.232309+0000","last_clean":"2023-09-30T13:56:07.232309+0000","last_became_active":"2023-09-30T13:56:05.430721+0000","last_became_peered":"2023-09-30T13:56:05.430721+0000","last_unstale":"2023-09-30T13:56:07.232309+0000","last_undegraded":"2023-09-30T13:56:07.232309+0000","last_fullsized":"2023-09-30T13:56:07.232309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865936+0000","last_change":"2023-09-30T13:56:05.427440+0000","last_active":"2023-09-30T13:56:06.865936+0000","last_peered":"2023-09-30T13:56:06.865936+0000","last_clean":"2023-09-30T13:56:06.865936+0000","last_became_active":"2023-09-30T13:56:05.427128+0000","last_became_peered":"2023-09-30T13:56:05.427128+0000","last_unstale":"2023-09-30T13:56:06.865936+0000","last_undegraded":"2023-09-30T13:56:06.865936+0000","last_fullsized":"2023-09-30T13:56:06.865936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866384+0000","last_change":"2023-09-30T13:56:05.428154+0000","last_active":"2023-09-30T13:56:06.866384+0000","last_peered":"2023-09-30T13:56:06.866384+0000","last_clean":"2023-09-30T13:56:06.866384+0000","last_became_active":"2023-09-30T13:56:05.427819+0000","last_became_peered":"2023-09-30T13:56:05.427819+0000","last_unstale":"2023-09-30T13:56:06.866384+0000","last_undegraded":"2023-09-30T13:56:06.866384+0000","last_fullsized":"2023-09-30T13:56:06.866384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411849+0000","last_change":"2023-09-30T13:56:05.419494+0000","last_active":"2023-09-30T13:56:06.411849+0000","last_peered":"2023-09-30T13:56:06.411849+0000","last_clean":"2023-09-30T13:56:06.411849+0000","last_became_active":"2023-09-30T13:56:05.419234+0000","last_became_peered":"2023-09-30T13:56:05.419234+0000","last_unstale":"2023-09-30T13:56:06.411849+0000","last_undegraded":"2023-09-30T13:56:06.411849+0000","last_fullsized":"2023-09-30T13:56:06.411849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412242+0000","last_change":"2023-09-30T13:56:05.419551+0000","last_active":"2023-09-30T13:56:06.412242+0000","last_peered":"2023-09-30T13:56:06.412242+0000","last_clean":"2023-09-30T13:56:06.412242+0000","last_became_active":"2023-09-30T13:56:05.419278+0000","last_became_peered":"2023-09-30T13:56:05.419278+0000","last_unstale":"2023-09-30T13:56:06.412242+0000","last_undegraded":"2023-09-30T13:56:06.412242+0000","last_fullsized":"2023-09-30T13:56:06.412242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:14.958753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411632+0000","last_change":"2023-09-30T13:56:05.416952+0000","last_active":"2023-09-30T13:56:06.411632+0000","last_peered":"2023-09-30T13:56:06.411632+0000","last_clean":"2023-09-30T13:56:06.411632+0000","last_became_active":"2023-09-30T13:56:05.416698+0000","last_became_peered":"2023-09-30T13:56:05.416698+0000","last_unstale":"2023-09-30T13:56:06.411632+0000","last_undegraded":"2023-09-30T13:56:06.411632+0000","last_fullsized":"2023-09-30T13:56:06.411632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232537+0000","last_change":"2023-09-30T13:56:05.430649+0000","last_active":"2023-09-30T13:56:07.232537+0000","last_peered":"2023-09-30T13:56:07.232537+0000","last_clean":"2023-09-30T13:56:07.232537+0000","last_became_active":"2023-09-30T13:56:05.429943+0000","last_became_peered":"2023-09-30T13:56:05.429943+0000","last_unstale":"2023-09-30T13:56:07.232537+0000","last_undegraded":"2023-09-30T13:56:07.232537+0000","last_fullsized":"2023-09-30T13:56:07.232537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232458+0000","last_change":"2023-09-30T13:56:05.419088+0000","last_active":"2023-09-30T13:56:07.232458+0000","last_peered":"2023-09-30T13:56:07.232458+0000","last_clean":"2023-09-30T13:56:07.232458+0000","last_became_active":"2023-09-30T13:56:05.418821+0000","last_became_peered":"2023-09-30T13:56:05.418821+0000","last_unstale":"2023-09-30T13:56:07.232458+0000","last_undegraded":"2023-09-30T13:56:07.232458+0000","last_fullsized":"2023-09-30T13:56:07.232458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865972+0000","last_change":"2023-09-30T13:56:05.427153+0000","last_active":"2023-09-30T13:56:06.865972+0000","last_peered":"2023-09-30T13:56:06.865972+0000","last_clean":"2023-09-30T13:56:06.865972+0000","last_became_active":"2023-09-30T13:56:05.426436+0000","last_became_peered":"2023-09-30T13:56:05.426436+0000","last_unstale":"2023-09-30T13:56:06.865972+0000","last_undegraded":"2023-09-30T13:56:06.865972+0000","last_fullsized":"2023-09-30T13:56:06.865972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411911+0000","last_change":"2023-09-30T13:56:05.428121+0000","last_active":"2023-09-30T13:56:06.411911+0000","last_peered":"2023-09-30T13:56:06.411911+0000","last_clean":"2023-09-30T13:56:06.411911+0000","last_became_active":"2023-09-30T13:56:05.427891+0000","last_became_peered":"2023-09-30T13:56:05.427891+0000","last_unstale":"2023-09-30T13:56:06.411911+0000","last_undegraded":"2023-09-30T13:56:06.411911+0000","last_fullsized":"2023-09-30T13:56:06.411911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:45:27.320047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411903+0000","last_change":"2023-09-30T13:56:05.419037+0000","last_active":"2023-09-30T13:56:06.411903+0000","last_peered":"2023-09-30T13:56:06.411903+0000","last_clean":"2023-09-30T13:56:06.411903+0000","last_became_active":"2023-09-30T13:56:05.418757+0000","last_became_peered":"2023-09-30T13:56:05.418757+0000","last_unstale":"2023-09-30T13:56:06.411903+0000","last_undegraded":"2023-09-30T13:56:06.411903+0000","last_fullsized":"2023-09-30T13:56:06.411903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231619+0000","last_change":"2023-09-30T13:56:05.425990+0000","last_active":"2023-09-30T13:56:07.231619+0000","last_peered":"2023-09-30T13:56:07.231619+0000","last_clean":"2023-09-30T13:56:07.231619+0000","last_became_active":"2023-09-30T13:56:05.425677+0000","last_became_peered":"2023-09-30T13:56:05.425677+0000","last_unstale":"2023-09-30T13:56:07.231619+0000","last_undegraded":"2023-09-30T13:56:07.231619+0000","last_fullsized":"2023-09-30T13:56:07.231619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411782+0000","last_change":"2023-09-30T13:56:05.419570+0000","last_active":"2023-09-30T13:56:06.411782+0000","last_peered":"2023-09-30T13:56:06.411782+0000","last_clean":"2023-09-30T13:56:06.411782+0000","last_became_active":"2023-09-30T13:56:05.418645+0000","last_became_peered":"2023-09-30T13:56:05.418645+0000","last_unstale":"2023-09-30T13:56:06.411782+0000","last_undegraded":"2023-09-30T13:56:06.411782+0000","last_fullsized":"2023-09-30T13:56:06.411782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232462+0000","last_change":"2023-09-30T13:56:05.423744+0000","last_active":"2023-09-30T13:56:07.232462+0000","last_peered":"2023-09-30T13:56:07.232462+0000","last_clean":"2023-09-30T13:56:07.232462+0000","last_became_active":"2023-09-30T13:56:05.423457+0000","last_became_peered":"2023-09-30T13:56:05.423457+0000","last_unstale":"2023-09-30T13:56:07.232462+0000","last_undegraded":"2023-09-30T13:56:07.232462+0000","last_fullsized":"2023-09-30T13:56:07.232462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.422761+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.421999+0000","last_became_peered":"2023-09-30T13:56:05.421999+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411510+0000","last_change":"2023-09-30T13:56:05.423384+0000","last_active":"2023-09-30T13:56:06.411510+0000","last_peered":"2023-09-30T13:56:06.411510+0000","last_clean":"2023-09-30T13:56:06.411510+0000","last_became_active":"2023-09-30T13:56:05.423055+0000","last_became_peered":"2023-09-30T13:56:05.423055+0000","last_unstale":"2023-09-30T13:56:06.411510+0000","last_undegraded":"2023-09-30T13:56:06.411510+0000","last_fullsized":"2023-09-30T13:56:06.411510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866252+0000","last_change":"2023-09-30T13:56:05.427583+0000","last_active":"2023-09-30T13:56:06.866252+0000","last_peered":"2023-09-30T13:56:06.866252+0000","last_clean":"2023-09-30T13:56:06.866252+0000","last_became_active":"2023-09-30T13:56:05.426872+0000","last_became_peered":"2023-09-30T13:56:05.426872+0000","last_unstale":"2023-09-30T13:56:06.866252+0000","last_undegraded":"2023-09-30T13:56:06.866252+0000","last_fullsized":"2023-09-30T13:56:06.866252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:24:15.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231455+0000","last_change":"2023-09-30T13:56:05.424956+0000","last_active":"2023-09-30T13:56:07.231455+0000","last_peered":"2023-09-30T13:56:07.231455+0000","last_clean":"2023-09-30T13:56:07.231455+0000","last_became_active":"2023-09-30T13:56:05.424699+0000","last_became_peered":"2023-09-30T13:56:05.424699+0000","last_unstale":"2023-09-30T13:56:07.231455+0000","last_undegraded":"2023-09-30T13:56:07.231455+0000","last_fullsized":"2023-09-30T13:56:07.231455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866303+0000","last_change":"2023-09-30T13:56:05.428142+0000","last_active":"2023-09-30T13:56:06.866303+0000","last_peered":"2023-09-30T13:56:06.866303+0000","last_clean":"2023-09-30T13:56:06.866303+0000","last_became_active":"2023-09-30T13:56:05.427802+0000","last_became_peered":"2023-09-30T13:56:05.427802+0000","last_unstale":"2023-09-30T13:56:06.866303+0000","last_undegraded":"2023-09-30T13:56:06.866303+0000","last_fullsized":"2023-09-30T13:56:06.866303+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411916+0000","last_change":"2023-09-30T13:56:05.018389+0000","last_active":"2023-09-30T13:56:06.411916+0000","last_peered":"2023-09-30T13:56:06.411916+0000","last_clean":"2023-09-30T13:56:06.411916+0000","last_became_active":"2023-09-30T13:56:05.018132+0000","last_became_peered":"2023-09-30T13:56:05.018132+0000","last_unstale":"2023-09-30T13:56:06.411916+0000","last_undegraded":"2023-09-30T13:56:06.411916+0000","last_fullsized":"2023-09-30T13:56:06.411916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231801+0000","last_change":"2023-09-30T13:56:05.425856+0000","last_active":"2023-09-30T13:56:07.231801+0000","last_peered":"2023-09-30T13:56:07.231801+0000","last_clean":"2023-09-30T13:56:07.231801+0000","last_became_active":"2023-09-30T13:56:05.425581+0000","last_became_peered":"2023-09-30T13:56:05.425581+0000","last_unstale":"2023-09-30T13:56:07.231801+0000","last_undegraded":"2023-09-30T13:56:07.231801+0000","last_fullsized":"2023-09-30T13:56:07.231801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106273+0000","last_change":"2023-09-30T13:56:05.027198+0000","last_active":"2023-09-30T13:56:07.106273+0000","last_peered":"2023-09-30T13:56:07.106273+0000","last_clean":"2023-09-30T13:56:07.106273+0000","last_became_active":"2023-09-30T13:56:05.026910+0000","last_became_peered":"2023-09-30T13:56:05.026910+0000","last_unstale":"2023-09-30T13:56:07.106273+0000","last_undegraded":"2023-09-30T13:56:07.106273+0000","last_fullsized":"2023-09-30T13:56:07.106273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232148+0000","last_change":"2023-09-30T13:56:05.420489+0000","last_active":"2023-09-30T13:56:07.232148+0000","last_peered":"2023-09-30T13:56:07.232148+0000","last_clean":"2023-09-30T13:56:07.232148+0000","last_became_active":"2023-09-30T13:56:05.420207+0000","last_became_peered":"2023-09-30T13:56:05.420207+0000","last_unstale":"2023-09-30T13:56:07.232148+0000","last_undegraded":"2023-09-30T13:56:07.232148+0000","last_fullsized":"2023-09-30T13:56:07.232148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231779+0000","last_change":"2023-09-30T13:56:05.022903+0000","last_active":"2023-09-30T13:56:07.231779+0000","last_peered":"2023-09-30T13:56:07.231779+0000","last_clean":"2023-09-30T13:56:07.231779+0000","last_became_active":"2023-09-30T13:56:05.022613+0000","last_became_peered":"2023-09-30T13:56:05.022613+0000","last_unstale":"2023-09-30T13:56:07.231779+0000","last_undegraded":"2023-09-30T13:56:07.231779+0000","last_fullsized":"2023-09-30T13:56:07.231779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.423430+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.423127+0000","last_became_peered":"2023-09-30T13:56:05.423127+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231952+0000","last_change":"2023-09-30T13:56:05.023831+0000","last_active":"2023-09-30T13:56:07.231952+0000","last_peered":"2023-09-30T13:56:07.231952+0000","last_clean":"2023-09-30T13:56:07.231952+0000","last_became_active":"2023-09-30T13:56:05.023571+0000","last_became_peered":"2023-09-30T13:56:05.023571+0000","last_unstale":"2023-09-30T13:56:07.231952+0000","last_undegraded":"2023-09-30T13:56:07.231952+0000","last_fullsized":"2023-09-30T13:56:07.231952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106034+0000","last_change":"2023-09-30T13:56:05.420452+0000","last_active":"2023-09-30T13:56:07.106034+0000","last_peered":"2023-09-30T13:56:07.106034+0000","last_clean":"2023-09-30T13:56:07.106034+0000","last_became_active":"2023-09-30T13:56:05.420204+0000","last_became_peered":"2023-09-30T13:56:05.420204+0000","last_unstale":"2023-09-30T13:56:07.106034+0000","last_undegraded":"2023-09-30T13:56:07.106034+0000","last_fullsized":"2023-09-30T13:56:07.106034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232629+0000","last_change":"2023-09-30T13:56:05.023750+0000","last_active":"2023-09-30T13:56:07.232629+0000","last_peered":"2023-09-30T13:56:07.232629+0000","last_clean":"2023-09-30T13:56:07.232629+0000","last_became_active":"2023-09-30T13:56:05.023475+0000","last_became_peered":"2023-09-30T13:56:05.023475+0000","last_unstale":"2023-09-30T13:56:07.232629+0000","last_undegraded":"2023-09-30T13:56:07.232629+0000","last_fullsized":"2023-09-30T13:56:07.232629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:05.152067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232366+0000","last_change":"2023-09-30T13:56:05.425132+0000","last_active":"2023-09-30T13:56:07.232366+0000","last_peered":"2023-09-30T13:56:07.232366+0000","last_clean":"2023-09-30T13:56:07.232366+0000","last_became_active":"2023-09-30T13:56:05.424796+0000","last_became_peered":"2023-09-30T13:56:05.424796+0000","last_unstale":"2023-09-30T13:56:07.232366+0000","last_undegraded":"2023-09-30T13:56:07.232366+0000","last_fullsized":"2023-09-30T13:56:07.232366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866074+0000","last_change":"2023-09-30T13:56:05.031611+0000","last_active":"2023-09-30T13:56:06.866074+0000","last_peered":"2023-09-30T13:56:06.866074+0000","last_clean":"2023-09-30T13:56:06.866074+0000","last_became_active":"2023-09-30T13:56:05.031229+0000","last_became_peered":"2023-09-30T13:56:05.031229+0000","last_unstale":"2023-09-30T13:56:06.866074+0000","last_undegraded":"2023-09-30T13:56:06.866074+0000","last_fullsized":"2023-09-30T13:56:06.866074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232315+0000","last_change":"2023-09-30T13:56:05.425565+0000","last_active":"2023-09-30T13:56:07.232315+0000","last_peered":"2023-09-30T13:56:07.232315+0000","last_clean":"2023-09-30T13:56:07.232315+0000","last_became_active":"2023-09-30T13:56:05.425288+0000","last_became_peered":"2023-09-30T13:56:05.425288+0000","last_unstale":"2023-09-30T13:56:07.232315+0000","last_undegraded":"2023-09-30T13:56:07.232315+0000","last_fullsized":"2023-09-30T13:56:07.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231618+0000","last_change":"2023-09-30T13:56:05.024829+0000","last_active":"2023-09-30T13:56:07.231618+0000","last_peered":"2023-09-30T13:56:07.231618+0000","last_clean":"2023-09-30T13:56:07.231618+0000","last_became_active":"2023-09-30T13:56:05.024568+0000","last_became_peered":"2023-09-30T13:56:05.024568+0000","last_unstale":"2023-09-30T13:56:07.231618+0000","last_undegraded":"2023-09-30T13:56:07.231618+0000","last_fullsized":"2023-09-30T13:56:07.231618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411265+0000","last_change":"2023-09-30T13:56:05.429283+0000","last_active":"2023-09-30T13:56:06.411265+0000","last_peered":"2023-09-30T13:56:06.411265+0000","last_clean":"2023-09-30T13:56:06.411265+0000","last_became_active":"2023-09-30T13:56:05.428988+0000","last_became_peered":"2023-09-30T13:56:05.428988+0000","last_unstale":"2023-09-30T13:56:06.411265+0000","last_undegraded":"2023-09-30T13:56:06.411265+0000","last_fullsized":"2023-09-30T13:56:06.411265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231642+0000","last_change":"2023-09-30T13:56:05.020445+0000","last_active":"2023-09-30T13:56:07.231642+0000","last_peered":"2023-09-30T13:56:07.231642+0000","last_clean":"2023-09-30T13:56:07.231642+0000","last_became_active":"2023-09-30T13:56:05.020184+0000","last_became_peered":"2023-09-30T13:56:05.020184+0000","last_unstale":"2023-09-30T13:56:07.231642+0000","last_undegraded":"2023-09-30T13:56:07.231642+0000","last_fullsized":"2023-09-30T13:56:07.231642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412227+0000","last_change":"2023-09-30T13:56:05.413074+0000","last_active":"2023-09-30T13:56:06.412227+0000","last_peered":"2023-09-30T13:56:06.412227+0000","last_clean":"2023-09-30T13:56:06.412227+0000","last_became_active":"2023-09-30T13:56:05.412825+0000","last_became_peered":"2023-09-30T13:56:05.412825+0000","last_unstale":"2023-09-30T13:56:06.412227+0000","last_undegraded":"2023-09-30T13:56:06.412227+0000","last_fullsized":"2023-09-30T13:56:06.412227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:15:57.774218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411698+0000","last_change":"2023-09-30T13:56:05.024356+0000","last_active":"2023-09-30T13:56:06.411698+0000","last_peered":"2023-09-30T13:56:06.411698+0000","last_clean":"2023-09-30T13:56:06.411698+0000","last_became_active":"2023-09-30T13:56:05.024047+0000","last_became_peered":"2023-09-30T13:56:05.024047+0000","last_unstale":"2023-09-30T13:56:06.411698+0000","last_undegraded":"2023-09-30T13:56:06.411698+0000","last_fullsized":"2023-09-30T13:56:06.411698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866427+0000","last_change":"2023-09-30T13:56:05.427700+0000","last_active":"2023-09-30T13:56:06.866427+0000","last_peered":"2023-09-30T13:56:06.866427+0000","last_clean":"2023-09-30T13:56:06.866427+0000","last_became_active":"2023-09-30T13:56:05.427183+0000","last_became_peered":"2023-09-30T13:56:05.427183+0000","last_unstale":"2023-09-30T13:56:06.866427+0000","last_undegraded":"2023-09-30T13:56:06.866427+0000","last_fullsized":"2023-09-30T13:56:06.866427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232936+0000","last_change":"2023-09-30T13:56:05.026290+0000","last_active":"2023-09-30T13:56:07.232936+0000","last_peered":"2023-09-30T13:56:07.232936+0000","last_clean":"2023-09-30T13:56:07.232936+0000","last_became_active":"2023-09-30T13:56:05.025969+0000","last_became_peered":"2023-09-30T13:56:05.025969+0000","last_unstale":"2023-09-30T13:56:07.232936+0000","last_undegraded":"2023-09-30T13:56:07.232936+0000","last_fullsized":"2023-09-30T13:56:07.232936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:17.133231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106286+0000","last_change":"2023-09-30T13:56:05.427209+0000","last_active":"2023-09-30T13:56:07.106286+0000","last_peered":"2023-09-30T13:56:07.106286+0000","last_clean":"2023-09-30T13:56:07.106286+0000","last_became_active":"2023-09-30T13:56:05.426884+0000","last_became_peered":"2023-09-30T13:56:05.426884+0000","last_unstale":"2023-09-30T13:56:07.106286+0000","last_undegraded":"2023-09-30T13:56:07.106286+0000","last_fullsized":"2023-09-30T13:56:07.106286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232661+0000","last_change":"2023-09-30T13:56:05.027961+0000","last_active":"2023-09-30T13:56:07.232661+0000","last_peered":"2023-09-30T13:56:07.232661+0000","last_clean":"2023-09-30T13:56:07.232661+0000","last_became_active":"2023-09-30T13:56:05.027693+0000","last_became_peered":"2023-09-30T13:56:05.027693+0000","last_unstale":"2023-09-30T13:56:07.232661+0000","last_undegraded":"2023-09-30T13:56:07.232661+0000","last_fullsized":"2023-09-30T13:56:07.232661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232080+0000","last_change":"2023-09-30T13:56:05.417132+0000","last_active":"2023-09-30T13:56:07.232080+0000","last_peered":"2023-09-30T13:56:07.232080+0000","last_clean":"2023-09-30T13:56:07.232080+0000","last_became_active":"2023-09-30T13:56:05.416832+0000","last_became_peered":"2023-09-30T13:56:05.416832+0000","last_unstale":"2023-09-30T13:56:07.232080+0000","last_undegraded":"2023-09-30T13:56:07.232080+0000","last_fullsized":"2023-09-30T13:56:07.232080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411487+0000","last_change":"2023-09-30T13:56:05.027519+0000","last_active":"2023-09-30T13:56:06.411487+0000","last_peered":"2023-09-30T13:56:06.411487+0000","last_clean":"2023-09-30T13:56:06.411487+0000","last_became_active":"2023-09-30T13:56:05.027240+0000","last_became_peered":"2023-09-30T13:56:05.027240+0000","last_unstale":"2023-09-30T13:56:06.411487+0000","last_undegraded":"2023-09-30T13:56:06.411487+0000","last_fullsized":"2023-09-30T13:56:06.411487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106081+0000","last_change":"2023-09-30T13:56:05.425318+0000","last_active":"2023-09-30T13:56:07.106081+0000","last_peered":"2023-09-30T13:56:07.106081+0000","last_clean":"2023-09-30T13:56:07.106081+0000","last_became_active":"2023-09-30T13:56:05.425067+0000","last_became_peered":"2023-09-30T13:56:05.425067+0000","last_unstale":"2023-09-30T13:56:07.106081+0000","last_undegraded":"2023-09-30T13:56:07.106081+0000","last_fullsized":"2023-09-30T13:56:07.106081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411486+0000","last_change":"2023-09-30T13:56:05.024545+0000","last_active":"2023-09-30T13:56:06.411486+0000","last_peered":"2023-09-30T13:56:06.411486+0000","last_clean":"2023-09-30T13:56:06.411486+0000","last_became_active":"2023-09-30T13:56:05.024255+0000","last_became_peered":"2023-09-30T13:56:05.024255+0000","last_unstale":"2023-09-30T13:56:06.411486+0000","last_undegraded":"2023-09-30T13:56:06.411486+0000","last_fullsized":"2023-09-30T13:56:06.411486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411300+0000","last_change":"2023-09-30T13:56:05.417483+0000","last_active":"2023-09-30T13:56:06.411300+0000","last_peered":"2023-09-30T13:56:06.411300+0000","last_clean":"2023-09-30T13:56:06.411300+0000","last_became_active":"2023-09-30T13:56:05.417154+0000","last_became_peered":"2023-09-30T13:56:05.417154+0000","last_unstale":"2023-09-30T13:56:06.411300+0000","last_undegraded":"2023-09-30T13:56:06.411300+0000","last_fullsized":"2023-09-30T13:56:06.411300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.024208+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.023897+0000","last_became_peered":"2023-09-30T13:56:05.023897+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866073+0000","last_change":"2023-09-30T13:56:05.425530+0000","last_active":"2023-09-30T13:56:06.866073+0000","last_peered":"2023-09-30T13:56:06.866073+0000","last_clean":"2023-09-30T13:56:06.866073+0000","last_became_active":"2023-09-30T13:56:05.425267+0000","last_became_peered":"2023-09-30T13:56:05.425267+0000","last_unstale":"2023-09-30T13:56:06.866073+0000","last_undegraded":"2023-09-30T13:56:06.866073+0000","last_fullsized":"2023-09-30T13:56:06.866073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411404+0000","last_change":"2023-09-30T13:56:05.019981+0000","last_active":"2023-09-30T13:56:06.411404+0000","last_peered":"2023-09-30T13:56:06.411404+0000","last_clean":"2023-09-30T13:56:06.411404+0000","last_became_active":"2023-09-30T13:56:05.019707+0000","last_became_peered":"2023-09-30T13:56:05.019707+0000","last_unstale":"2023-09-30T13:56:06.411404+0000","last_undegraded":"2023-09-30T13:56:06.411404+0000","last_fullsized":"2023-09-30T13:56:06.411404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411406+0000","last_change":"2023-09-30T13:56:05.418328+0000","last_active":"2023-09-30T13:56:06.411406+0000","last_peered":"2023-09-30T13:56:06.411406+0000","last_clean":"2023-09-30T13:56:06.411406+0000","last_became_active":"2023-09-30T13:56:05.417615+0000","last_became_peered":"2023-09-30T13:56:05.417615+0000","last_unstale":"2023-09-30T13:56:06.411406+0000","last_undegraded":"2023-09-30T13:56:06.411406+0000","last_fullsized":"2023-09-30T13:56:06.411406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865931+0000","last_change":"2023-09-30T13:56:05.031440+0000","last_active":"2023-09-30T13:56:06.865931+0000","last_peered":"2023-09-30T13:56:06.865931+0000","last_clean":"2023-09-30T13:56:06.865931+0000","last_became_active":"2023-09-30T13:56:05.031110+0000","last_became_peered":"2023-09-30T13:56:05.031110+0000","last_unstale":"2023-09-30T13:56:06.865931+0000","last_undegraded":"2023-09-30T13:56:06.865931+0000","last_fullsized":"2023-09-30T13:56:06.865931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411452+0000","last_change":"2023-09-30T13:56:05.423405+0000","last_active":"2023-09-30T13:56:06.411452+0000","last_peered":"2023-09-30T13:56:06.411452+0000","last_clean":"2023-09-30T13:56:06.411452+0000","last_became_active":"2023-09-30T13:56:05.423132+0000","last_became_peered":"2023-09-30T13:56:05.423132+0000","last_unstale":"2023-09-30T13:56:06.411452+0000","last_undegraded":"2023-09-30T13:56:06.411452+0000","last_fullsized":"2023-09-30T13:56:06.411452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233017+0000","last_change":"2023-09-30T13:56:05.023723+0000","last_active":"2023-09-30T13:56:07.233017+0000","last_peered":"2023-09-30T13:56:07.233017+0000","last_clean":"2023-09-30T13:56:07.233017+0000","last_became_active":"2023-09-30T13:56:05.023454+0000","last_became_peered":"2023-09-30T13:56:05.023454+0000","last_unstale":"2023-09-30T13:56:07.233017+0000","last_undegraded":"2023-09-30T13:56:07.233017+0000","last_fullsized":"2023-09-30T13:56:07.233017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232596+0000","last_change":"2023-09-30T13:56:05.431567+0000","last_active":"2023-09-30T13:56:07.232596+0000","last_peered":"2023-09-30T13:56:07.232596+0000","last_clean":"2023-09-30T13:56:07.232596+0000","last_became_active":"2023-09-30T13:56:05.431246+0000","last_became_peered":"2023-09-30T13:56:05.431246+0000","last_unstale":"2023-09-30T13:56:07.232596+0000","last_undegraded":"2023-09-30T13:56:07.232596+0000","last_fullsized":"2023-09-30T13:56:07.232596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232264+0000","last_change":"2023-09-30T13:56:05.024797+0000","last_active":"2023-09-30T13:56:07.232264+0000","last_peered":"2023-09-30T13:56:07.232264+0000","last_clean":"2023-09-30T13:56:07.232264+0000","last_became_active":"2023-09-30T13:56:05.024377+0000","last_became_peered":"2023-09-30T13:56:05.024377+0000","last_unstale":"2023-09-30T13:56:07.232264+0000","last_undegraded":"2023-09-30T13:56:07.232264+0000","last_fullsized":"2023-09-30T13:56:07.232264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:48:03.565686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232086+0000","last_change":"2023-09-30T13:56:05.418093+0000","last_active":"2023-09-30T13:56:07.232086+0000","last_peered":"2023-09-30T13:56:07.232086+0000","last_clean":"2023-09-30T13:56:07.232086+0000","last_became_active":"2023-09-30T13:56:05.417749+0000","last_became_peered":"2023-09-30T13:56:05.417749+0000","last_unstale":"2023-09-30T13:56:07.232086+0000","last_undegraded":"2023-09-30T13:56:07.232086+0000","last_fullsized":"2023-09-30T13:56:07.232086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412257+0000","last_change":"2023-09-30T13:56:05.026612+0000","last_active":"2023-09-30T13:56:06.412257+0000","last_peered":"2023-09-30T13:56:06.412257+0000","last_clean":"2023-09-30T13:56:06.412257+0000","last_became_active":"2023-09-30T13:56:05.026286+0000","last_became_peered":"2023-09-30T13:56:05.026286+0000","last_unstale":"2023-09-30T13:56:06.412257+0000","last_undegraded":"2023-09-30T13:56:06.412257+0000","last_fullsized":"2023-09-30T13:56:06.412257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:28:14.007134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412124+0000","last_change":"2023-09-30T13:56:05.417529+0000","last_active":"2023-09-30T13:56:06.412124+0000","last_peered":"2023-09-30T13:56:06.412124+0000","last_clean":"2023-09-30T13:56:06.412124+0000","last_became_active":"2023-09-30T13:56:05.417268+0000","last_became_peered":"2023-09-30T13:56:05.417268+0000","last_unstale":"2023-09-30T13:56:06.412124+0000","last_undegraded":"2023-09-30T13:56:06.412124+0000","last_fullsized":"2023-09-30T13:56:06.412124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:05:43.691463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.026479+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.026207+0000","last_became_peered":"2023-09-30T13:56:05.026207+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:47.241082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866185+0000","last_change":"2023-09-30T13:56:05.430870+0000","last_active":"2023-09-30T13:56:06.866185+0000","last_peered":"2023-09-30T13:56:06.866185+0000","last_clean":"2023-09-30T13:56:06.866185+0000","last_became_active":"2023-09-30T13:56:05.430516+0000","last_became_peered":"2023-09-30T13:56:05.430516+0000","last_unstale":"2023-09-30T13:56:06.866185+0000","last_undegraded":"2023-09-30T13:56:06.866185+0000","last_fullsized":"2023-09-30T13:56:06.866185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412054+0000","last_change":"2023-09-30T13:56:05.020968+0000","last_active":"2023-09-30T13:56:06.412054+0000","last_peered":"2023-09-30T13:56:06.412054+0000","last_clean":"2023-09-30T13:56:06.412054+0000","last_became_active":"2023-09-30T13:56:05.020698+0000","last_became_peered":"2023-09-30T13:56:05.020698+0000","last_unstale":"2023-09-30T13:56:06.412054+0000","last_undegraded":"2023-09-30T13:56:06.412054+0000","last_fullsized":"2023-09-30T13:56:06.412054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:35.380176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106059+0000","last_change":"2023-09-30T13:56:05.429248+0000","last_active":"2023-09-30T13:56:07.106059+0000","last_peered":"2023-09-30T13:56:07.106059+0000","last_clean":"2023-09-30T13:56:07.106059+0000","last_became_active":"2023-09-30T13:56:05.428978+0000","last_became_peered":"2023-09-30T13:56:05.428978+0000","last_unstale":"2023-09-30T13:56:07.106059+0000","last_undegraded":"2023-09-30T13:56:07.106059+0000","last_fullsized":"2023-09-30T13:56:07.106059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412016+0000","last_change":"2023-09-30T13:56:05.017181+0000","last_active":"2023-09-30T13:56:06.412016+0000","last_peered":"2023-09-30T13:56:06.412016+0000","last_clean":"2023-09-30T13:56:06.412016+0000","last_became_active":"2023-09-30T13:56:05.016888+0000","last_became_peered":"2023-09-30T13:56:05.016888+0000","last_unstale":"2023-09-30T13:56:06.412016+0000","last_undegraded":"2023-09-30T13:56:06.412016+0000","last_fullsized":"2023-09-30T13:56:06.412016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:14:10.079773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232168+0000","last_change":"2023-09-30T13:56:05.424901+0000","last_active":"2023-09-30T13:56:07.232168+0000","last_peered":"2023-09-30T13:56:07.232168+0000","last_clean":"2023-09-30T13:56:07.232168+0000","last_became_active":"2023-09-30T13:56:05.424606+0000","last_became_peered":"2023-09-30T13:56:05.424606+0000","last_unstale":"2023-09-30T13:56:07.232168+0000","last_undegraded":"2023-09-30T13:56:07.232168+0000","last_fullsized":"2023-09-30T13:56:07.232168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866080+0000","last_change":"2023-09-30T13:56:05.031024+0000","last_active":"2023-09-30T13:56:06.866080+0000","last_peered":"2023-09-30T13:56:06.866080+0000","last_clean":"2023-09-30T13:56:06.866080+0000","last_became_active":"2023-09-30T13:56:05.030761+0000","last_became_peered":"2023-09-30T13:56:05.030761+0000","last_unstale":"2023-09-30T13:56:06.866080+0000","last_undegraded":"2023-09-30T13:56:06.866080+0000","last_fullsized":"2023-09-30T13:56:06.866080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:22.715731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411395+0000","last_change":"2023-09-30T13:56:05.427427+0000","last_active":"2023-09-30T13:56:06.411395+0000","last_peered":"2023-09-30T13:56:06.411395+0000","last_clean":"2023-09-30T13:56:06.411395+0000","last_became_active":"2023-09-30T13:56:05.427197+0000","last_became_peered":"2023-09-30T13:56:05.427197+0000","last_unstale":"2023-09-30T13:56:06.411395+0000","last_undegraded":"2023-09-30T13:56:06.411395+0000","last_fullsized":"2023-09-30T13:56:06.411395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411780+0000","last_change":"2023-09-30T13:56:05.018322+0000","last_active":"2023-09-30T13:56:06.411780+0000","last_peered":"2023-09-30T13:56:06.411780+0000","last_clean":"2023-09-30T13:56:06.411780+0000","last_became_active":"2023-09-30T13:56:05.018041+0000","last_became_peered":"2023-09-30T13:56:05.018041+0000","last_unstale":"2023-09-30T13:56:06.411780+0000","last_undegraded":"2023-09-30T13:56:06.411780+0000","last_fullsized":"2023-09-30T13:56:06.411780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:27:16.924592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231539+0000","last_change":"2023-09-30T13:56:05.429919+0000","last_active":"2023-09-30T13:56:07.231539+0000","last_peered":"2023-09-30T13:56:07.231539+0000","last_clean":"2023-09-30T13:56:07.231539+0000","last_became_active":"2023-09-30T13:56:05.429685+0000","last_became_peered":"2023-09-30T13:56:05.429685+0000","last_unstale":"2023-09-30T13:56:07.231539+0000","last_undegraded":"2023-09-30T13:56:07.231539+0000","last_fullsized":"2023-09-30T13:56:07.231539+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233086+0000","last_change":"2023-09-30T13:56:05.027919+0000","last_active":"2023-09-30T13:56:07.233086+0000","last_peered":"2023-09-30T13:56:07.233086+0000","last_clean":"2023-09-30T13:56:07.233086+0000","last_became_active":"2023-09-30T13:56:05.027642+0000","last_became_peered":"2023-09-30T13:56:05.027642+0000","last_unstale":"2023-09-30T13:56:07.233086+0000","last_undegraded":"2023-09-30T13:56:07.233086+0000","last_fullsized":"2023-09-30T13:56:07.233086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866446+0000","last_change":"2023-09-30T13:56:05.428015+0000","last_active":"2023-09-30T13:56:06.866446+0000","last_peered":"2023-09-30T13:56:06.866446+0000","last_clean":"2023-09-30T13:56:06.866446+0000","last_became_active":"2023-09-30T13:56:05.427521+0000","last_became_peered":"2023-09-30T13:56:05.427521+0000","last_unstale":"2023-09-30T13:56:06.866446+0000","last_undegraded":"2023-09-30T13:56:06.866446+0000","last_fullsized":"2023-09-30T13:56:06.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412076+0000","last_change":"2023-09-30T13:56:05.026091+0000","last_active":"2023-09-30T13:56:06.412076+0000","last_peered":"2023-09-30T13:56:06.412076+0000","last_clean":"2023-09-30T13:56:06.412076+0000","last_became_active":"2023-09-30T13:56:05.025797+0000","last_became_peered":"2023-09-30T13:56:05.025797+0000","last_unstale":"2023-09-30T13:56:06.412076+0000","last_undegraded":"2023-09-30T13:56:06.412076+0000","last_fullsized":"2023-09-30T13:56:06.412076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:57:45.773605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411521+0000","last_change":"2023-09-30T13:56:05.418019+0000","last_active":"2023-09-30T13:56:06.411521+0000","last_peered":"2023-09-30T13:56:06.411521+0000","last_clean":"2023-09-30T13:56:06.411521+0000","last_became_active":"2023-09-30T13:56:05.417721+0000","last_became_peered":"2023-09-30T13:56:05.417721+0000","last_unstale":"2023-09-30T13:56:06.411521+0000","last_undegraded":"2023-09-30T13:56:06.411521+0000","last_fullsized":"2023-09-30T13:56:06.411521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106159+0000","last_change":"2023-09-30T13:56:05.029178+0000","last_active":"2023-09-30T13:56:07.106159+0000","last_peered":"2023-09-30T13:56:07.106159+0000","last_clean":"2023-09-30T13:56:07.106159+0000","last_became_active":"2023-09-30T13:56:05.028931+0000","last_became_peered":"2023-09-30T13:56:05.028931+0000","last_unstale":"2023-09-30T13:56:07.106159+0000","last_undegraded":"2023-09-30T13:56:07.106159+0000","last_fullsized":"2023-09-30T13:56:07.106159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106209+0000","last_change":"2023-09-30T13:56:05.419085+0000","last_active":"2023-09-30T13:56:07.106209+0000","last_peered":"2023-09-30T13:56:07.106209+0000","last_clean":"2023-09-30T13:56:07.106209+0000","last_became_active":"2023-09-30T13:56:05.418848+0000","last_became_peered":"2023-09-30T13:56:05.418848+0000","last_unstale":"2023-09-30T13:56:07.106209+0000","last_undegraded":"2023-09-30T13:56:07.106209+0000","last_fullsized":"2023-09-30T13:56:07.106209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106349+0000","last_change":"2023-09-30T13:56:05.027449+0000","last_active":"2023-09-30T13:56:07.106349+0000","last_peered":"2023-09-30T13:56:07.106349+0000","last_clean":"2023-09-30T13:56:07.106349+0000","last_became_active":"2023-09-30T13:56:05.026839+0000","last_became_peered":"2023-09-30T13:56:05.026839+0000","last_unstale":"2023-09-30T13:56:07.106349+0000","last_undegraded":"2023-09-30T13:56:07.106349+0000","last_fullsized":"2023-09-30T13:56:07.106349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231609+0000","last_change":"2023-09-30T13:56:05.425626+0000","last_active":"2023-09-30T13:56:07.231609+0000","last_peered":"2023-09-30T13:56:07.231609+0000","last_clean":"2023-09-30T13:56:07.231609+0000","last_became_active":"2023-09-30T13:56:05.425145+0000","last_became_peered":"2023-09-30T13:56:05.425145+0000","last_unstale":"2023-09-30T13:56:07.231609+0000","last_undegraded":"2023-09-30T13:56:07.231609+0000","last_fullsized":"2023-09-30T13:56:07.231609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411524+0000","last_change":"2023-09-30T13:56:05.023063+0000","last_active":"2023-09-30T13:56:06.411524+0000","last_peered":"2023-09-30T13:56:06.411524+0000","last_clean":"2023-09-30T13:56:06.411524+0000","last_became_active":"2023-09-30T13:56:05.022761+0000","last_became_peered":"2023-09-30T13:56:05.022761+0000","last_unstale":"2023-09-30T13:56:06.411524+0000","last_undegraded":"2023-09-30T13:56:06.411524+0000","last_fullsized":"2023-09-30T13:56:06.411524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232039+0000","last_change":"2023-09-30T13:56:05.416330+0000","last_active":"2023-09-30T13:56:07.232039+0000","last_peered":"2023-09-30T13:56:07.232039+0000","last_clean":"2023-09-30T13:56:07.232039+0000","last_became_active":"2023-09-30T13:56:05.415996+0000","last_became_peered":"2023-09-30T13:56:05.415996+0000","last_unstale":"2023-09-30T13:56:07.232039+0000","last_undegraded":"2023-09-30T13:56:07.232039+0000","last_fullsized":"2023-09-30T13:56:07.232039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:57.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231616+0000","last_change":"2023-09-30T13:56:05.026762+0000","last_active":"2023-09-30T13:56:07.231616+0000","last_peered":"2023-09-30T13:56:07.231616+0000","last_clean":"2023-09-30T13:56:07.231616+0000","last_became_active":"2023-09-30T13:56:05.025474+0000","last_became_peered":"2023-09-30T13:56:05.025474+0000","last_unstale":"2023-09-30T13:56:07.231616+0000","last_undegraded":"2023-09-30T13:56:07.231616+0000","last_fullsized":"2023-09-30T13:56:07.231616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:03.717220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866423+0000","last_change":"2023-09-30T13:56:05.427573+0000","last_active":"2023-09-30T13:56:06.866423+0000","last_peered":"2023-09-30T13:56:06.866423+0000","last_clean":"2023-09-30T13:56:06.866423+0000","last_became_active":"2023-09-30T13:56:05.427099+0000","last_became_peered":"2023-09-30T13:56:05.427099+0000","last_unstale":"2023-09-30T13:56:06.866423+0000","last_undegraded":"2023-09-30T13:56:06.866423+0000","last_fullsized":"2023-09-30T13:56:06.866423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411122+0000","last_change":"2023-09-30T13:56:05.018971+0000","last_active":"2023-09-30T13:56:06.411122+0000","last_peered":"2023-09-30T13:56:06.411122+0000","last_clean":"2023-09-30T13:56:06.411122+0000","last_became_active":"2023-09-30T13:56:05.018657+0000","last_became_peered":"2023-09-30T13:56:05.018657+0000","last_unstale":"2023-09-30T13:56:06.411122+0000","last_undegraded":"2023-09-30T13:56:06.411122+0000","last_fullsized":"2023-09-30T13:56:06.411122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232981+0000","last_change":"2023-09-30T13:56:05.429413+0000","last_active":"2023-09-30T13:56:07.232981+0000","last_peered":"2023-09-30T13:56:07.232981+0000","last_clean":"2023-09-30T13:56:07.232981+0000","last_became_active":"2023-09-30T13:56:05.429084+0000","last_became_peered":"2023-09-30T13:56:05.429084+0000","last_unstale":"2023-09-30T13:56:07.232981+0000","last_undegraded":"2023-09-30T13:56:07.232981+0000","last_fullsized":"2023-09-30T13:56:07.232981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:58:09.108273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866162+0000","last_change":"2023-09-30T13:56:05.032091+0000","last_active":"2023-09-30T13:56:06.866162+0000","last_peered":"2023-09-30T13:56:06.866162+0000","last_clean":"2023-09-30T13:56:06.866162+0000","last_became_active":"2023-09-30T13:56:05.031821+0000","last_became_peered":"2023-09-30T13:56:05.031821+0000","last_unstale":"2023-09-30T13:56:06.866162+0000","last_undegraded":"2023-09-30T13:56:06.866162+0000","last_fullsized":"2023-09-30T13:56:06.866162+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-30T13:56:05.417519+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:56:05.417519+0000","last_peered":"2023-09-30T13:56:05.417519+0000","last_clean":"2023-09-30T13:56:05.417519+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:56:05.417519+0000","last_undegraded":"2023-09-30T13:56:05.417519+0000","last_fullsized":"2023-09-30T13:56:05.417519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":781218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.378}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.621}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":183152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.42699999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":190814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.629}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.38}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.378}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.497}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.432},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.48199999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":772950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.623},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:56:09.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T13:56:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.864+0000 7fe87a409640 1 Processor -- start 2023-09-30T13:56:09.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.864+0000 7fe87a409640 1 -- start start 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe87a409640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cdc20 0x7fe8740b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe87a409640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8740b2940 0x7fe8740cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe87a409640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740b2e50 con 0x7fe8740cef70 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe87a409640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740cf400 con 0x7fe8740b2940 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe87a409640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740ac2d0 con 0x7fe8740cdc20 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8737fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8740b2940 0x7fe8740cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8789a6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe8740cef70 0x7fe8740ab250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55436/0 (socket says 172.21.15.62:55436) 2023-09-30T13:56:09.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8789a6640 1 -- 172.21.15.62:0/1713432997 learned_addr learned my addr 172.21.15.62:0/1713432997 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe873fff640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cdc20 0x7fe8740b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8737fe640 1 -- 172.21.15.62:0/1713432997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cdc20 msgr2=0x7fe8740b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8737fe640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cdc20 0x7fe8740b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8737fe640 1 -- 172.21.15.62:0/1713432997 >> v1:172.21.15.62:6789/0 conn(0x7fe8740cef70 legacy=0x7fe8740ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe872ffd640 1 -- 172.21.15.62:0/1713432997 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788994907 0 0) 0x7fe8740b2e50 con 0x7fe8740cef70 2023-09-30T13:56:09.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.865+0000 7fe8737fe640 1 -- 172.21.15.62:0/1713432997 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740cc340 con 0x7fe8740b2940 2023-09-30T13:56:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.866+0000 7fe8737fe640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe8740cea30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097a0 tx=0x7fe86402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca4256706974646 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.866+0000 7fe872ffd640 1 -- 172.21.15.62:0/1713432997 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86402e070 con 0x7fe8740b2940 2023-09-30T13:56:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.866+0000 7fe872ffd640 1 -- 172.21.15.62:0/1713432997 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8640315a0 con 0x7fe8740b2940 2023-09-30T13:56:09.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.866+0000 7fe872ffd640 1 -- 172.21.15.62:0/1713432997 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864031930 con 0x7fe8740b2940 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 -- 172.21.15.62:0/1713432997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 msgr2=0x7fe8740cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe8740cea30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097a0 tx=0x7fe86402b840 comp rx=0 tx=0).stop 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 -- 172.21.15.62:0/1713432997 shutdown_connections 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe8740cea30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 --2- 172.21.15.62:0/1713432997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cdc20 0x7fe8740b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 -- 172.21.15.62:0/1713432997 >> 172.21.15.62:0/1713432997 conn(0x7fe87406a170 msgr2=0x7fe87406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 -- 172.21.15.62:0/1713432997 shutdown_connections 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.867+0000 7fe87a409640 1 -- 172.21.15.62:0/1713432997 wait complete. 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.868+0000 7fe87a409640 1 Processor -- start 2023-09-30T13:56:09.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.868+0000 7fe87a409640 1 -- start start 2023-09-30T13:56:09.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8740cdc20 0x7fe8740c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cef70 0x7fe8740cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b0a50 con 0x7fe8740b2940 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741554b0 con 0x7fe8740cdc20 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874156270 con 0x7fe8740cef70 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56938/0 (socket says 172.21.15.62:56938) 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 -- 172.21.15.62:0/3153685291 learned_addr learned my addr 172.21.15.62:0/3153685291 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe8737fe640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8740cdc20 0x7fe8740c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 -- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cef70 msgr2=0x7fe8740cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cef70 0x7fe8740cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 -- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8740cdc20 msgr2=0x7fe8740c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8740cdc20 0x7fe8740c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 -- 172.21.15.62:0/3153685291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864009400 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe873fff640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868007820 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868007980 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868007cf0 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8740c44a0 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.869+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8740c4a60 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.870+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87404e0d0 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.871+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe8680113f0 con 0x7fe8740b2940 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.871+0000 7fe870ff9640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 0x7fe86006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:09.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.871+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe868089740 con 0x7fe8740b2940 2023-09-30T13:56:09.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.872+0000 7fe8737fe640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 0x7fe86006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:09.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.872+0000 7fe8737fe640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 0x7fe86006cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe864036000 tx=0x7fe86403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:09.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:09.876+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe8680547c0 con 0x7fe8740b2940 2023-09-30T13:56:09.994 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-09-30T13:56:09.994+0000 7f38bded5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T13:56:10.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.120+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe8740b21e0 con 0x7fe8740b2940 2023-09-30T13:56:10.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.120+0000 7fe870ff9640 1 -- 172.21.15.62:0/3153685291 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fe86801f410 con 0x7fe8740b2940 2023-09-30T13:56:10.120 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:10.120 INFO:teuthology.orchestra.run.smithi062.stdout:{"fsid":"79595c1b-6895-4c76-9183-336503666b5b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1696082076,"num_in_osds":8,"osd_in_since":1696082067,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":226078720,"bytes_avail":772868034560,"bytes_total":773094113280,"write_bytes_sec":2520,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5529}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-09-30T13:55:55.690342+0000","services":{}},"progress_events":{}} 2023-09-30T13:56:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 msgr2=0x7fe86006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 0x7fe86006cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe864036000 tx=0x7fe86403d040 comp rx=0 tx=0).stop 2023-09-30T13:56:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 msgr2=0x7fe874155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800ccb0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 shutdown_connections 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe86006ab30 0x7fe86006cff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8740cef70 0x7fe8740cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8740cdc20 0x7fe8740c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 --2- 172.21.15.62:0/3153685291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8740b2940 0x7fe874155d30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 >> 172.21.15.62:0/3153685291 conn(0x7fe87406a170 msgr2=0x7fe87406a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 shutdown_connections 2023-09-30T13:56:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.122+0000 7fe87a409640 1 -- 172.21.15.62:0/3153685291 wait complete. 2023-09-30T13:56:10.132 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T13:56:10.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:56:10.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.238+0000 7f0cad5a9640 1 Processor -- start 2023-09-30T13:56:10.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.238+0000 7f0cad5a9640 1 -- start start 2023-09-30T13:56:10.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0cad5a9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ca80d1410 0x7f0ca80d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0cad5a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ca806b650 0x7f0ca806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0cad5a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80cf450 con 0x7f0ca815cbe0 2023-09-30T13:56:10.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0cad5a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80cfcf0 con 0x7f0ca806b650 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0cad5a9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80cf730 con 0x7f0ca80d1410 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0ca77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ca806b650 0x7f0ca806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0ca6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0ca815cbe0 0x7f0ca80d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55448/0 (socket says 172.21.15.62:55448) 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.239+0000 7f0ca6ffd640 1 -- 172.21.15.62:0/2675494925 learned_addr learned my addr 172.21.15.62:0/2675494925 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca67fc640 1 --2- 172.21.15.62:0/2675494925 >> v2:172.21.15.135:3300/0 conn(0x7f0ca80d1410 0x7f0ca80d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca77fe640 1 -- 172.21.15.62:0/2675494925 >> v2:172.21.15.135:3300/0 conn(0x7f0ca80d1410 msgr2=0x7f0ca80d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca77fe640 1 --2- 172.21.15.62:0/2675494925 >> v2:172.21.15.135:3300/0 conn(0x7f0ca80d1410 0x7f0ca80d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca77fe640 1 -- 172.21.15.62:0/2675494925 >> v1:172.21.15.62:6789/0 conn(0x7f0ca815cbe0 legacy=0x7f0ca80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca77fe640 1 -- 172.21.15.62:0/2675494925 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80cfa10 con 0x7f0ca806b650 2023-09-30T13:56:10.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca5ffb640 1 -- 172.21.15.62:0/2675494925 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797955496 0 0) 0x7f0ca80cf450 con 0x7f0ca815cbe0 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.240+0000 7f0ca77fe640 1 --2- 172.21.15.62:0/2675494925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca806b650 0x7f0ca806bac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0ca808c140 tx=0x7f0c9802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741b47b5059618a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0ca5ffb640 1 -- 172.21.15.62:0/2675494925 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9802cd00 con 0x7f0ca806b650 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0ca5ffb640 1 -- 172.21.15.62:0/2675494925 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9802ce60 con 0x7f0ca806b650 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0ca5ffb640 1 -- 172.21.15.62:0/2675494925 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98034660 con 0x7f0ca806b650 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 -- 172.21.15.62:0/2675494925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca806b650 msgr2=0x7f0ca806bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/2675494925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca806b650 0x7f0ca806bac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0ca808c140 tx=0x7f0c9802bf50 comp rx=0 tx=0).stop 2023-09-30T13:56:10.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 -- 172.21.15.62:0/2675494925 shutdown_connections 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/2675494925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca806b650 0x7f0ca806bac0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/2675494925 >> v2:172.21.15.135:3300/0 conn(0x7f0ca80d1410 0x7f0ca80d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 -- 172.21.15.62:0/2675494925 >> 172.21.15.62:0/2675494925 conn(0x7f0ca8089fe0 msgr2=0x7f0ca80d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 -- 172.21.15.62:0/2675494925 shutdown_connections 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.241+0000 7f0cad5a9640 1 -- 172.21.15.62:0/2675494925 wait complete. 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.242+0000 7f0cad5a9640 1 Processor -- start 2023-09-30T13:56:10.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.242+0000 7f0cad5a9640 1 -- start start 2023-09-30T13:56:10.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 0x7f0ca814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca80d1410 0x7f0ca80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b73b0 con 0x7f0ca815cbe0 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b4d60 con 0x7f0ca806b650 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0cad5a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814d040 con 0x7f0ca80d1410 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0ca77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0ca77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56954/0 (socket says 172.21.15.62:56954) 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.243+0000 7f0ca77fe640 1 -- 172.21.15.62:0/3749755796 learned_addr learned my addr 172.21.15.62:0/3749755796 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca6ffd640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 0x7f0ca814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 -- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca80d1410 msgr2=0x7f0ca80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca67fc640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca80d1410 0x7f0ca80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca80d1410 0x7f0ca80b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 -- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 msgr2=0x7f0ca814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 0x7f0ca814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 -- 172.21.15.62:0/3749755796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009a70 con 0x7f0ca815cbe0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca6ffd640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 0x7f0ca814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0ca77fe640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009e80 tx=0x7f0c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9803d600 con 0x7f0ca815cbe0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9803d780 con 0x7f0ca815cbe0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca814d320 con 0x7f0ca815cbe0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9803db30 con 0x7f0ca815cbe0 2023-09-30T13:56:10.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.244+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca814a940 con 0x7f0ca815cbe0 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.245+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca804e0d0 con 0x7f0ca815cbe0 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.245+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0c9803b040 con 0x7f0ca815cbe0 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.246+0000 7f0c9f7fe640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 0x7f0c8806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.246+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c980abab0 con 0x7f0ca815cbe0 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.246+0000 7f0ca6ffd640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 0x7f0c8806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:10.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.247+0000 7f0ca6ffd640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 0x7f0c8806cff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:10.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.250+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0c98076bc0 con 0x7f0ca815cbe0 2023-09-30T13:56:10.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.421+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ca814cec0 con 0x7f0c8806ab30 2023-09-30T13:56:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.429+0000 7f0c9f7fe640 1 -- 172.21.15.62:0/3749755796 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289728 (secure 0 0 0) 0x7f0ca0001d30 con 0x7f0c8806ab30 2023-09-30T13:56:10.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:56:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 msgr2=0x7f0c8806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 0x7f0c8806cff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 msgr2=0x7f0ca80b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009e80 tx=0x7f0c98004a40 comp rx=0 tx=0).stop 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 shutdown_connections 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0c8806ab30 0x7f0c8806cff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ca815cbe0 0x7f0ca80b0620 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ca80d1410 0x7f0ca80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 --2- 172.21.15.62:0/3749755796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ca806b650 0x7f0ca814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.432+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 >> 172.21.15.62:0/3749755796 conn(0x7f0ca8089fe0 msgr2=0x7f0ca815eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.433+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 shutdown_connections 2023-09-30T13:56:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:10.433+0000 7f0cad5a9640 1 -- 172.21.15.62:0/3749755796 wait complete. 2023-09-30T13:56:10.443 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-09-30T13:56:09.693209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220780,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753940,"statfs":{"total":773094113280,"available":772868034560,"internally_reserved":0,"allocated":4710400,"data_stored":2672420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.686913"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411627+0000","last_change":"2023-09-30T13:56:05.420040+0000","last_active":"2023-09-30T13:56:06.411627+0000","last_peered":"2023-09-30T13:56:06.411627+0000","last_clean":"2023-09-30T13:56:06.411627+0000","last_became_active":"2023-09-30T13:56:05.419799+0000","last_became_peered":"2023-09-30T13:56:05.419799+0000","last_unstale":"2023-09-30T13:56:06.411627+0000","last_undegraded":"2023-09-30T13:56:06.411627+0000","last_fullsized":"2023-09-30T13:56:06.411627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411410+0000","last_change":"2023-09-30T13:56:05.417471+0000","last_active":"2023-09-30T13:56:06.411410+0000","last_peered":"2023-09-30T13:56:06.411410+0000","last_clean":"2023-09-30T13:56:06.411410+0000","last_became_active":"2023-09-30T13:56:05.416791+0000","last_became_peered":"2023-09-30T13:56:05.416791+0000","last_unstale":"2023-09-30T13:56:06.411410+0000","last_undegraded":"2023-09-30T13:56:06.411410+0000","last_fullsized":"2023-09-30T13:56:06.411410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106158+0000","last_change":"2023-09-30T13:56:05.426264+0000","last_active":"2023-09-30T13:56:07.106158+0000","last_peered":"2023-09-30T13:56:07.106158+0000","last_clean":"2023-09-30T13:56:07.106158+0000","last_became_active":"2023-09-30T13:56:05.425996+0000","last_became_peered":"2023-09-30T13:56:05.425996+0000","last_unstale":"2023-09-30T13:56:07.106158+0000","last_undegraded":"2023-09-30T13:56:07.106158+0000","last_fullsized":"2023-09-30T13:56:07.106158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412164+0000","last_change":"2023-09-30T13:56:05.415699+0000","last_active":"2023-09-30T13:56:06.412164+0000","last_peered":"2023-09-30T13:56:06.412164+0000","last_clean":"2023-09-30T13:56:06.412164+0000","last_became_active":"2023-09-30T13:56:05.415434+0000","last_became_peered":"2023-09-30T13:56:05.415434+0000","last_unstale":"2023-09-30T13:56:06.412164+0000","last_undegraded":"2023-09-30T13:56:06.412164+0000","last_fullsized":"2023-09-30T13:56:06.412164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:51:29.923797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411958+0000","last_change":"2023-09-30T13:56:05.414021+0000","last_active":"2023-09-30T13:56:06.411958+0000","last_peered":"2023-09-30T13:56:06.411958+0000","last_clean":"2023-09-30T13:56:06.411958+0000","last_became_active":"2023-09-30T13:56:05.412524+0000","last_became_peered":"2023-09-30T13:56:05.412524+0000","last_unstale":"2023-09-30T13:56:06.411958+0000","last_undegraded":"2023-09-30T13:56:06.411958+0000","last_fullsized":"2023-09-30T13:56:06.411958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:07:22.395707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231454+0000","last_change":"2023-09-30T13:56:05.422130+0000","last_active":"2023-09-30T13:56:07.231454+0000","last_peered":"2023-09-30T13:56:07.231454+0000","last_clean":"2023-09-30T13:56:07.231454+0000","last_became_active":"2023-09-30T13:56:05.421855+0000","last_became_peered":"2023-09-30T13:56:05.421855+0000","last_unstale":"2023-09-30T13:56:07.231454+0000","last_undegraded":"2023-09-30T13:56:07.231454+0000","last_fullsized":"2023-09-30T13:56:07.231454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232217+0000","last_change":"2023-09-30T13:56:05.431278+0000","last_active":"2023-09-30T13:56:07.232217+0000","last_peered":"2023-09-30T13:56:07.232217+0000","last_clean":"2023-09-30T13:56:07.232217+0000","last_became_active":"2023-09-30T13:56:05.429588+0000","last_became_peered":"2023-09-30T13:56:05.429588+0000","last_unstale":"2023-09-30T13:56:07.232217+0000","last_undegraded":"2023-09-30T13:56:07.232217+0000","last_fullsized":"2023-09-30T13:56:07.232217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411112+0000","last_change":"2023-09-30T13:56:05.425541+0000","last_active":"2023-09-30T13:56:06.411112+0000","last_peered":"2023-09-30T13:56:06.411112+0000","last_clean":"2023-09-30T13:56:06.411112+0000","last_became_active":"2023-09-30T13:56:05.425266+0000","last_became_peered":"2023-09-30T13:56:05.425266+0000","last_unstale":"2023-09-30T13:56:06.411112+0000","last_undegraded":"2023-09-30T13:56:06.411112+0000","last_fullsized":"2023-09-30T13:56:06.411112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106368+0000","last_change":"2023-09-30T13:56:05.426569+0000","last_active":"2023-09-30T13:56:07.106368+0000","last_peered":"2023-09-30T13:56:07.106368+0000","last_clean":"2023-09-30T13:56:07.106368+0000","last_became_active":"2023-09-30T13:56:05.426275+0000","last_became_peered":"2023-09-30T13:56:05.426275+0000","last_unstale":"2023-09-30T13:56:07.106368+0000","last_undegraded":"2023-09-30T13:56:07.106368+0000","last_fullsized":"2023-09-30T13:56:07.106368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232736+0000","last_change":"2023-09-30T13:56:05.430304+0000","last_active":"2023-09-30T13:56:07.232736+0000","last_peered":"2023-09-30T13:56:07.232736+0000","last_clean":"2023-09-30T13:56:07.232736+0000","last_became_active":"2023-09-30T13:56:05.430014+0000","last_became_peered":"2023-09-30T13:56:05.430014+0000","last_unstale":"2023-09-30T13:56:07.232736+0000","last_undegraded":"2023-09-30T13:56:07.232736+0000","last_fullsized":"2023-09-30T13:56:07.232736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232605+0000","last_change":"2023-09-30T13:56:05.428773+0000","last_active":"2023-09-30T13:56:07.232605+0000","last_peered":"2023-09-30T13:56:07.232605+0000","last_clean":"2023-09-30T13:56:07.232605+0000","last_became_active":"2023-09-30T13:56:05.428505+0000","last_became_peered":"2023-09-30T13:56:05.428505+0000","last_unstale":"2023-09-30T13:56:07.232605+0000","last_undegraded":"2023-09-30T13:56:07.232605+0000","last_fullsized":"2023-09-30T13:56:07.232605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106147+0000","last_change":"2023-09-30T13:56:05.425127+0000","last_active":"2023-09-30T13:56:07.106147+0000","last_peered":"2023-09-30T13:56:07.106147+0000","last_clean":"2023-09-30T13:56:07.106147+0000","last_became_active":"2023-09-30T13:56:05.424756+0000","last_became_peered":"2023-09-30T13:56:05.424756+0000","last_unstale":"2023-09-30T13:56:07.106147+0000","last_undegraded":"2023-09-30T13:56:07.106147+0000","last_fullsized":"2023-09-30T13:56:07.106147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:28:55.098378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232522+0000","last_change":"2023-09-30T13:56:05.430863+0000","last_active":"2023-09-30T13:56:07.232522+0000","last_peered":"2023-09-30T13:56:07.232522+0000","last_clean":"2023-09-30T13:56:07.232522+0000","last_became_active":"2023-09-30T13:56:05.430318+0000","last_became_peered":"2023-09-30T13:56:05.430318+0000","last_unstale":"2023-09-30T13:56:07.232522+0000","last_undegraded":"2023-09-30T13:56:07.232522+0000","last_fullsized":"2023-09-30T13:56:07.232522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231695+0000","last_change":"2023-09-30T13:56:05.423606+0000","last_active":"2023-09-30T13:56:07.231695+0000","last_peered":"2023-09-30T13:56:07.231695+0000","last_clean":"2023-09-30T13:56:07.231695+0000","last_became_active":"2023-09-30T13:56:05.421905+0000","last_became_peered":"2023-09-30T13:56:05.421905+0000","last_unstale":"2023-09-30T13:56:07.231695+0000","last_undegraded":"2023-09-30T13:56:07.231695+0000","last_fullsized":"2023-09-30T13:56:07.231695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:54.420405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232309+0000","last_change":"2023-09-30T13:56:05.431457+0000","last_active":"2023-09-30T13:56:07.232309+0000","last_peered":"2023-09-30T13:56:07.232309+0000","last_clean":"2023-09-30T13:56:07.232309+0000","last_became_active":"2023-09-30T13:56:05.430721+0000","last_became_peered":"2023-09-30T13:56:05.430721+0000","last_unstale":"2023-09-30T13:56:07.232309+0000","last_undegraded":"2023-09-30T13:56:07.232309+0000","last_fullsized":"2023-09-30T13:56:07.232309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865936+0000","last_change":"2023-09-30T13:56:05.427440+0000","last_active":"2023-09-30T13:56:06.865936+0000","last_peered":"2023-09-30T13:56:06.865936+0000","last_clean":"2023-09-30T13:56:06.865936+0000","last_became_active":"2023-09-30T13:56:05.427128+0000","last_became_peered":"2023-09-30T13:56:05.427128+0000","last_unstale":"2023-09-30T13:56:06.865936+0000","last_undegraded":"2023-09-30T13:56:06.865936+0000","last_fullsized":"2023-09-30T13:56:06.865936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866384+0000","last_change":"2023-09-30T13:56:05.428154+0000","last_active":"2023-09-30T13:56:06.866384+0000","last_peered":"2023-09-30T13:56:06.866384+0000","last_clean":"2023-09-30T13:56:06.866384+0000","last_became_active":"2023-09-30T13:56:05.427819+0000","last_became_peered":"2023-09-30T13:56:05.427819+0000","last_unstale":"2023-09-30T13:56:06.866384+0000","last_undegraded":"2023-09-30T13:56:06.866384+0000","last_fullsized":"2023-09-30T13:56:06.866384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411849+0000","last_change":"2023-09-30T13:56:05.419494+0000","last_active":"2023-09-30T13:56:06.411849+0000","last_peered":"2023-09-30T13:56:06.411849+0000","last_clean":"2023-09-30T13:56:06.411849+0000","last_became_active":"2023-09-30T13:56:05.419234+0000","last_became_peered":"2023-09-30T13:56:05.419234+0000","last_unstale":"2023-09-30T13:56:06.411849+0000","last_undegraded":"2023-09-30T13:56:06.411849+0000","last_fullsized":"2023-09-30T13:56:06.411849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412242+0000","last_change":"2023-09-30T13:56:05.419551+0000","last_active":"2023-09-30T13:56:06.412242+0000","last_peered":"2023-09-30T13:56:06.412242+0000","last_clean":"2023-09-30T13:56:06.412242+0000","last_became_active":"2023-09-30T13:56:05.419278+0000","last_became_peered":"2023-09-30T13:56:05.419278+0000","last_unstale":"2023-09-30T13:56:06.412242+0000","last_undegraded":"2023-09-30T13:56:06.412242+0000","last_fullsized":"2023-09-30T13:56:06.412242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:14.958753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411632+0000","last_change":"2023-09-30T13:56:05.416952+0000","last_active":"2023-09-30T13:56:06.411632+0000","last_peered":"2023-09-30T13:56:06.411632+0000","last_clean":"2023-09-30T13:56:06.411632+0000","last_became_active":"2023-09-30T13:56:05.416698+0000","last_became_peered":"2023-09-30T13:56:05.416698+0000","last_unstale":"2023-09-30T13:56:06.411632+0000","last_undegraded":"2023-09-30T13:56:06.411632+0000","last_fullsized":"2023-09-30T13:56:06.411632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232537+0000","last_change":"2023-09-30T13:56:05.430649+0000","last_active":"2023-09-30T13:56:07.232537+0000","last_peered":"2023-09-30T13:56:07.232537+0000","last_clean":"2023-09-30T13:56:07.232537+0000","last_became_active":"2023-09-30T13:56:05.429943+0000","last_became_peered":"2023-09-30T13:56:05.429943+0000","last_unstale":"2023-09-30T13:56:07.232537+0000","last_undegraded":"2023-09-30T13:56:07.232537+0000","last_fullsized":"2023-09-30T13:56:07.232537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232458+0000","last_change":"2023-09-30T13:56:05.419088+0000","last_active":"2023-09-30T13:56:07.232458+0000","last_peered":"2023-09-30T13:56:07.232458+0000","last_clean":"2023-09-30T13:56:07.232458+0000","last_became_active":"2023-09-30T13:56:05.418821+0000","last_became_peered":"2023-09-30T13:56:05.418821+0000","last_unstale":"2023-09-30T13:56:07.232458+0000","last_undegraded":"2023-09-30T13:56:07.232458+0000","last_fullsized":"2023-09-30T13:56:07.232458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865972+0000","last_change":"2023-09-30T13:56:05.427153+0000","last_active":"2023-09-30T13:56:06.865972+0000","last_peered":"2023-09-30T13:56:06.865972+0000","last_clean":"2023-09-30T13:56:06.865972+0000","last_became_active":"2023-09-30T13:56:05.426436+0000","last_became_peered":"2023-09-30T13:56:05.426436+0000","last_unstale":"2023-09-30T13:56:06.865972+0000","last_undegraded":"2023-09-30T13:56:06.865972+0000","last_fullsized":"2023-09-30T13:56:06.865972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411911+0000","last_change":"2023-09-30T13:56:05.428121+0000","last_active":"2023-09-30T13:56:06.411911+0000","last_peered":"2023-09-30T13:56:06.411911+0000","last_clean":"2023-09-30T13:56:06.411911+0000","last_became_active":"2023-09-30T13:56:05.427891+0000","last_became_peered":"2023-09-30T13:56:05.427891+0000","last_unstale":"2023-09-30T13:56:06.411911+0000","last_undegraded":"2023-09-30T13:56:06.411911+0000","last_fullsized":"2023-09-30T13:56:06.411911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:45:27.320047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411903+0000","last_change":"2023-09-30T13:56:05.419037+0000","last_active":"2023-09-30T13:56:06.411903+0000","last_peered":"2023-09-30T13:56:06.411903+0000","last_clean":"2023-09-30T13:56:06.411903+0000","last_became_active":"2023-09-30T13:56:05.418757+0000","last_became_peered":"2023-09-30T13:56:05.418757+0000","last_unstale":"2023-09-30T13:56:06.411903+0000","last_undegraded":"2023-09-30T13:56:06.411903+0000","last_fullsized":"2023-09-30T13:56:06.411903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231619+0000","last_change":"2023-09-30T13:56:05.425990+0000","last_active":"2023-09-30T13:56:07.231619+0000","last_peered":"2023-09-30T13:56:07.231619+0000","last_clean":"2023-09-30T13:56:07.231619+0000","last_became_active":"2023-09-30T13:56:05.425677+0000","last_became_peered":"2023-09-30T13:56:05.425677+0000","last_unstale":"2023-09-30T13:56:07.231619+0000","last_undegraded":"2023-09-30T13:56:07.231619+0000","last_fullsized":"2023-09-30T13:56:07.231619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411782+0000","last_change":"2023-09-30T13:56:05.419570+0000","last_active":"2023-09-30T13:56:06.411782+0000","last_peered":"2023-09-30T13:56:06.411782+0000","last_clean":"2023-09-30T13:56:06.411782+0000","last_became_active":"2023-09-30T13:56:05.418645+0000","last_became_peered":"2023-09-30T13:56:05.418645+0000","last_unstale":"2023-09-30T13:56:06.411782+0000","last_undegraded":"2023-09-30T13:56:06.411782+0000","last_fullsized":"2023-09-30T13:56:06.411782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232462+0000","last_change":"2023-09-30T13:56:05.423744+0000","last_active":"2023-09-30T13:56:07.232462+0000","last_peered":"2023-09-30T13:56:07.232462+0000","last_clean":"2023-09-30T13:56:07.232462+0000","last_became_active":"2023-09-30T13:56:05.423457+0000","last_became_peered":"2023-09-30T13:56:05.423457+0000","last_unstale":"2023-09-30T13:56:07.232462+0000","last_undegraded":"2023-09-30T13:56:07.232462+0000","last_fullsized":"2023-09-30T13:56:07.232462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.422761+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.421999+0000","last_became_peered":"2023-09-30T13:56:05.421999+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411510+0000","last_change":"2023-09-30T13:56:05.423384+0000","last_active":"2023-09-30T13:56:06.411510+0000","last_peered":"2023-09-30T13:56:06.411510+0000","last_clean":"2023-09-30T13:56:06.411510+0000","last_became_active":"2023-09-30T13:56:05.423055+0000","last_became_peered":"2023-09-30T13:56:05.423055+0000","last_unstale":"2023-09-30T13:56:06.411510+0000","last_undegraded":"2023-09-30T13:56:06.411510+0000","last_fullsized":"2023-09-30T13:56:06.411510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866252+0000","last_change":"2023-09-30T13:56:05.427583+0000","last_active":"2023-09-30T13:56:06.866252+0000","last_peered":"2023-09-30T13:56:06.866252+0000","last_clean":"2023-09-30T13:56:06.866252+0000","last_became_active":"2023-09-30T13:56:05.426872+0000","last_became_peered":"2023-09-30T13:56:05.426872+0000","last_unstale":"2023-09-30T13:56:06.866252+0000","last_undegraded":"2023-09-30T13:56:06.866252+0000","last_fullsized":"2023-09-30T13:56:06.866252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:24:15.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231455+0000","last_change":"2023-09-30T13:56:05.424956+0000","last_active":"2023-09-30T13:56:07.231455+0000","last_peered":"2023-09-30T13:56:07.231455+0000","last_clean":"2023-09-30T13:56:07.231455+0000","last_became_active":"2023-09-30T13:56:05.424699+0000","last_became_peered":"2023-09-30T13:56:05.424699+0000","last_unstale":"2023-09-30T13:56:07.231455+0000","last_undegraded":"2023-09-30T13:56:07.231455+0000","last_fullsized":"2023-09-30T13:56:07.231455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866303+0000","last_change":"2023-09-30T13:56:05.428142+0000","last_active":"2023-09-30T13:56:06.866303+0000","last_peered":"2023-09-30T13:56:06.866303+0000","last_clean":"2023-09-30T13:56:06.866303+0000","last_became_active":"2023-09-30T13:56:05.427802+0000","last_became_peered":"2023-09-30T13:56:05.427802+0000","last_unstale":"2023-09-30T13:56:06.866303+0000","last_undegraded":"2023-09-30T13:56:06.866303+0000","last_fullsized":"2023-09-30T13:56:06.866303+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411916+0000","last_change":"2023-09-30T13:56:05.018389+0000","last_active":"2023-09-30T13:56:06.411916+0000","last_peered":"2023-09-30T13:56:06.411916+0000","last_clean":"2023-09-30T13:56:06.411916+0000","last_became_active":"2023-09-30T13:56:05.018132+0000","last_became_peered":"2023-09-30T13:56:05.018132+0000","last_unstale":"2023-09-30T13:56:06.411916+0000","last_undegraded":"2023-09-30T13:56:06.411916+0000","last_fullsized":"2023-09-30T13:56:06.411916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231801+0000","last_change":"2023-09-30T13:56:05.425856+0000","last_active":"2023-09-30T13:56:07.231801+0000","last_peered":"2023-09-30T13:56:07.231801+0000","last_clean":"2023-09-30T13:56:07.231801+0000","last_became_active":"2023-09-30T13:56:05.425581+0000","last_became_peered":"2023-09-30T13:56:05.425581+0000","last_unstale":"2023-09-30T13:56:07.231801+0000","last_undegraded":"2023-09-30T13:56:07.231801+0000","last_fullsized":"2023-09-30T13:56:07.231801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106273+0000","last_change":"2023-09-30T13:56:05.027198+0000","last_active":"2023-09-30T13:56:07.106273+0000","last_peered":"2023-09-30T13:56:07.106273+0000","last_clean":"2023-09-30T13:56:07.106273+0000","last_became_active":"2023-09-30T13:56:05.026910+0000","last_became_peered":"2023-09-30T13:56:05.026910+0000","last_unstale":"2023-09-30T13:56:07.106273+0000","last_undegraded":"2023-09-30T13:56:07.106273+0000","last_fullsized":"2023-09-30T13:56:07.106273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232148+0000","last_change":"2023-09-30T13:56:05.420489+0000","last_active":"2023-09-30T13:56:07.232148+0000","last_peered":"2023-09-30T13:56:07.232148+0000","last_clean":"2023-09-30T13:56:07.232148+0000","last_became_active":"2023-09-30T13:56:05.420207+0000","last_became_peered":"2023-09-30T13:56:05.420207+0000","last_unstale":"2023-09-30T13:56:07.232148+0000","last_undegraded":"2023-09-30T13:56:07.232148+0000","last_fullsized":"2023-09-30T13:56:07.232148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231779+0000","last_change":"2023-09-30T13:56:05.022903+0000","last_active":"2023-09-30T13:56:07.231779+0000","last_peered":"2023-09-30T13:56:07.231779+0000","last_clean":"2023-09-30T13:56:07.231779+0000","last_became_active":"2023-09-30T13:56:05.022613+0000","last_became_peered":"2023-09-30T13:56:05.022613+0000","last_unstale":"2023-09-30T13:56:07.231779+0000","last_undegraded":"2023-09-30T13:56:07.231779+0000","last_fullsized":"2023-09-30T13:56:07.231779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.423430+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.423127+0000","last_became_peered":"2023-09-30T13:56:05.423127+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231952+0000","last_change":"2023-09-30T13:56:05.023831+0000","last_active":"2023-09-30T13:56:07.231952+0000","last_peered":"2023-09-30T13:56:07.231952+0000","last_clean":"2023-09-30T13:56:07.231952+0000","last_became_active":"2023-09-30T13:56:05.023571+0000","last_became_peered":"2023-09-30T13:56:05.023571+0000","last_unstale":"2023-09-30T13:56:07.231952+0000","last_undegraded":"2023-09-30T13:56:07.231952+0000","last_fullsized":"2023-09-30T13:56:07.231952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106034+0000","last_change":"2023-09-30T13:56:05.420452+0000","last_active":"2023-09-30T13:56:07.106034+0000","last_peered":"2023-09-30T13:56:07.106034+0000","last_clean":"2023-09-30T13:56:07.106034+0000","last_became_active":"2023-09-30T13:56:05.420204+0000","last_became_peered":"2023-09-30T13:56:05.420204+0000","last_unstale":"2023-09-30T13:56:07.106034+0000","last_undegraded":"2023-09-30T13:56:07.106034+0000","last_fullsized":"2023-09-30T13:56:07.106034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232629+0000","last_change":"2023-09-30T13:56:05.023750+0000","last_active":"2023-09-30T13:56:07.232629+0000","last_peered":"2023-09-30T13:56:07.232629+0000","last_clean":"2023-09-30T13:56:07.232629+0000","last_became_active":"2023-09-30T13:56:05.023475+0000","last_became_peered":"2023-09-30T13:56:05.023475+0000","last_unstale":"2023-09-30T13:56:07.232629+0000","last_undegraded":"2023-09-30T13:56:07.232629+0000","last_fullsized":"2023-09-30T13:56:07.232629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:05.152067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232366+0000","last_change":"2023-09-30T13:56:05.425132+0000","last_active":"2023-09-30T13:56:07.232366+0000","last_peered":"2023-09-30T13:56:07.232366+0000","last_clean":"2023-09-30T13:56:07.232366+0000","last_became_active":"2023-09-30T13:56:05.424796+0000","last_became_peered":"2023-09-30T13:56:05.424796+0000","last_unstale":"2023-09-30T13:56:07.232366+0000","last_undegraded":"2023-09-30T13:56:07.232366+0000","last_fullsized":"2023-09-30T13:56:07.232366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866074+0000","last_change":"2023-09-30T13:56:05.031611+0000","last_active":"2023-09-30T13:56:06.866074+0000","last_peered":"2023-09-30T13:56:06.866074+0000","last_clean":"2023-09-30T13:56:06.866074+0000","last_became_active":"2023-09-30T13:56:05.031229+0000","last_became_peered":"2023-09-30T13:56:05.031229+0000","last_unstale":"2023-09-30T13:56:06.866074+0000","last_undegraded":"2023-09-30T13:56:06.866074+0000","last_fullsized":"2023-09-30T13:56:06.866074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232315+0000","last_change":"2023-09-30T13:56:05.425565+0000","last_active":"2023-09-30T13:56:07.232315+0000","last_peered":"2023-09-30T13:56:07.232315+0000","last_clean":"2023-09-30T13:56:07.232315+0000","last_became_active":"2023-09-30T13:56:05.425288+0000","last_became_peered":"2023-09-30T13:56:05.425288+0000","last_unstale":"2023-09-30T13:56:07.232315+0000","last_undegraded":"2023-09-30T13:56:07.232315+0000","last_fullsized":"2023-09-30T13:56:07.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231618+0000","last_change":"2023-09-30T13:56:05.024829+0000","last_active":"2023-09-30T13:56:07.231618+0000","last_peered":"2023-09-30T13:56:07.231618+0000","last_clean":"2023-09-30T13:56:07.231618+0000","last_became_active":"2023-09-30T13:56:05.024568+0000","last_became_peered":"2023-09-30T13:56:05.024568+0000","last_unstale":"2023-09-30T13:56:07.231618+0000","last_undegraded":"2023-09-30T13:56:07.231618+0000","last_fullsized":"2023-09-30T13:56:07.231618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411265+0000","last_change":"2023-09-30T13:56:05.429283+0000","last_active":"2023-09-30T13:56:06.411265+0000","last_peered":"2023-09-30T13:56:06.411265+0000","last_clean":"2023-09-30T13:56:06.411265+0000","last_became_active":"2023-09-30T13:56:05.428988+0000","last_became_peered":"2023-09-30T13:56:05.428988+0000","last_unstale":"2023-09-30T13:56:06.411265+0000","last_undegraded":"2023-09-30T13:56:06.411265+0000","last_fullsized":"2023-09-30T13:56:06.411265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231642+0000","last_change":"2023-09-30T13:56:05.020445+0000","last_active":"2023-09-30T13:56:07.231642+0000","last_peered":"2023-09-30T13:56:07.231642+0000","last_clean":"2023-09-30T13:56:07.231642+0000","last_became_active":"2023-09-30T13:56:05.020184+0000","last_became_peered":"2023-09-30T13:56:05.020184+0000","last_unstale":"2023-09-30T13:56:07.231642+0000","last_undegraded":"2023-09-30T13:56:07.231642+0000","last_fullsized":"2023-09-30T13:56:07.231642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412227+0000","last_change":"2023-09-30T13:56:05.413074+0000","last_active":"2023-09-30T13:56:06.412227+0000","last_peered":"2023-09-30T13:56:06.412227+0000","last_clean":"2023-09-30T13:56:06.412227+0000","last_became_active":"2023-09-30T13:56:05.412825+0000","last_became_peered":"2023-09-30T13:56:05.412825+0000","last_unstale":"2023-09-30T13:56:06.412227+0000","last_undegraded":"2023-09-30T13:56:06.412227+0000","last_fullsized":"2023-09-30T13:56:06.412227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:15:57.774218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411698+0000","last_change":"2023-09-30T13:56:05.024356+0000","last_active":"2023-09-30T13:56:06.411698+0000","last_peered":"2023-09-30T13:56:06.411698+0000","last_clean":"2023-09-30T13:56:06.411698+0000","last_became_active":"2023-09-30T13:56:05.024047+0000","last_became_peered":"2023-09-30T13:56:05.024047+0000","last_unstale":"2023-09-30T13:56:06.411698+0000","last_undegraded":"2023-09-30T13:56:06.411698+0000","last_fullsized":"2023-09-30T13:56:06.411698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866427+0000","last_change":"2023-09-30T13:56:05.427700+0000","last_active":"2023-09-30T13:56:06.866427+0000","last_peered":"2023-09-30T13:56:06.866427+0000","last_clean":"2023-09-30T13:56:06.866427+0000","last_became_active":"2023-09-30T13:56:05.427183+0000","last_became_peered":"2023-09-30T13:56:05.427183+0000","last_unstale":"2023-09-30T13:56:06.866427+0000","last_undegraded":"2023-09-30T13:56:06.866427+0000","last_fullsized":"2023-09-30T13:56:06.866427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232936+0000","last_change":"2023-09-30T13:56:05.026290+0000","last_active":"2023-09-30T13:56:07.232936+0000","last_peered":"2023-09-30T13:56:07.232936+0000","last_clean":"2023-09-30T13:56:07.232936+0000","last_became_active":"2023-09-30T13:56:05.025969+0000","last_became_peered":"2023-09-30T13:56:05.025969+0000","last_unstale":"2023-09-30T13:56:07.232936+0000","last_undegraded":"2023-09-30T13:56:07.232936+0000","last_fullsized":"2023-09-30T13:56:07.232936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:17.133231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106286+0000","last_change":"2023-09-30T13:56:05.427209+0000","last_active":"2023-09-30T13:56:07.106286+0000","last_peered":"2023-09-30T13:56:07.106286+0000","last_clean":"2023-09-30T13:56:07.106286+0000","last_became_active":"2023-09-30T13:56:05.426884+0000","last_became_peered":"2023-09-30T13:56:05.426884+0000","last_unstale":"2023-09-30T13:56:07.106286+0000","last_undegraded":"2023-09-30T13:56:07.106286+0000","last_fullsized":"2023-09-30T13:56:07.106286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232661+0000","last_change":"2023-09-30T13:56:05.027961+0000","last_active":"2023-09-30T13:56:07.232661+0000","last_peered":"2023-09-30T13:56:07.232661+0000","last_clean":"2023-09-30T13:56:07.232661+0000","last_became_active":"2023-09-30T13:56:05.027693+0000","last_became_peered":"2023-09-30T13:56:05.027693+0000","last_unstale":"2023-09-30T13:56:07.232661+0000","last_undegraded":"2023-09-30T13:56:07.232661+0000","last_fullsized":"2023-09-30T13:56:07.232661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232080+0000","last_change":"2023-09-30T13:56:05.417132+0000","last_active":"2023-09-30T13:56:07.232080+0000","last_peered":"2023-09-30T13:56:07.232080+0000","last_clean":"2023-09-30T13:56:07.232080+0000","last_became_active":"2023-09-30T13:56:05.416832+0000","last_became_peered":"2023-09-30T13:56:05.416832+0000","last_unstale":"2023-09-30T13:56:07.232080+0000","last_undegraded":"2023-09-30T13:56:07.232080+0000","last_fullsized":"2023-09-30T13:56:07.232080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411487+0000","last_change":"2023-09-30T13:56:05.027519+0000","last_active":"2023-09-30T13:56:06.411487+0000","last_peered":"2023-09-30T13:56:06.411487+0000","last_clean":"2023-09-30T13:56:06.411487+0000","last_became_active":"2023-09-30T13:56:05.027240+0000","last_became_peered":"2023-09-30T13:56:05.027240+0000","last_unstale":"2023-09-30T13:56:06.411487+0000","last_undegraded":"2023-09-30T13:56:06.411487+0000","last_fullsized":"2023-09-30T13:56:06.411487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106081+0000","last_change":"2023-09-30T13:56:05.425318+0000","last_active":"2023-09-30T13:56:07.106081+0000","last_peered":"2023-09-30T13:56:07.106081+0000","last_clean":"2023-09-30T13:56:07.106081+0000","last_became_active":"2023-09-30T13:56:05.425067+0000","last_became_peered":"2023-09-30T13:56:05.425067+0000","last_unstale":"2023-09-30T13:56:07.106081+0000","last_undegraded":"2023-09-30T13:56:07.106081+0000","last_fullsized":"2023-09-30T13:56:07.106081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411486+0000","last_change":"2023-09-30T13:56:05.024545+0000","last_active":"2023-09-30T13:56:06.411486+0000","last_peered":"2023-09-30T13:56:06.411486+0000","last_clean":"2023-09-30T13:56:06.411486+0000","last_became_active":"2023-09-30T13:56:05.024255+0000","last_became_peered":"2023-09-30T13:56:05.024255+0000","last_unstale":"2023-09-30T13:56:06.411486+0000","last_undegraded":"2023-09-30T13:56:06.411486+0000","last_fullsized":"2023-09-30T13:56:06.411486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411300+0000","last_change":"2023-09-30T13:56:05.417483+0000","last_active":"2023-09-30T13:56:06.411300+0000","last_peered":"2023-09-30T13:56:06.411300+0000","last_clean":"2023-09-30T13:56:06.411300+0000","last_became_active":"2023-09-30T13:56:05.417154+0000","last_became_peered":"2023-09-30T13:56:05.417154+0000","last_unstale":"2023-09-30T13:56:06.411300+0000","last_undegraded":"2023-09-30T13:56:06.411300+0000","last_fullsized":"2023-09-30T13:56:06.411300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.024208+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.023897+0000","last_became_peered":"2023-09-30T13:56:05.023897+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866073+0000","last_change":"2023-09-30T13:56:05.425530+0000","last_active":"2023-09-30T13:56:06.866073+0000","last_peered":"2023-09-30T13:56:06.866073+0000","last_clean":"2023-09-30T13:56:06.866073+0000","last_became_active":"2023-09-30T13:56:05.425267+0000","last_became_peered":"2023-09-30T13:56:05.425267+0000","last_unstale":"2023-09-30T13:56:06.866073+0000","last_undegraded":"2023-09-30T13:56:06.866073+0000","last_fullsized":"2023-09-30T13:56:06.866073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411404+0000","last_change":"2023-09-30T13:56:05.019981+0000","last_active":"2023-09-30T13:56:06.411404+0000","last_peered":"2023-09-30T13:56:06.411404+0000","last_clean":"2023-09-30T13:56:06.411404+0000","last_became_active":"2023-09-30T13:56:05.019707+0000","last_became_peered":"2023-09-30T13:56:05.019707+0000","last_unstale":"2023-09-30T13:56:06.411404+0000","last_undegraded":"2023-09-30T13:56:06.411404+0000","last_fullsized":"2023-09-30T13:56:06.411404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411406+0000","last_change":"2023-09-30T13:56:05.418328+0000","last_active":"2023-09-30T13:56:06.411406+0000","last_peered":"2023-09-30T13:56:06.411406+0000","last_clean":"2023-09-30T13:56:06.411406+0000","last_became_active":"2023-09-30T13:56:05.417615+0000","last_became_peered":"2023-09-30T13:56:05.417615+0000","last_unstale":"2023-09-30T13:56:06.411406+0000","last_undegraded":"2023-09-30T13:56:06.411406+0000","last_fullsized":"2023-09-30T13:56:06.411406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865931+0000","last_change":"2023-09-30T13:56:05.031440+0000","last_active":"2023-09-30T13:56:06.865931+0000","last_peered":"2023-09-30T13:56:06.865931+0000","last_clean":"2023-09-30T13:56:06.865931+0000","last_became_active":"2023-09-30T13:56:05.031110+0000","last_became_peered":"2023-09-30T13:56:05.031110+0000","last_unstale":"2023-09-30T13:56:06.865931+0000","last_undegraded":"2023-09-30T13:56:06.865931+0000","last_fullsized":"2023-09-30T13:56:06.865931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411452+0000","last_change":"2023-09-30T13:56:05.423405+0000","last_active":"2023-09-30T13:56:06.411452+0000","last_peered":"2023-09-30T13:56:06.411452+0000","last_clean":"2023-09-30T13:56:06.411452+0000","last_became_active":"2023-09-30T13:56:05.423132+0000","last_became_peered":"2023-09-30T13:56:05.423132+0000","last_unstale":"2023-09-30T13:56:06.411452+0000","last_undegraded":"2023-09-30T13:56:06.411452+0000","last_fullsized":"2023-09-30T13:56:06.411452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233017+0000","last_change":"2023-09-30T13:56:05.023723+0000","last_active":"2023-09-30T13:56:07.233017+0000","last_peered":"2023-09-30T13:56:07.233017+0000","last_clean":"2023-09-30T13:56:07.233017+0000","last_became_active":"2023-09-30T13:56:05.023454+0000","last_became_peered":"2023-09-30T13:56:05.023454+0000","last_unstale":"2023-09-30T13:56:07.233017+0000","last_undegraded":"2023-09-30T13:56:07.233017+0000","last_fullsized":"2023-09-30T13:56:07.233017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232596+0000","last_change":"2023-09-30T13:56:05.431567+0000","last_active":"2023-09-30T13:56:07.232596+0000","last_peered":"2023-09-30T13:56:07.232596+0000","last_clean":"2023-09-30T13:56:07.232596+0000","last_became_active":"2023-09-30T13:56:05.431246+0000","last_became_peered":"2023-09-30T13:56:05.431246+0000","last_unstale":"2023-09-30T13:56:07.232596+0000","last_undegraded":"2023-09-30T13:56:07.232596+0000","last_fullsized":"2023-09-30T13:56:07.232596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232264+0000","last_change":"2023-09-30T13:56:05.024797+0000","last_active":"2023-09-30T13:56:07.232264+0000","last_peered":"2023-09-30T13:56:07.232264+0000","last_clean":"2023-09-30T13:56:07.232264+0000","last_became_active":"2023-09-30T13:56:05.024377+0000","last_became_peered":"2023-09-30T13:56:05.024377+0000","last_unstale":"2023-09-30T13:56:07.232264+0000","last_undegraded":"2023-09-30T13:56:07.232264+0000","last_fullsized":"2023-09-30T13:56:07.232264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:48:03.565686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232086+0000","last_change":"2023-09-30T13:56:05.418093+0000","last_active":"2023-09-30T13:56:07.232086+0000","last_peered":"2023-09-30T13:56:07.232086+0000","last_clean":"2023-09-30T13:56:07.232086+0000","last_became_active":"2023-09-30T13:56:05.417749+0000","last_became_peered":"2023-09-30T13:56:05.417749+0000","last_unstale":"2023-09-30T13:56:07.232086+0000","last_undegraded":"2023-09-30T13:56:07.232086+0000","last_fullsized":"2023-09-30T13:56:07.232086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412257+0000","last_change":"2023-09-30T13:56:05.026612+0000","last_active":"2023-09-30T13:56:06.412257+0000","last_peered":"2023-09-30T13:56:06.412257+0000","last_clean":"2023-09-30T13:56:06.412257+0000","last_became_active":"2023-09-30T13:56:05.026286+0000","last_became_peered":"2023-09-30T13:56:05.026286+0000","last_unstale":"2023-09-30T13:56:06.412257+0000","last_undegraded":"2023-09-30T13:56:06.412257+0000","last_fullsized":"2023-09-30T13:56:06.412257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:28:14.007134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412124+0000","last_change":"2023-09-30T13:56:05.417529+0000","last_active":"2023-09-30T13:56:06.412124+0000","last_peered":"2023-09-30T13:56:06.412124+0000","last_clean":"2023-09-30T13:56:06.412124+0000","last_became_active":"2023-09-30T13:56:05.417268+0000","last_became_peered":"2023-09-30T13:56:05.417268+0000","last_unstale":"2023-09-30T13:56:06.412124+0000","last_undegraded":"2023-09-30T13:56:06.412124+0000","last_fullsized":"2023-09-30T13:56:06.412124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:05:43.691463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.026479+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.026207+0000","last_became_peered":"2023-09-30T13:56:05.026207+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:47.241082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866185+0000","last_change":"2023-09-30T13:56:05.430870+0000","last_active":"2023-09-30T13:56:06.866185+0000","last_peered":"2023-09-30T13:56:06.866185+0000","last_clean":"2023-09-30T13:56:06.866185+0000","last_became_active":"2023-09-30T13:56:05.430516+0000","last_became_peered":"2023-09-30T13:56:05.430516+0000","last_unstale":"2023-09-30T13:56:06.866185+0000","last_undegraded":"2023-09-30T13:56:06.866185+0000","last_fullsized":"2023-09-30T13:56:06.866185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412054+0000","last_change":"2023-09-30T13:56:05.020968+0000","last_active":"2023-09-30T13:56:06.412054+0000","last_peered":"2023-09-30T13:56:06.412054+0000","last_clean":"2023-09-30T13:56:06.412054+0000","last_became_active":"2023-09-30T13:56:05.020698+0000","last_became_peered":"2023-09-30T13:56:05.020698+0000","last_unstale":"2023-09-30T13:56:06.412054+0000","last_undegraded":"2023-09-30T13:56:06.412054+0000","last_fullsized":"2023-09-30T13:56:06.412054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:35.380176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106059+0000","last_change":"2023-09-30T13:56:05.429248+0000","last_active":"2023-09-30T13:56:07.106059+0000","last_peered":"2023-09-30T13:56:07.106059+0000","last_clean":"2023-09-30T13:56:07.106059+0000","last_became_active":"2023-09-30T13:56:05.428978+0000","last_became_peered":"2023-09-30T13:56:05.428978+0000","last_unstale":"2023-09-30T13:56:07.106059+0000","last_undegraded":"2023-09-30T13:56:07.106059+0000","last_fullsized":"2023-09-30T13:56:07.106059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412016+0000","last_change":"2023-09-30T13:56:05.017181+0000","last_active":"2023-09-30T13:56:06.412016+0000","last_peered":"2023-09-30T13:56:06.412016+0000","last_clean":"2023-09-30T13:56:06.412016+0000","last_became_active":"2023-09-30T13:56:05.016888+0000","last_became_peered":"2023-09-30T13:56:05.016888+0000","last_unstale":"2023-09-30T13:56:06.412016+0000","last_undegraded":"2023-09-30T13:56:06.412016+0000","last_fullsized":"2023-09-30T13:56:06.412016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:14:10.079773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232168+0000","last_change":"2023-09-30T13:56:05.424901+0000","last_active":"2023-09-30T13:56:07.232168+0000","last_peered":"2023-09-30T13:56:07.232168+0000","last_clean":"2023-09-30T13:56:07.232168+0000","last_became_active":"2023-09-30T13:56:05.424606+0000","last_became_peered":"2023-09-30T13:56:05.424606+0000","last_unstale":"2023-09-30T13:56:07.232168+0000","last_undegraded":"2023-09-30T13:56:07.232168+0000","last_fullsized":"2023-09-30T13:56:07.232168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866080+0000","last_change":"2023-09-30T13:56:05.031024+0000","last_active":"2023-09-30T13:56:06.866080+0000","last_peered":"2023-09-30T13:56:06.866080+0000","last_clean":"2023-09-30T13:56:06.866080+0000","last_became_active":"2023-09-30T13:56:05.030761+0000","last_became_peered":"2023-09-30T13:56:05.030761+0000","last_unstale":"2023-09-30T13:56:06.866080+0000","last_undegraded":"2023-09-30T13:56:06.866080+0000","last_fullsized":"2023-09-30T13:56:06.866080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:22.715731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411395+0000","last_change":"2023-09-30T13:56:05.427427+0000","last_active":"2023-09-30T13:56:06.411395+0000","last_peered":"2023-09-30T13:56:06.411395+0000","last_clean":"2023-09-30T13:56:06.411395+0000","last_became_active":"2023-09-30T13:56:05.427197+0000","last_became_peered":"2023-09-30T13:56:05.427197+0000","last_unstale":"2023-09-30T13:56:06.411395+0000","last_undegraded":"2023-09-30T13:56:06.411395+0000","last_fullsized":"2023-09-30T13:56:06.411395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411780+0000","last_change":"2023-09-30T13:56:05.018322+0000","last_active":"2023-09-30T13:56:06.411780+0000","last_peered":"2023-09-30T13:56:06.411780+0000","last_clean":"2023-09-30T13:56:06.411780+0000","last_became_active":"2023-09-30T13:56:05.018041+0000","last_became_peered":"2023-09-30T13:56:05.018041+0000","last_unstale":"2023-09-30T13:56:06.411780+0000","last_undegraded":"2023-09-30T13:56:06.411780+0000","last_fullsized":"2023-09-30T13:56:06.411780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:27:16.924592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231539+0000","last_change":"2023-09-30T13:56:05.429919+0000","last_active":"2023-09-30T13:56:07.231539+0000","last_peered":"2023-09-30T13:56:07.231539+0000","last_clean":"2023-09-30T13:56:07.231539+0000","last_became_active":"2023-09-30T13:56:05.429685+0000","last_became_peered":"2023-09-30T13:56:05.429685+0000","last_unstale":"2023-09-30T13:56:07.231539+0000","last_undegraded":"2023-09-30T13:56:07.231539+0000","last_fullsized":"2023-09-30T13:56:07.231539+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233086+0000","last_change":"2023-09-30T13:56:05.027919+0000","last_active":"2023-09-30T13:56:07.233086+0000","last_peered":"2023-09-30T13:56:07.233086+0000","last_clean":"2023-09-30T13:56:07.233086+0000","last_became_active":"2023-09-30T13:56:05.027642+0000","last_became_peered":"2023-09-30T13:56:05.027642+0000","last_unstale":"2023-09-30T13:56:07.233086+0000","last_undegraded":"2023-09-30T13:56:07.233086+0000","last_fullsized":"2023-09-30T13:56:07.233086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866446+0000","last_change":"2023-09-30T13:56:05.428015+0000","last_active":"2023-09-30T13:56:06.866446+0000","last_peered":"2023-09-30T13:56:06.866446+0000","last_clean":"2023-09-30T13:56:06.866446+0000","last_became_active":"2023-09-30T13:56:05.427521+0000","last_became_peered":"2023-09-30T13:56:05.427521+0000","last_unstale":"2023-09-30T13:56:06.866446+0000","last_undegraded":"2023-09-30T13:56:06.866446+0000","last_fullsized":"2023-09-30T13:56:06.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412076+0000","last_change":"2023-09-30T13:56:05.026091+0000","last_active":"2023-09-30T13:56:06.412076+0000","last_peered":"2023-09-30T13:56:06.412076+0000","last_clean":"2023-09-30T13:56:06.412076+0000","last_became_active":"2023-09-30T13:56:05.025797+0000","last_became_peered":"2023-09-30T13:56:05.025797+0000","last_unstale":"2023-09-30T13:56:06.412076+0000","last_undegraded":"2023-09-30T13:56:06.412076+0000","last_fullsized":"2023-09-30T13:56:06.412076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:57:45.773605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411521+0000","last_change":"2023-09-30T13:56:05.418019+0000","last_active":"2023-09-30T13:56:06.411521+0000","last_peered":"2023-09-30T13:56:06.411521+0000","last_clean":"2023-09-30T13:56:06.411521+0000","last_became_active":"2023-09-30T13:56:05.417721+0000","last_became_peered":"2023-09-30T13:56:05.417721+0000","last_unstale":"2023-09-30T13:56:06.411521+0000","last_undegraded":"2023-09-30T13:56:06.411521+0000","last_fullsized":"2023-09-30T13:56:06.411521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106159+0000","last_change":"2023-09-30T13:56:05.029178+0000","last_active":"2023-09-30T13:56:07.106159+0000","last_peered":"2023-09-30T13:56:07.106159+0000","last_clean":"2023-09-30T13:56:07.106159+0000","last_became_active":"2023-09-30T13:56:05.028931+0000","last_became_peered":"2023-09-30T13:56:05.028931+0000","last_unstale":"2023-09-30T13:56:07.106159+0000","last_undegraded":"2023-09-30T13:56:07.106159+0000","last_fullsized":"2023-09-30T13:56:07.106159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106209+0000","last_change":"2023-09-30T13:56:05.419085+0000","last_active":"2023-09-30T13:56:07.106209+0000","last_peered":"2023-09-30T13:56:07.106209+0000","last_clean":"2023-09-30T13:56:07.106209+0000","last_became_active":"2023-09-30T13:56:05.418848+0000","last_became_peered":"2023-09-30T13:56:05.418848+0000","last_unstale":"2023-09-30T13:56:07.106209+0000","last_undegraded":"2023-09-30T13:56:07.106209+0000","last_fullsized":"2023-09-30T13:56:07.106209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106349+0000","last_change":"2023-09-30T13:56:05.027449+0000","last_active":"2023-09-30T13:56:07.106349+0000","last_peered":"2023-09-30T13:56:07.106349+0000","last_clean":"2023-09-30T13:56:07.106349+0000","last_became_active":"2023-09-30T13:56:05.026839+0000","last_became_peered":"2023-09-30T13:56:05.026839+0000","last_unstale":"2023-09-30T13:56:07.106349+0000","last_undegraded":"2023-09-30T13:56:07.106349+0000","last_fullsized":"2023-09-30T13:56:07.106349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231609+0000","last_change":"2023-09-30T13:56:05.425626+0000","last_active":"2023-09-30T13:56:07.231609+0000","last_peered":"2023-09-30T13:56:07.231609+0000","last_clean":"2023-09-30T13:56:07.231609+0000","last_became_active":"2023-09-30T13:56:05.425145+0000","last_became_peered":"2023-09-30T13:56:05.425145+0000","last_unstale":"2023-09-30T13:56:07.231609+0000","last_undegraded":"2023-09-30T13:56:07.231609+0000","last_fullsized":"2023-09-30T13:56:07.231609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411524+0000","last_change":"2023-09-30T13:56:05.023063+0000","last_active":"2023-09-30T13:56:06.411524+0000","last_peered":"2023-09-30T13:56:06.411524+0000","last_clean":"2023-09-30T13:56:06.411524+0000","last_became_active":"2023-09-30T13:56:05.022761+0000","last_became_peered":"2023-09-30T13:56:05.022761+0000","last_unstale":"2023-09-30T13:56:06.411524+0000","last_undegraded":"2023-09-30T13:56:06.411524+0000","last_fullsized":"2023-09-30T13:56:06.411524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232039+0000","last_change":"2023-09-30T13:56:05.416330+0000","last_active":"2023-09-30T13:56:07.232039+0000","last_peered":"2023-09-30T13:56:07.232039+0000","last_clean":"2023-09-30T13:56:07.232039+0000","last_became_active":"2023-09-30T13:56:05.415996+0000","last_became_peered":"2023-09-30T13:56:05.415996+0000","last_unstale":"2023-09-30T13:56:07.232039+0000","last_undegraded":"2023-09-30T13:56:07.232039+0000","last_fullsized":"2023-09-30T13:56:07.232039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:57.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231616+0000","last_change":"2023-09-30T13:56:05.026762+0000","last_active":"2023-09-30T13:56:07.231616+0000","last_peered":"2023-09-30T13:56:07.231616+0000","last_clean":"2023-09-30T13:56:07.231616+0000","last_became_active":"2023-09-30T13:56:05.025474+0000","last_became_peered":"2023-09-30T13:56:05.025474+0000","last_unstale":"2023-09-30T13:56:07.231616+0000","last_undegraded":"2023-09-30T13:56:07.231616+0000","last_fullsized":"2023-09-30T13:56:07.231616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:03.717220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866423+0000","last_change":"2023-09-30T13:56:05.427573+0000","last_active":"2023-09-30T13:56:06.866423+0000","last_peered":"2023-09-30T13:56:06.866423+0000","last_clean":"2023-09-30T13:56:06.866423+0000","last_became_active":"2023-09-30T13:56:05.427099+0000","last_became_peered":"2023-09-30T13:56:05.427099+0000","last_unstale":"2023-09-30T13:56:06.866423+0000","last_undegraded":"2023-09-30T13:56:06.866423+0000","last_fullsized":"2023-09-30T13:56:06.866423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411122+0000","last_change":"2023-09-30T13:56:05.018971+0000","last_active":"2023-09-30T13:56:06.411122+0000","last_peered":"2023-09-30T13:56:06.411122+0000","last_clean":"2023-09-30T13:56:06.411122+0000","last_became_active":"2023-09-30T13:56:05.018657+0000","last_became_peered":"2023-09-30T13:56:05.018657+0000","last_unstale":"2023-09-30T13:56:06.411122+0000","last_undegraded":"2023-09-30T13:56:06.411122+0000","last_fullsized":"2023-09-30T13:56:06.411122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232981+0000","last_change":"2023-09-30T13:56:05.429413+0000","last_active":"2023-09-30T13:56:07.232981+0000","last_peered":"2023-09-30T13:56:07.232981+0000","last_clean":"2023-09-30T13:56:07.232981+0000","last_became_active":"2023-09-30T13:56:05.429084+0000","last_became_peered":"2023-09-30T13:56:05.429084+0000","last_unstale":"2023-09-30T13:56:07.232981+0000","last_undegraded":"2023-09-30T13:56:07.232981+0000","last_fullsized":"2023-09-30T13:56:07.232981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:58:09.108273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866162+0000","last_change":"2023-09-30T13:56:05.032091+0000","last_active":"2023-09-30T13:56:06.866162+0000","last_peered":"2023-09-30T13:56:06.866162+0000","last_clean":"2023-09-30T13:56:06.866162+0000","last_became_active":"2023-09-30T13:56:05.031821+0000","last_became_peered":"2023-09-30T13:56:05.031821+0000","last_unstale":"2023-09-30T13:56:06.866162+0000","last_undegraded":"2023-09-30T13:56:06.866162+0000","last_fullsized":"2023-09-30T13:56:06.866162+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-30T13:56:05.417519+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:56:05.417519+0000","last_peered":"2023-09-30T13:56:05.417519+0000","last_clean":"2023-09-30T13:56:05.417519+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:56:05.417519+0000","last_undegraded":"2023-09-30T13:56:05.417519+0000","last_fullsized":"2023-09-30T13:56:05.417519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":781218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.378}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.75}]},{"osd":7,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.621}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":183152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.42699999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":190814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.629}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.38}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.378}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.497}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.432},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.48199999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":772950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.623},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:56:13.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:56:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.568+0000 7f551a8b4640 1 Processor -- start 2023-09-30T13:56:13.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.568+0000 7f551a8b4640 1 -- start start 2023-09-30T13:56:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f551a8b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f55140cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f551a8b4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55140ab250 0x7f55140ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f551a8b4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140cf3d0 con 0x7f55140cdc20 2023-09-30T13:56:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f551a8b4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140b2e50 con 0x7f55140ab250 2023-09-30T13:56:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f551a8b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140ac2d0 con 0x7f55140cea30 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f5513fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f55140cdc20 0x7f55140b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55452/0 (socket says 172.21.15.62:55452) 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f5513fff640 1 -- 172.21.15.62:0/356159620 learned_addr learned my addr 172.21.15.62:0/356159620 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f5518e51640 1 --2- 172.21.15.62:0/356159620 >> v2:172.21.15.135:3300/0 conn(0x7f55140ab250 0x7f55140ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663330688 0 0) 0x7f55140cf3d0 con 0x7f55140cdc20 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f55137fe640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f55140cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.569+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc003520 con 0x7f55140cdc20 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466247869 0 0) 0x7f54fc003520 con 0x7f55140cdc20 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 msgr2=0x7f55140cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f55140cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 >> v2:172.21.15.135:3300/0 conn(0x7f55140ab250 msgr2=0x7f55140ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 --2- 172.21.15.62:0/356159620 >> v2:172.21.15.135:3300/0 conn(0x7f55140ab250 0x7f55140ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140cc340 con 0x7f55140cdc20 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f55080017f0 con 0x7f55140cdc20 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 >> v1:172.21.15.62:6789/0 conn(0x7f55140cdc20 legacy=0x7f55140b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc003970 0x7f54fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f54fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54fc004d00 0x7f54fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140b2e50 con 0x7f54fc004d00 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140ac2d0 con 0x7f54fc003970 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc00b980 con 0x7f55140cea30 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54fc004d00 0x7f54fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5513fff640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc003970 0x7f54fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f55137fe640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f54fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 -- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 msgr2=0x7f54fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140cea30 0x7f54fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 -- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc003970 msgr2=0x7f54fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc003970 0x7f54fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.570+0000 7f5518e51640 1 -- 172.21.15.62:0/356159620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc003520 con 0x7f54fc004d00 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.571+0000 7f5518e51640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54fc004d00 0x7f54fc005180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f550c009fc0 tx=0x7f54fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853f1394cb42faa5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.571+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c02cc60 con 0x7f54fc004d00 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.571+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00f040 con 0x7f54fc004d00 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.571+0000 7f5512ffd640 1 -- 172.21.15.62:0/356159620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c034440 con 0x7f54fc004d00 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 -- 172.21.15.62:0/356159620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54fc004d00 msgr2=0x7f54fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 --2- 172.21.15.62:0/356159620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54fc004d00 0x7f54fc005180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f550c009fc0 tx=0x7f54fc0057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f5518e51640 1 -- 172.21.15.62:0/356159620 reap_dead start 2023-09-30T13:56:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 -- 172.21.15.62:0/356159620 shutdown_connections 2023-09-30T13:56:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 -- 172.21.15.62:0/356159620 >> 172.21.15.62:0/356159620 conn(0x7f551406a170 msgr2=0x7f551406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 -- 172.21.15.62:0/356159620 shutdown_connections 2023-09-30T13:56:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.572+0000 7f551a8b4640 1 -- 172.21.15.62:0/356159620 wait complete. 2023-09-30T13:56:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.573+0000 7f551a8b4640 1 Processor -- start 2023-09-30T13:56:13.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.573+0000 7f551a8b4640 1 -- start start 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140c8140 0x7f55140ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55140abb70 0x7f55141f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140abff0 con 0x7f5514158790 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551415afc0 con 0x7f55140abb70 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f551a8b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551415b280 con 0x7f55140c8140 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56972/0 (socket says 172.21.15.62:56972) 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 -- 172.21.15.62:0/1288686495 learned_addr learned my addr 172.21.15.62:0/1288686495 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5518e51640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55140abb70 0x7f55141f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f55137fe640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140c8140 0x7f55140ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 -- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140c8140 msgr2=0x7f55140ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140c8140 0x7f55140ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 -- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55140abb70 msgr2=0x7f55141f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55140abb70 0x7f55141f36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 -- 172.21.15.62:0/1288686495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551415b560 con 0x7f5514158790 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.574+0000 7f5513fff640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5508000ef0 tx=0x7f550800ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.575+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080072e0 con 0x7f5514158790 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.575+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508007440 con 0x7f5514158790 2023-09-30T13:56:13.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.575+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551415b840 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.575+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800d7f0 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.575+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55140c5280 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.576+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551404e0d0 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.576+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f550800d950 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.577+0000 7f5510ff9640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 0x7f550006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.577+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5508089660 con 0x7f5514158790 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.577+0000 7f55137fe640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 0x7f550006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.578+0000 7f55137fe640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 0x7f550006d020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5514070e20 tx=0x7f5504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.581+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5508054770 con 0x7f5514158790 2023-09-30T13:56:13.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.755+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55140cc900 con 0x7f550006ab60 2023-09-30T13:56:13.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.763+0000 7f5510ff9640 1 -- 172.21.15.62:0/1288686495 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289588 (secure 0 0 0) 0x7f5504013960 con 0x7f550006ab60 2023-09-30T13:56:13.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:13.766 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 msgr2=0x7f550006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 0x7f550006d020 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5514070e20 tx=0x7f5504008040 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 msgr2=0x7f55140c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5508000ef0 tx=0x7f550800ff80 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 shutdown_connections 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f550006ab60 0x7f550006d020 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55140abb70 0x7f55141f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55140c8140 0x7f55140ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 --2- 172.21.15.62:0/1288686495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5514158790 0x7f55140c7c00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 >> 172.21.15.62:0/1288686495 conn(0x7f551406a170 msgr2=0x7f55140702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:13.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 shutdown_connections 2023-09-30T13:56:13.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.766+0000 7f551a8b4640 1 -- 172.21.15.62:0/1288686495 wait complete. 2023-09-30T13:56:13.776 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-30T13:56:13.694208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220844,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753876,"statfs":{"total":773094113280,"available":772867969024,"internally_reserved":0,"allocated":4759552,"data_stored":2698900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.285944"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411627+0000","last_change":"2023-09-30T13:56:05.420040+0000","last_active":"2023-09-30T13:56:06.411627+0000","last_peered":"2023-09-30T13:56:06.411627+0000","last_clean":"2023-09-30T13:56:06.411627+0000","last_became_active":"2023-09-30T13:56:05.419799+0000","last_became_peered":"2023-09-30T13:56:05.419799+0000","last_unstale":"2023-09-30T13:56:06.411627+0000","last_undegraded":"2023-09-30T13:56:06.411627+0000","last_fullsized":"2023-09-30T13:56:06.411627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411410+0000","last_change":"2023-09-30T13:56:05.417471+0000","last_active":"2023-09-30T13:56:06.411410+0000","last_peered":"2023-09-30T13:56:06.411410+0000","last_clean":"2023-09-30T13:56:06.411410+0000","last_became_active":"2023-09-30T13:56:05.416791+0000","last_became_peered":"2023-09-30T13:56:05.416791+0000","last_unstale":"2023-09-30T13:56:06.411410+0000","last_undegraded":"2023-09-30T13:56:06.411410+0000","last_fullsized":"2023-09-30T13:56:06.411410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106158+0000","last_change":"2023-09-30T13:56:05.426264+0000","last_active":"2023-09-30T13:56:07.106158+0000","last_peered":"2023-09-30T13:56:07.106158+0000","last_clean":"2023-09-30T13:56:07.106158+0000","last_became_active":"2023-09-30T13:56:05.425996+0000","last_became_peered":"2023-09-30T13:56:05.425996+0000","last_unstale":"2023-09-30T13:56:07.106158+0000","last_undegraded":"2023-09-30T13:56:07.106158+0000","last_fullsized":"2023-09-30T13:56:07.106158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412164+0000","last_change":"2023-09-30T13:56:05.415699+0000","last_active":"2023-09-30T13:56:06.412164+0000","last_peered":"2023-09-30T13:56:06.412164+0000","last_clean":"2023-09-30T13:56:06.412164+0000","last_became_active":"2023-09-30T13:56:05.415434+0000","last_became_peered":"2023-09-30T13:56:05.415434+0000","last_unstale":"2023-09-30T13:56:06.412164+0000","last_undegraded":"2023-09-30T13:56:06.412164+0000","last_fullsized":"2023-09-30T13:56:06.412164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:51:29.923797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411958+0000","last_change":"2023-09-30T13:56:05.414021+0000","last_active":"2023-09-30T13:56:06.411958+0000","last_peered":"2023-09-30T13:56:06.411958+0000","last_clean":"2023-09-30T13:56:06.411958+0000","last_became_active":"2023-09-30T13:56:05.412524+0000","last_became_peered":"2023-09-30T13:56:05.412524+0000","last_unstale":"2023-09-30T13:56:06.411958+0000","last_undegraded":"2023-09-30T13:56:06.411958+0000","last_fullsized":"2023-09-30T13:56:06.411958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:07:22.395707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231454+0000","last_change":"2023-09-30T13:56:05.422130+0000","last_active":"2023-09-30T13:56:07.231454+0000","last_peered":"2023-09-30T13:56:07.231454+0000","last_clean":"2023-09-30T13:56:07.231454+0000","last_became_active":"2023-09-30T13:56:05.421855+0000","last_became_peered":"2023-09-30T13:56:05.421855+0000","last_unstale":"2023-09-30T13:56:07.231454+0000","last_undegraded":"2023-09-30T13:56:07.231454+0000","last_fullsized":"2023-09-30T13:56:07.231454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:26.197507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232217+0000","last_change":"2023-09-30T13:56:05.431278+0000","last_active":"2023-09-30T13:56:07.232217+0000","last_peered":"2023-09-30T13:56:07.232217+0000","last_clean":"2023-09-30T13:56:07.232217+0000","last_became_active":"2023-09-30T13:56:05.429588+0000","last_became_peered":"2023-09-30T13:56:05.429588+0000","last_unstale":"2023-09-30T13:56:07.232217+0000","last_undegraded":"2023-09-30T13:56:07.232217+0000","last_fullsized":"2023-09-30T13:56:07.232217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411112+0000","last_change":"2023-09-30T13:56:05.425541+0000","last_active":"2023-09-30T13:56:06.411112+0000","last_peered":"2023-09-30T13:56:06.411112+0000","last_clean":"2023-09-30T13:56:06.411112+0000","last_became_active":"2023-09-30T13:56:05.425266+0000","last_became_peered":"2023-09-30T13:56:05.425266+0000","last_unstale":"2023-09-30T13:56:06.411112+0000","last_undegraded":"2023-09-30T13:56:06.411112+0000","last_fullsized":"2023-09-30T13:56:06.411112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106368+0000","last_change":"2023-09-30T13:56:05.426569+0000","last_active":"2023-09-30T13:56:07.106368+0000","last_peered":"2023-09-30T13:56:07.106368+0000","last_clean":"2023-09-30T13:56:07.106368+0000","last_became_active":"2023-09-30T13:56:05.426275+0000","last_became_peered":"2023-09-30T13:56:05.426275+0000","last_unstale":"2023-09-30T13:56:07.106368+0000","last_undegraded":"2023-09-30T13:56:07.106368+0000","last_fullsized":"2023-09-30T13:56:07.106368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232736+0000","last_change":"2023-09-30T13:56:05.430304+0000","last_active":"2023-09-30T13:56:07.232736+0000","last_peered":"2023-09-30T13:56:07.232736+0000","last_clean":"2023-09-30T13:56:07.232736+0000","last_became_active":"2023-09-30T13:56:05.430014+0000","last_became_peered":"2023-09-30T13:56:05.430014+0000","last_unstale":"2023-09-30T13:56:07.232736+0000","last_undegraded":"2023-09-30T13:56:07.232736+0000","last_fullsized":"2023-09-30T13:56:07.232736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:23:17.184954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232605+0000","last_change":"2023-09-30T13:56:05.428773+0000","last_active":"2023-09-30T13:56:07.232605+0000","last_peered":"2023-09-30T13:56:07.232605+0000","last_clean":"2023-09-30T13:56:07.232605+0000","last_became_active":"2023-09-30T13:56:05.428505+0000","last_became_peered":"2023-09-30T13:56:05.428505+0000","last_unstale":"2023-09-30T13:56:07.232605+0000","last_undegraded":"2023-09-30T13:56:07.232605+0000","last_fullsized":"2023-09-30T13:56:07.232605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106147+0000","last_change":"2023-09-30T13:56:05.425127+0000","last_active":"2023-09-30T13:56:07.106147+0000","last_peered":"2023-09-30T13:56:07.106147+0000","last_clean":"2023-09-30T13:56:07.106147+0000","last_became_active":"2023-09-30T13:56:05.424756+0000","last_became_peered":"2023-09-30T13:56:05.424756+0000","last_unstale":"2023-09-30T13:56:07.106147+0000","last_undegraded":"2023-09-30T13:56:07.106147+0000","last_fullsized":"2023-09-30T13:56:07.106147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:28:55.098378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232522+0000","last_change":"2023-09-30T13:56:05.430863+0000","last_active":"2023-09-30T13:56:07.232522+0000","last_peered":"2023-09-30T13:56:07.232522+0000","last_clean":"2023-09-30T13:56:07.232522+0000","last_became_active":"2023-09-30T13:56:05.430318+0000","last_became_peered":"2023-09-30T13:56:05.430318+0000","last_unstale":"2023-09-30T13:56:07.232522+0000","last_undegraded":"2023-09-30T13:56:07.232522+0000","last_fullsized":"2023-09-30T13:56:07.232522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:08:03.823555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231695+0000","last_change":"2023-09-30T13:56:05.423606+0000","last_active":"2023-09-30T13:56:07.231695+0000","last_peered":"2023-09-30T13:56:07.231695+0000","last_clean":"2023-09-30T13:56:07.231695+0000","last_became_active":"2023-09-30T13:56:05.421905+0000","last_became_peered":"2023-09-30T13:56:05.421905+0000","last_unstale":"2023-09-30T13:56:07.231695+0000","last_undegraded":"2023-09-30T13:56:07.231695+0000","last_fullsized":"2023-09-30T13:56:07.231695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:54.420405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232309+0000","last_change":"2023-09-30T13:56:05.431457+0000","last_active":"2023-09-30T13:56:07.232309+0000","last_peered":"2023-09-30T13:56:07.232309+0000","last_clean":"2023-09-30T13:56:07.232309+0000","last_became_active":"2023-09-30T13:56:05.430721+0000","last_became_peered":"2023-09-30T13:56:05.430721+0000","last_unstale":"2023-09-30T13:56:07.232309+0000","last_undegraded":"2023-09-30T13:56:07.232309+0000","last_fullsized":"2023-09-30T13:56:07.232309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865936+0000","last_change":"2023-09-30T13:56:05.427440+0000","last_active":"2023-09-30T13:56:06.865936+0000","last_peered":"2023-09-30T13:56:06.865936+0000","last_clean":"2023-09-30T13:56:06.865936+0000","last_became_active":"2023-09-30T13:56:05.427128+0000","last_became_peered":"2023-09-30T13:56:05.427128+0000","last_unstale":"2023-09-30T13:56:06.865936+0000","last_undegraded":"2023-09-30T13:56:06.865936+0000","last_fullsized":"2023-09-30T13:56:06.865936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866384+0000","last_change":"2023-09-30T13:56:05.428154+0000","last_active":"2023-09-30T13:56:06.866384+0000","last_peered":"2023-09-30T13:56:06.866384+0000","last_clean":"2023-09-30T13:56:06.866384+0000","last_became_active":"2023-09-30T13:56:05.427819+0000","last_became_peered":"2023-09-30T13:56:05.427819+0000","last_unstale":"2023-09-30T13:56:06.866384+0000","last_undegraded":"2023-09-30T13:56:06.866384+0000","last_fullsized":"2023-09-30T13:56:06.866384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411849+0000","last_change":"2023-09-30T13:56:05.419494+0000","last_active":"2023-09-30T13:56:06.411849+0000","last_peered":"2023-09-30T13:56:06.411849+0000","last_clean":"2023-09-30T13:56:06.411849+0000","last_became_active":"2023-09-30T13:56:05.419234+0000","last_became_peered":"2023-09-30T13:56:05.419234+0000","last_unstale":"2023-09-30T13:56:06.411849+0000","last_undegraded":"2023-09-30T13:56:06.411849+0000","last_fullsized":"2023-09-30T13:56:06.411849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412242+0000","last_change":"2023-09-30T13:56:05.419551+0000","last_active":"2023-09-30T13:56:06.412242+0000","last_peered":"2023-09-30T13:56:06.412242+0000","last_clean":"2023-09-30T13:56:06.412242+0000","last_became_active":"2023-09-30T13:56:05.419278+0000","last_became_peered":"2023-09-30T13:56:05.419278+0000","last_unstale":"2023-09-30T13:56:06.412242+0000","last_undegraded":"2023-09-30T13:56:06.412242+0000","last_fullsized":"2023-09-30T13:56:06.412242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:14.958753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411632+0000","last_change":"2023-09-30T13:56:05.416952+0000","last_active":"2023-09-30T13:56:06.411632+0000","last_peered":"2023-09-30T13:56:06.411632+0000","last_clean":"2023-09-30T13:56:06.411632+0000","last_became_active":"2023-09-30T13:56:05.416698+0000","last_became_peered":"2023-09-30T13:56:05.416698+0000","last_unstale":"2023-09-30T13:56:06.411632+0000","last_undegraded":"2023-09-30T13:56:06.411632+0000","last_fullsized":"2023-09-30T13:56:06.411632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232537+0000","last_change":"2023-09-30T13:56:05.430649+0000","last_active":"2023-09-30T13:56:07.232537+0000","last_peered":"2023-09-30T13:56:07.232537+0000","last_clean":"2023-09-30T13:56:07.232537+0000","last_became_active":"2023-09-30T13:56:05.429943+0000","last_became_peered":"2023-09-30T13:56:05.429943+0000","last_unstale":"2023-09-30T13:56:07.232537+0000","last_undegraded":"2023-09-30T13:56:07.232537+0000","last_fullsized":"2023-09-30T13:56:07.232537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232458+0000","last_change":"2023-09-30T13:56:05.419088+0000","last_active":"2023-09-30T13:56:07.232458+0000","last_peered":"2023-09-30T13:56:07.232458+0000","last_clean":"2023-09-30T13:56:07.232458+0000","last_became_active":"2023-09-30T13:56:05.418821+0000","last_became_peered":"2023-09-30T13:56:05.418821+0000","last_unstale":"2023-09-30T13:56:07.232458+0000","last_undegraded":"2023-09-30T13:56:07.232458+0000","last_fullsized":"2023-09-30T13:56:07.232458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865972+0000","last_change":"2023-09-30T13:56:05.427153+0000","last_active":"2023-09-30T13:56:06.865972+0000","last_peered":"2023-09-30T13:56:06.865972+0000","last_clean":"2023-09-30T13:56:06.865972+0000","last_became_active":"2023-09-30T13:56:05.426436+0000","last_became_peered":"2023-09-30T13:56:05.426436+0000","last_unstale":"2023-09-30T13:56:06.865972+0000","last_undegraded":"2023-09-30T13:56:06.865972+0000","last_fullsized":"2023-09-30T13:56:06.865972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411911+0000","last_change":"2023-09-30T13:56:05.428121+0000","last_active":"2023-09-30T13:56:06.411911+0000","last_peered":"2023-09-30T13:56:06.411911+0000","last_clean":"2023-09-30T13:56:06.411911+0000","last_became_active":"2023-09-30T13:56:05.427891+0000","last_became_peered":"2023-09-30T13:56:05.427891+0000","last_unstale":"2023-09-30T13:56:06.411911+0000","last_undegraded":"2023-09-30T13:56:06.411911+0000","last_fullsized":"2023-09-30T13:56:06.411911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:45:27.320047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411903+0000","last_change":"2023-09-30T13:56:05.419037+0000","last_active":"2023-09-30T13:56:06.411903+0000","last_peered":"2023-09-30T13:56:06.411903+0000","last_clean":"2023-09-30T13:56:06.411903+0000","last_became_active":"2023-09-30T13:56:05.418757+0000","last_became_peered":"2023-09-30T13:56:05.418757+0000","last_unstale":"2023-09-30T13:56:06.411903+0000","last_undegraded":"2023-09-30T13:56:06.411903+0000","last_fullsized":"2023-09-30T13:56:06.411903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231619+0000","last_change":"2023-09-30T13:56:05.425990+0000","last_active":"2023-09-30T13:56:07.231619+0000","last_peered":"2023-09-30T13:56:07.231619+0000","last_clean":"2023-09-30T13:56:07.231619+0000","last_became_active":"2023-09-30T13:56:05.425677+0000","last_became_peered":"2023-09-30T13:56:05.425677+0000","last_unstale":"2023-09-30T13:56:07.231619+0000","last_undegraded":"2023-09-30T13:56:07.231619+0000","last_fullsized":"2023-09-30T13:56:07.231619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411782+0000","last_change":"2023-09-30T13:56:05.419570+0000","last_active":"2023-09-30T13:56:06.411782+0000","last_peered":"2023-09-30T13:56:06.411782+0000","last_clean":"2023-09-30T13:56:06.411782+0000","last_became_active":"2023-09-30T13:56:05.418645+0000","last_became_peered":"2023-09-30T13:56:05.418645+0000","last_unstale":"2023-09-30T13:56:06.411782+0000","last_undegraded":"2023-09-30T13:56:06.411782+0000","last_fullsized":"2023-09-30T13:56:06.411782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232462+0000","last_change":"2023-09-30T13:56:05.423744+0000","last_active":"2023-09-30T13:56:07.232462+0000","last_peered":"2023-09-30T13:56:07.232462+0000","last_clean":"2023-09-30T13:56:07.232462+0000","last_became_active":"2023-09-30T13:56:05.423457+0000","last_became_peered":"2023-09-30T13:56:05.423457+0000","last_unstale":"2023-09-30T13:56:07.232462+0000","last_undegraded":"2023-09-30T13:56:07.232462+0000","last_fullsized":"2023-09-30T13:56:07.232462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.422761+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.421999+0000","last_became_peered":"2023-09-30T13:56:05.421999+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411510+0000","last_change":"2023-09-30T13:56:05.423384+0000","last_active":"2023-09-30T13:56:06.411510+0000","last_peered":"2023-09-30T13:56:06.411510+0000","last_clean":"2023-09-30T13:56:06.411510+0000","last_became_active":"2023-09-30T13:56:05.423055+0000","last_became_peered":"2023-09-30T13:56:05.423055+0000","last_unstale":"2023-09-30T13:56:06.411510+0000","last_undegraded":"2023-09-30T13:56:06.411510+0000","last_fullsized":"2023-09-30T13:56:06.411510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866252+0000","last_change":"2023-09-30T13:56:05.427583+0000","last_active":"2023-09-30T13:56:06.866252+0000","last_peered":"2023-09-30T13:56:06.866252+0000","last_clean":"2023-09-30T13:56:06.866252+0000","last_became_active":"2023-09-30T13:56:05.426872+0000","last_became_peered":"2023-09-30T13:56:05.426872+0000","last_unstale":"2023-09-30T13:56:06.866252+0000","last_undegraded":"2023-09-30T13:56:06.866252+0000","last_fullsized":"2023-09-30T13:56:06.866252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:24:15.184492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231455+0000","last_change":"2023-09-30T13:56:05.424956+0000","last_active":"2023-09-30T13:56:07.231455+0000","last_peered":"2023-09-30T13:56:07.231455+0000","last_clean":"2023-09-30T13:56:07.231455+0000","last_became_active":"2023-09-30T13:56:05.424699+0000","last_became_peered":"2023-09-30T13:56:05.424699+0000","last_unstale":"2023-09-30T13:56:07.231455+0000","last_undegraded":"2023-09-30T13:56:07.231455+0000","last_fullsized":"2023-09-30T13:56:07.231455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866303+0000","last_change":"2023-09-30T13:56:05.428142+0000","last_active":"2023-09-30T13:56:06.866303+0000","last_peered":"2023-09-30T13:56:06.866303+0000","last_clean":"2023-09-30T13:56:06.866303+0000","last_became_active":"2023-09-30T13:56:05.427802+0000","last_became_peered":"2023-09-30T13:56:05.427802+0000","last_unstale":"2023-09-30T13:56:06.866303+0000","last_undegraded":"2023-09-30T13:56:06.866303+0000","last_fullsized":"2023-09-30T13:56:06.866303+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411916+0000","last_change":"2023-09-30T13:56:05.018389+0000","last_active":"2023-09-30T13:56:06.411916+0000","last_peered":"2023-09-30T13:56:06.411916+0000","last_clean":"2023-09-30T13:56:06.411916+0000","last_became_active":"2023-09-30T13:56:05.018132+0000","last_became_peered":"2023-09-30T13:56:05.018132+0000","last_unstale":"2023-09-30T13:56:06.411916+0000","last_undegraded":"2023-09-30T13:56:06.411916+0000","last_fullsized":"2023-09-30T13:56:06.411916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231801+0000","last_change":"2023-09-30T13:56:05.425856+0000","last_active":"2023-09-30T13:56:07.231801+0000","last_peered":"2023-09-30T13:56:07.231801+0000","last_clean":"2023-09-30T13:56:07.231801+0000","last_became_active":"2023-09-30T13:56:05.425581+0000","last_became_peered":"2023-09-30T13:56:05.425581+0000","last_unstale":"2023-09-30T13:56:07.231801+0000","last_undegraded":"2023-09-30T13:56:07.231801+0000","last_fullsized":"2023-09-30T13:56:07.231801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106273+0000","last_change":"2023-09-30T13:56:05.027198+0000","last_active":"2023-09-30T13:56:07.106273+0000","last_peered":"2023-09-30T13:56:07.106273+0000","last_clean":"2023-09-30T13:56:07.106273+0000","last_became_active":"2023-09-30T13:56:05.026910+0000","last_became_peered":"2023-09-30T13:56:05.026910+0000","last_unstale":"2023-09-30T13:56:07.106273+0000","last_undegraded":"2023-09-30T13:56:07.106273+0000","last_fullsized":"2023-09-30T13:56:07.106273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232148+0000","last_change":"2023-09-30T13:56:05.420489+0000","last_active":"2023-09-30T13:56:07.232148+0000","last_peered":"2023-09-30T13:56:07.232148+0000","last_clean":"2023-09-30T13:56:07.232148+0000","last_became_active":"2023-09-30T13:56:05.420207+0000","last_became_peered":"2023-09-30T13:56:05.420207+0000","last_unstale":"2023-09-30T13:56:07.232148+0000","last_undegraded":"2023-09-30T13:56:07.232148+0000","last_fullsized":"2023-09-30T13:56:07.232148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:41.635266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231779+0000","last_change":"2023-09-30T13:56:05.022903+0000","last_active":"2023-09-30T13:56:07.231779+0000","last_peered":"2023-09-30T13:56:07.231779+0000","last_clean":"2023-09-30T13:56:07.231779+0000","last_became_active":"2023-09-30T13:56:05.022613+0000","last_became_peered":"2023-09-30T13:56:05.022613+0000","last_unstale":"2023-09-30T13:56:07.231779+0000","last_undegraded":"2023-09-30T13:56:07.231779+0000","last_fullsized":"2023-09-30T13:56:07.231779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:42.196434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411613+0000","last_change":"2023-09-30T13:56:05.423430+0000","last_active":"2023-09-30T13:56:06.411613+0000","last_peered":"2023-09-30T13:56:06.411613+0000","last_clean":"2023-09-30T13:56:06.411613+0000","last_became_active":"2023-09-30T13:56:05.423127+0000","last_became_peered":"2023-09-30T13:56:05.423127+0000","last_unstale":"2023-09-30T13:56:06.411613+0000","last_undegraded":"2023-09-30T13:56:06.411613+0000","last_fullsized":"2023-09-30T13:56:06.411613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:11:18.991440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231952+0000","last_change":"2023-09-30T13:56:05.023831+0000","last_active":"2023-09-30T13:56:07.231952+0000","last_peered":"2023-09-30T13:56:07.231952+0000","last_clean":"2023-09-30T13:56:07.231952+0000","last_became_active":"2023-09-30T13:56:05.023571+0000","last_became_peered":"2023-09-30T13:56:05.023571+0000","last_unstale":"2023-09-30T13:56:07.231952+0000","last_undegraded":"2023-09-30T13:56:07.231952+0000","last_fullsized":"2023-09-30T13:56:07.231952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106034+0000","last_change":"2023-09-30T13:56:05.420452+0000","last_active":"2023-09-30T13:56:07.106034+0000","last_peered":"2023-09-30T13:56:07.106034+0000","last_clean":"2023-09-30T13:56:07.106034+0000","last_became_active":"2023-09-30T13:56:05.420204+0000","last_became_peered":"2023-09-30T13:56:05.420204+0000","last_unstale":"2023-09-30T13:56:07.106034+0000","last_undegraded":"2023-09-30T13:56:07.106034+0000","last_fullsized":"2023-09-30T13:56:07.106034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232629+0000","last_change":"2023-09-30T13:56:05.023750+0000","last_active":"2023-09-30T13:56:07.232629+0000","last_peered":"2023-09-30T13:56:07.232629+0000","last_clean":"2023-09-30T13:56:07.232629+0000","last_became_active":"2023-09-30T13:56:05.023475+0000","last_became_peered":"2023-09-30T13:56:05.023475+0000","last_unstale":"2023-09-30T13:56:07.232629+0000","last_undegraded":"2023-09-30T13:56:07.232629+0000","last_fullsized":"2023-09-30T13:56:07.232629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:05.152067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232366+0000","last_change":"2023-09-30T13:56:05.425132+0000","last_active":"2023-09-30T13:56:07.232366+0000","last_peered":"2023-09-30T13:56:07.232366+0000","last_clean":"2023-09-30T13:56:07.232366+0000","last_became_active":"2023-09-30T13:56:05.424796+0000","last_became_peered":"2023-09-30T13:56:05.424796+0000","last_unstale":"2023-09-30T13:56:07.232366+0000","last_undegraded":"2023-09-30T13:56:07.232366+0000","last_fullsized":"2023-09-30T13:56:07.232366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866074+0000","last_change":"2023-09-30T13:56:05.031611+0000","last_active":"2023-09-30T13:56:06.866074+0000","last_peered":"2023-09-30T13:56:06.866074+0000","last_clean":"2023-09-30T13:56:06.866074+0000","last_became_active":"2023-09-30T13:56:05.031229+0000","last_became_peered":"2023-09-30T13:56:05.031229+0000","last_unstale":"2023-09-30T13:56:06.866074+0000","last_undegraded":"2023-09-30T13:56:06.866074+0000","last_fullsized":"2023-09-30T13:56:06.866074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:40:59.798396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232315+0000","last_change":"2023-09-30T13:56:05.425565+0000","last_active":"2023-09-30T13:56:07.232315+0000","last_peered":"2023-09-30T13:56:07.232315+0000","last_clean":"2023-09-30T13:56:07.232315+0000","last_became_active":"2023-09-30T13:56:05.425288+0000","last_became_peered":"2023-09-30T13:56:05.425288+0000","last_unstale":"2023-09-30T13:56:07.232315+0000","last_undegraded":"2023-09-30T13:56:07.232315+0000","last_fullsized":"2023-09-30T13:56:07.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:23.719760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231618+0000","last_change":"2023-09-30T13:56:05.024829+0000","last_active":"2023-09-30T13:56:07.231618+0000","last_peered":"2023-09-30T13:56:07.231618+0000","last_clean":"2023-09-30T13:56:07.231618+0000","last_became_active":"2023-09-30T13:56:05.024568+0000","last_became_peered":"2023-09-30T13:56:05.024568+0000","last_unstale":"2023-09-30T13:56:07.231618+0000","last_undegraded":"2023-09-30T13:56:07.231618+0000","last_fullsized":"2023-09-30T13:56:07.231618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411265+0000","last_change":"2023-09-30T13:56:05.429283+0000","last_active":"2023-09-30T13:56:06.411265+0000","last_peered":"2023-09-30T13:56:06.411265+0000","last_clean":"2023-09-30T13:56:06.411265+0000","last_became_active":"2023-09-30T13:56:05.428988+0000","last_became_peered":"2023-09-30T13:56:05.428988+0000","last_unstale":"2023-09-30T13:56:06.411265+0000","last_undegraded":"2023-09-30T13:56:06.411265+0000","last_fullsized":"2023-09-30T13:56:06.411265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:04.266163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231642+0000","last_change":"2023-09-30T13:56:05.020445+0000","last_active":"2023-09-30T13:56:07.231642+0000","last_peered":"2023-09-30T13:56:07.231642+0000","last_clean":"2023-09-30T13:56:07.231642+0000","last_became_active":"2023-09-30T13:56:05.020184+0000","last_became_peered":"2023-09-30T13:56:05.020184+0000","last_unstale":"2023-09-30T13:56:07.231642+0000","last_undegraded":"2023-09-30T13:56:07.231642+0000","last_fullsized":"2023-09-30T13:56:07.231642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412227+0000","last_change":"2023-09-30T13:56:05.413074+0000","last_active":"2023-09-30T13:56:06.412227+0000","last_peered":"2023-09-30T13:56:06.412227+0000","last_clean":"2023-09-30T13:56:06.412227+0000","last_became_active":"2023-09-30T13:56:05.412825+0000","last_became_peered":"2023-09-30T13:56:05.412825+0000","last_unstale":"2023-09-30T13:56:06.412227+0000","last_undegraded":"2023-09-30T13:56:06.412227+0000","last_fullsized":"2023-09-30T13:56:06.412227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:15:57.774218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411698+0000","last_change":"2023-09-30T13:56:05.024356+0000","last_active":"2023-09-30T13:56:06.411698+0000","last_peered":"2023-09-30T13:56:06.411698+0000","last_clean":"2023-09-30T13:56:06.411698+0000","last_became_active":"2023-09-30T13:56:05.024047+0000","last_became_peered":"2023-09-30T13:56:05.024047+0000","last_unstale":"2023-09-30T13:56:06.411698+0000","last_undegraded":"2023-09-30T13:56:06.411698+0000","last_fullsized":"2023-09-30T13:56:06.411698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866427+0000","last_change":"2023-09-30T13:56:05.427700+0000","last_active":"2023-09-30T13:56:06.866427+0000","last_peered":"2023-09-30T13:56:06.866427+0000","last_clean":"2023-09-30T13:56:06.866427+0000","last_became_active":"2023-09-30T13:56:05.427183+0000","last_became_peered":"2023-09-30T13:56:05.427183+0000","last_unstale":"2023-09-30T13:56:06.866427+0000","last_undegraded":"2023-09-30T13:56:06.866427+0000","last_fullsized":"2023-09-30T13:56:06.866427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232936+0000","last_change":"2023-09-30T13:56:05.026290+0000","last_active":"2023-09-30T13:56:07.232936+0000","last_peered":"2023-09-30T13:56:07.232936+0000","last_clean":"2023-09-30T13:56:07.232936+0000","last_became_active":"2023-09-30T13:56:05.025969+0000","last_became_peered":"2023-09-30T13:56:05.025969+0000","last_unstale":"2023-09-30T13:56:07.232936+0000","last_undegraded":"2023-09-30T13:56:07.232936+0000","last_fullsized":"2023-09-30T13:56:07.232936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:17.133231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106286+0000","last_change":"2023-09-30T13:56:05.427209+0000","last_active":"2023-09-30T13:56:07.106286+0000","last_peered":"2023-09-30T13:56:07.106286+0000","last_clean":"2023-09-30T13:56:07.106286+0000","last_became_active":"2023-09-30T13:56:05.426884+0000","last_became_peered":"2023-09-30T13:56:05.426884+0000","last_unstale":"2023-09-30T13:56:07.106286+0000","last_undegraded":"2023-09-30T13:56:07.106286+0000","last_fullsized":"2023-09-30T13:56:07.106286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232661+0000","last_change":"2023-09-30T13:56:05.027961+0000","last_active":"2023-09-30T13:56:07.232661+0000","last_peered":"2023-09-30T13:56:07.232661+0000","last_clean":"2023-09-30T13:56:07.232661+0000","last_became_active":"2023-09-30T13:56:05.027693+0000","last_became_peered":"2023-09-30T13:56:05.027693+0000","last_unstale":"2023-09-30T13:56:07.232661+0000","last_undegraded":"2023-09-30T13:56:07.232661+0000","last_fullsized":"2023-09-30T13:56:07.232661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232080+0000","last_change":"2023-09-30T13:56:05.417132+0000","last_active":"2023-09-30T13:56:07.232080+0000","last_peered":"2023-09-30T13:56:07.232080+0000","last_clean":"2023-09-30T13:56:07.232080+0000","last_became_active":"2023-09-30T13:56:05.416832+0000","last_became_peered":"2023-09-30T13:56:05.416832+0000","last_unstale":"2023-09-30T13:56:07.232080+0000","last_undegraded":"2023-09-30T13:56:07.232080+0000","last_fullsized":"2023-09-30T13:56:07.232080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:17.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411487+0000","last_change":"2023-09-30T13:56:05.027519+0000","last_active":"2023-09-30T13:56:06.411487+0000","last_peered":"2023-09-30T13:56:06.411487+0000","last_clean":"2023-09-30T13:56:06.411487+0000","last_became_active":"2023-09-30T13:56:05.027240+0000","last_became_peered":"2023-09-30T13:56:05.027240+0000","last_unstale":"2023-09-30T13:56:06.411487+0000","last_undegraded":"2023-09-30T13:56:06.411487+0000","last_fullsized":"2023-09-30T13:56:06.411487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:04.099926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106081+0000","last_change":"2023-09-30T13:56:05.425318+0000","last_active":"2023-09-30T13:56:07.106081+0000","last_peered":"2023-09-30T13:56:07.106081+0000","last_clean":"2023-09-30T13:56:07.106081+0000","last_became_active":"2023-09-30T13:56:05.425067+0000","last_became_peered":"2023-09-30T13:56:05.425067+0000","last_unstale":"2023-09-30T13:56:07.106081+0000","last_undegraded":"2023-09-30T13:56:07.106081+0000","last_fullsized":"2023-09-30T13:56:07.106081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:43.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411486+0000","last_change":"2023-09-30T13:56:05.024545+0000","last_active":"2023-09-30T13:56:06.411486+0000","last_peered":"2023-09-30T13:56:06.411486+0000","last_clean":"2023-09-30T13:56:06.411486+0000","last_became_active":"2023-09-30T13:56:05.024255+0000","last_became_peered":"2023-09-30T13:56:05.024255+0000","last_unstale":"2023-09-30T13:56:06.411486+0000","last_undegraded":"2023-09-30T13:56:06.411486+0000","last_fullsized":"2023-09-30T13:56:06.411486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411300+0000","last_change":"2023-09-30T13:56:05.417483+0000","last_active":"2023-09-30T13:56:06.411300+0000","last_peered":"2023-09-30T13:56:06.411300+0000","last_clean":"2023-09-30T13:56:06.411300+0000","last_became_active":"2023-09-30T13:56:05.417154+0000","last_became_peered":"2023-09-30T13:56:05.417154+0000","last_unstale":"2023-09-30T13:56:06.411300+0000","last_undegraded":"2023-09-30T13:56:06.411300+0000","last_fullsized":"2023-09-30T13:56:06.411300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.024208+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.023897+0000","last_became_peered":"2023-09-30T13:56:05.023897+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866073+0000","last_change":"2023-09-30T13:56:05.425530+0000","last_active":"2023-09-30T13:56:06.866073+0000","last_peered":"2023-09-30T13:56:06.866073+0000","last_clean":"2023-09-30T13:56:06.866073+0000","last_became_active":"2023-09-30T13:56:05.425267+0000","last_became_peered":"2023-09-30T13:56:05.425267+0000","last_unstale":"2023-09-30T13:56:06.866073+0000","last_undegraded":"2023-09-30T13:56:06.866073+0000","last_fullsized":"2023-09-30T13:56:06.866073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:19.079150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411404+0000","last_change":"2023-09-30T13:56:05.019981+0000","last_active":"2023-09-30T13:56:06.411404+0000","last_peered":"2023-09-30T13:56:06.411404+0000","last_clean":"2023-09-30T13:56:06.411404+0000","last_became_active":"2023-09-30T13:56:05.019707+0000","last_became_peered":"2023-09-30T13:56:05.019707+0000","last_unstale":"2023-09-30T13:56:06.411404+0000","last_undegraded":"2023-09-30T13:56:06.411404+0000","last_fullsized":"2023-09-30T13:56:06.411404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:58:02.871108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411406+0000","last_change":"2023-09-30T13:56:05.418328+0000","last_active":"2023-09-30T13:56:06.411406+0000","last_peered":"2023-09-30T13:56:06.411406+0000","last_clean":"2023-09-30T13:56:06.411406+0000","last_became_active":"2023-09-30T13:56:05.417615+0000","last_became_peered":"2023-09-30T13:56:05.417615+0000","last_unstale":"2023-09-30T13:56:06.411406+0000","last_undegraded":"2023-09-30T13:56:06.411406+0000","last_fullsized":"2023-09-30T13:56:06.411406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.865931+0000","last_change":"2023-09-30T13:56:05.031440+0000","last_active":"2023-09-30T13:56:06.865931+0000","last_peered":"2023-09-30T13:56:06.865931+0000","last_clean":"2023-09-30T13:56:06.865931+0000","last_became_active":"2023-09-30T13:56:05.031110+0000","last_became_peered":"2023-09-30T13:56:05.031110+0000","last_unstale":"2023-09-30T13:56:06.865931+0000","last_undegraded":"2023-09-30T13:56:06.865931+0000","last_fullsized":"2023-09-30T13:56:06.865931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411452+0000","last_change":"2023-09-30T13:56:05.423405+0000","last_active":"2023-09-30T13:56:06.411452+0000","last_peered":"2023-09-30T13:56:06.411452+0000","last_clean":"2023-09-30T13:56:06.411452+0000","last_became_active":"2023-09-30T13:56:05.423132+0000","last_became_peered":"2023-09-30T13:56:05.423132+0000","last_unstale":"2023-09-30T13:56:06.411452+0000","last_undegraded":"2023-09-30T13:56:06.411452+0000","last_fullsized":"2023-09-30T13:56:06.411452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:42:44.627880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233017+0000","last_change":"2023-09-30T13:56:05.023723+0000","last_active":"2023-09-30T13:56:07.233017+0000","last_peered":"2023-09-30T13:56:07.233017+0000","last_clean":"2023-09-30T13:56:07.233017+0000","last_became_active":"2023-09-30T13:56:05.023454+0000","last_became_peered":"2023-09-30T13:56:05.023454+0000","last_unstale":"2023-09-30T13:56:07.233017+0000","last_undegraded":"2023-09-30T13:56:07.233017+0000","last_fullsized":"2023-09-30T13:56:07.233017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:57:18.075121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232596+0000","last_change":"2023-09-30T13:56:05.431567+0000","last_active":"2023-09-30T13:56:07.232596+0000","last_peered":"2023-09-30T13:56:07.232596+0000","last_clean":"2023-09-30T13:56:07.232596+0000","last_became_active":"2023-09-30T13:56:05.431246+0000","last_became_peered":"2023-09-30T13:56:05.431246+0000","last_unstale":"2023-09-30T13:56:07.232596+0000","last_undegraded":"2023-09-30T13:56:07.232596+0000","last_fullsized":"2023-09-30T13:56:07.232596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232264+0000","last_change":"2023-09-30T13:56:05.024797+0000","last_active":"2023-09-30T13:56:07.232264+0000","last_peered":"2023-09-30T13:56:07.232264+0000","last_clean":"2023-09-30T13:56:07.232264+0000","last_became_active":"2023-09-30T13:56:05.024377+0000","last_became_peered":"2023-09-30T13:56:05.024377+0000","last_unstale":"2023-09-30T13:56:07.232264+0000","last_undegraded":"2023-09-30T13:56:07.232264+0000","last_fullsized":"2023-09-30T13:56:07.232264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:48:03.565686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232086+0000","last_change":"2023-09-30T13:56:05.418093+0000","last_active":"2023-09-30T13:56:07.232086+0000","last_peered":"2023-09-30T13:56:07.232086+0000","last_clean":"2023-09-30T13:56:07.232086+0000","last_became_active":"2023-09-30T13:56:05.417749+0000","last_became_peered":"2023-09-30T13:56:05.417749+0000","last_unstale":"2023-09-30T13:56:07.232086+0000","last_undegraded":"2023-09-30T13:56:07.232086+0000","last_fullsized":"2023-09-30T13:56:07.232086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:06:00.090852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412257+0000","last_change":"2023-09-30T13:56:05.026612+0000","last_active":"2023-09-30T13:56:06.412257+0000","last_peered":"2023-09-30T13:56:06.412257+0000","last_clean":"2023-09-30T13:56:06.412257+0000","last_became_active":"2023-09-30T13:56:05.026286+0000","last_became_peered":"2023-09-30T13:56:05.026286+0000","last_unstale":"2023-09-30T13:56:06.412257+0000","last_undegraded":"2023-09-30T13:56:06.412257+0000","last_fullsized":"2023-09-30T13:56:06.412257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:28:14.007134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412124+0000","last_change":"2023-09-30T13:56:05.417529+0000","last_active":"2023-09-30T13:56:06.412124+0000","last_peered":"2023-09-30T13:56:06.412124+0000","last_clean":"2023-09-30T13:56:06.412124+0000","last_became_active":"2023-09-30T13:56:05.417268+0000","last_became_peered":"2023-09-30T13:56:05.417268+0000","last_unstale":"2023-09-30T13:56:06.412124+0000","last_undegraded":"2023-09-30T13:56:06.412124+0000","last_fullsized":"2023-09-30T13:56:06.412124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:05:43.691463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231522+0000","last_change":"2023-09-30T13:56:05.026479+0000","last_active":"2023-09-30T13:56:07.231522+0000","last_peered":"2023-09-30T13:56:07.231522+0000","last_clean":"2023-09-30T13:56:07.231522+0000","last_became_active":"2023-09-30T13:56:05.026207+0000","last_became_peered":"2023-09-30T13:56:05.026207+0000","last_unstale":"2023-09-30T13:56:07.231522+0000","last_undegraded":"2023-09-30T13:56:07.231522+0000","last_fullsized":"2023-09-30T13:56:07.231522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:47.241082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866185+0000","last_change":"2023-09-30T13:56:05.430870+0000","last_active":"2023-09-30T13:56:06.866185+0000","last_peered":"2023-09-30T13:56:06.866185+0000","last_clean":"2023-09-30T13:56:06.866185+0000","last_became_active":"2023-09-30T13:56:05.430516+0000","last_became_peered":"2023-09-30T13:56:05.430516+0000","last_unstale":"2023-09-30T13:56:06.866185+0000","last_undegraded":"2023-09-30T13:56:06.866185+0000","last_fullsized":"2023-09-30T13:56:06.866185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:46.876043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412054+0000","last_change":"2023-09-30T13:56:05.020968+0000","last_active":"2023-09-30T13:56:06.412054+0000","last_peered":"2023-09-30T13:56:06.412054+0000","last_clean":"2023-09-30T13:56:06.412054+0000","last_became_active":"2023-09-30T13:56:05.020698+0000","last_became_peered":"2023-09-30T13:56:05.020698+0000","last_unstale":"2023-09-30T13:56:06.412054+0000","last_undegraded":"2023-09-30T13:56:06.412054+0000","last_fullsized":"2023-09-30T13:56:06.412054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:30:35.380176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106059+0000","last_change":"2023-09-30T13:56:05.429248+0000","last_active":"2023-09-30T13:56:07.106059+0000","last_peered":"2023-09-30T13:56:07.106059+0000","last_clean":"2023-09-30T13:56:07.106059+0000","last_became_active":"2023-09-30T13:56:05.428978+0000","last_became_peered":"2023-09-30T13:56:05.428978+0000","last_unstale":"2023-09-30T13:56:07.106059+0000","last_undegraded":"2023-09-30T13:56:07.106059+0000","last_fullsized":"2023-09-30T13:56:07.106059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:48.245112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.412016+0000","last_change":"2023-09-30T13:56:05.017181+0000","last_active":"2023-09-30T13:56:06.412016+0000","last_peered":"2023-09-30T13:56:06.412016+0000","last_clean":"2023-09-30T13:56:06.412016+0000","last_became_active":"2023-09-30T13:56:05.016888+0000","last_became_peered":"2023-09-30T13:56:05.016888+0000","last_unstale":"2023-09-30T13:56:06.412016+0000","last_undegraded":"2023-09-30T13:56:06.412016+0000","last_fullsized":"2023-09-30T13:56:06.412016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:14:10.079773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232168+0000","last_change":"2023-09-30T13:56:05.424901+0000","last_active":"2023-09-30T13:56:07.232168+0000","last_peered":"2023-09-30T13:56:07.232168+0000","last_clean":"2023-09-30T13:56:07.232168+0000","last_became_active":"2023-09-30T13:56:05.424606+0000","last_became_peered":"2023-09-30T13:56:05.424606+0000","last_unstale":"2023-09-30T13:56:07.232168+0000","last_undegraded":"2023-09-30T13:56:07.232168+0000","last_fullsized":"2023-09-30T13:56:07.232168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:41.393631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866080+0000","last_change":"2023-09-30T13:56:05.031024+0000","last_active":"2023-09-30T13:56:06.866080+0000","last_peered":"2023-09-30T13:56:06.866080+0000","last_clean":"2023-09-30T13:56:06.866080+0000","last_became_active":"2023-09-30T13:56:05.030761+0000","last_became_peered":"2023-09-30T13:56:05.030761+0000","last_unstale":"2023-09-30T13:56:06.866080+0000","last_undegraded":"2023-09-30T13:56:06.866080+0000","last_fullsized":"2023-09-30T13:56:06.866080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:54:22.715731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411395+0000","last_change":"2023-09-30T13:56:05.427427+0000","last_active":"2023-09-30T13:56:06.411395+0000","last_peered":"2023-09-30T13:56:06.411395+0000","last_clean":"2023-09-30T13:56:06.411395+0000","last_became_active":"2023-09-30T13:56:05.427197+0000","last_became_peered":"2023-09-30T13:56:05.427197+0000","last_unstale":"2023-09-30T13:56:06.411395+0000","last_undegraded":"2023-09-30T13:56:06.411395+0000","last_fullsized":"2023-09-30T13:56:06.411395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:42:06.311842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411780+0000","last_change":"2023-09-30T13:56:05.018322+0000","last_active":"2023-09-30T13:56:06.411780+0000","last_peered":"2023-09-30T13:56:06.411780+0000","last_clean":"2023-09-30T13:56:06.411780+0000","last_became_active":"2023-09-30T13:56:05.018041+0000","last_became_peered":"2023-09-30T13:56:05.018041+0000","last_unstale":"2023-09-30T13:56:06.411780+0000","last_undegraded":"2023-09-30T13:56:06.411780+0000","last_fullsized":"2023-09-30T13:56:06.411780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:27:16.924592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231539+0000","last_change":"2023-09-30T13:56:05.429919+0000","last_active":"2023-09-30T13:56:07.231539+0000","last_peered":"2023-09-30T13:56:07.231539+0000","last_clean":"2023-09-30T13:56:07.231539+0000","last_became_active":"2023-09-30T13:56:05.429685+0000","last_became_peered":"2023-09-30T13:56:05.429685+0000","last_unstale":"2023-09-30T13:56:07.231539+0000","last_undegraded":"2023-09-30T13:56:07.231539+0000","last_fullsized":"2023-09-30T13:56:07.231539+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:01:05.103956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.233086+0000","last_change":"2023-09-30T13:56:05.027919+0000","last_active":"2023-09-30T13:56:07.233086+0000","last_peered":"2023-09-30T13:56:07.233086+0000","last_clean":"2023-09-30T13:56:07.233086+0000","last_became_active":"2023-09-30T13:56:05.027642+0000","last_became_peered":"2023-09-30T13:56:05.027642+0000","last_unstale":"2023-09-30T13:56:07.233086+0000","last_undegraded":"2023-09-30T13:56:07.233086+0000","last_fullsized":"2023-09-30T13:56:07.233086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:02:45.872014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866446+0000","last_change":"2023-09-30T13:56:05.428015+0000","last_active":"2023-09-30T13:56:06.866446+0000","last_peered":"2023-09-30T13:56:06.866446+0000","last_clean":"2023-09-30T13:56:06.866446+0000","last_became_active":"2023-09-30T13:56:05.427521+0000","last_became_peered":"2023-09-30T13:56:05.427521+0000","last_unstale":"2023-09-30T13:56:06.866446+0000","last_undegraded":"2023-09-30T13:56:06.866446+0000","last_fullsized":"2023-09-30T13:56:06.866446+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:33:57.034815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.694488+0000","last_change":"2023-09-30T13:56:05.026091+0000","last_active":"2023-09-30T13:56:07.694488+0000","last_peered":"2023-09-30T13:56:07.694488+0000","last_clean":"2023-09-30T13:56:07.694488+0000","last_became_active":"2023-09-30T13:56:05.025797+0000","last_became_peered":"2023-09-30T13:56:05.025797+0000","last_unstale":"2023-09-30T13:56:07.694488+0000","last_undegraded":"2023-09-30T13:56:07.694488+0000","last_fullsized":"2023-09-30T13:56:07.694488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:57:45.773605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411521+0000","last_change":"2023-09-30T13:56:05.418019+0000","last_active":"2023-09-30T13:56:06.411521+0000","last_peered":"2023-09-30T13:56:06.411521+0000","last_clean":"2023-09-30T13:56:06.411521+0000","last_became_active":"2023-09-30T13:56:05.417721+0000","last_became_peered":"2023-09-30T13:56:05.417721+0000","last_unstale":"2023-09-30T13:56:06.411521+0000","last_undegraded":"2023-09-30T13:56:06.411521+0000","last_fullsized":"2023-09-30T13:56:06.411521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:32:06.682024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106159+0000","last_change":"2023-09-30T13:56:05.029178+0000","last_active":"2023-09-30T13:56:07.106159+0000","last_peered":"2023-09-30T13:56:07.106159+0000","last_clean":"2023-09-30T13:56:07.106159+0000","last_became_active":"2023-09-30T13:56:05.028931+0000","last_became_peered":"2023-09-30T13:56:05.028931+0000","last_unstale":"2023-09-30T13:56:07.106159+0000","last_undegraded":"2023-09-30T13:56:07.106159+0000","last_fullsized":"2023-09-30T13:56:07.106159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:56.811792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106209+0000","last_change":"2023-09-30T13:56:05.419085+0000","last_active":"2023-09-30T13:56:07.106209+0000","last_peered":"2023-09-30T13:56:07.106209+0000","last_clean":"2023-09-30T13:56:07.106209+0000","last_became_active":"2023-09-30T13:56:05.418848+0000","last_became_peered":"2023-09-30T13:56:05.418848+0000","last_unstale":"2023-09-30T13:56:07.106209+0000","last_undegraded":"2023-09-30T13:56:07.106209+0000","last_fullsized":"2023-09-30T13:56:07.106209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:26:06.156096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.106349+0000","last_change":"2023-09-30T13:56:05.027449+0000","last_active":"2023-09-30T13:56:07.106349+0000","last_peered":"2023-09-30T13:56:07.106349+0000","last_clean":"2023-09-30T13:56:07.106349+0000","last_became_active":"2023-09-30T13:56:05.026839+0000","last_became_peered":"2023-09-30T13:56:05.026839+0000","last_unstale":"2023-09-30T13:56:07.106349+0000","last_undegraded":"2023-09-30T13:56:07.106349+0000","last_fullsized":"2023-09-30T13:56:07.106349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:36:16.637515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231609+0000","last_change":"2023-09-30T13:56:05.425626+0000","last_active":"2023-09-30T13:56:07.231609+0000","last_peered":"2023-09-30T13:56:07.231609+0000","last_clean":"2023-09-30T13:56:07.231609+0000","last_became_active":"2023-09-30T13:56:05.425145+0000","last_became_peered":"2023-09-30T13:56:05.425145+0000","last_unstale":"2023-09-30T13:56:07.231609+0000","last_undegraded":"2023-09-30T13:56:07.231609+0000","last_fullsized":"2023-09-30T13:56:07.231609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:59:18.137261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411524+0000","last_change":"2023-09-30T13:56:05.023063+0000","last_active":"2023-09-30T13:56:06.411524+0000","last_peered":"2023-09-30T13:56:06.411524+0000","last_clean":"2023-09-30T13:56:06.411524+0000","last_became_active":"2023-09-30T13:56:05.022761+0000","last_became_peered":"2023-09-30T13:56:05.022761+0000","last_unstale":"2023-09-30T13:56:06.411524+0000","last_undegraded":"2023-09-30T13:56:06.411524+0000","last_fullsized":"2023-09-30T13:56:06.411524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:53.416376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232039+0000","last_change":"2023-09-30T13:56:05.416330+0000","last_active":"2023-09-30T13:56:07.232039+0000","last_peered":"2023-09-30T13:56:07.232039+0000","last_clean":"2023-09-30T13:56:07.232039+0000","last_became_active":"2023-09-30T13:56:05.415996+0000","last_became_peered":"2023-09-30T13:56:05.415996+0000","last_unstale":"2023-09-30T13:56:07.232039+0000","last_undegraded":"2023-09-30T13:56:07.232039+0000","last_fullsized":"2023-09-30T13:56:07.232039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:57.815821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.231616+0000","last_change":"2023-09-30T13:56:05.026762+0000","last_active":"2023-09-30T13:56:07.231616+0000","last_peered":"2023-09-30T13:56:07.231616+0000","last_clean":"2023-09-30T13:56:07.231616+0000","last_became_active":"2023-09-30T13:56:05.025474+0000","last_became_peered":"2023-09-30T13:56:05.025474+0000","last_unstale":"2023-09-30T13:56:07.231616+0000","last_undegraded":"2023-09-30T13:56:07.231616+0000","last_fullsized":"2023-09-30T13:56:07.231616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:03.717220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866423+0000","last_change":"2023-09-30T13:56:05.427573+0000","last_active":"2023-09-30T13:56:06.866423+0000","last_peered":"2023-09-30T13:56:06.866423+0000","last_clean":"2023-09-30T13:56:06.866423+0000","last_became_active":"2023-09-30T13:56:05.427099+0000","last_became_peered":"2023-09-30T13:56:05.427099+0000","last_unstale":"2023-09-30T13:56:06.866423+0000","last_undegraded":"2023-09-30T13:56:06.866423+0000","last_fullsized":"2023-09-30T13:56:06.866423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:33:53.870388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.411122+0000","last_change":"2023-09-30T13:56:05.018971+0000","last_active":"2023-09-30T13:56:06.411122+0000","last_peered":"2023-09-30T13:56:06.411122+0000","last_clean":"2023-09-30T13:56:06.411122+0000","last_became_active":"2023-09-30T13:56:05.018657+0000","last_became_peered":"2023-09-30T13:56:05.018657+0000","last_unstale":"2023-09-30T13:56:06.411122+0000","last_undegraded":"2023-09-30T13:56:06.411122+0000","last_fullsized":"2023-09-30T13:56:06.411122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:07.232981+0000","last_change":"2023-09-30T13:56:05.429413+0000","last_active":"2023-09-30T13:56:07.232981+0000","last_peered":"2023-09-30T13:56:07.232981+0000","last_clean":"2023-09-30T13:56:07.232981+0000","last_became_active":"2023-09-30T13:56:05.429084+0000","last_became_peered":"2023-09-30T13:56:05.429084+0000","last_unstale":"2023-09-30T13:56:07.232981+0000","last_undegraded":"2023-09-30T13:56:07.232981+0000","last_fullsized":"2023-09-30T13:56:07.232981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:05.005566+0000","last_clean_scrub_stamp":"2023-09-30T13:56:05.005566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:58:09.108273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-30T13:56:06.866162+0000","last_change":"2023-09-30T13:56:05.032091+0000","last_active":"2023-09-30T13:56:06.866162+0000","last_peered":"2023-09-30T13:56:06.866162+0000","last_clean":"2023-09-30T13:56:06.866162+0000","last_became_active":"2023-09-30T13:56:05.031821+0000","last_became_peered":"2023-09-30T13:56:05.031821+0000","last_unstale":"2023-09-30T13:56:06.866162+0000","last_undegraded":"2023-09-30T13:56:06.866162+0000","last_fullsized":"2023-09-30T13:56:06.866162+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:56:04.001537+0000","last_clean_scrub_stamp":"2023-09-30T13:56:04.001537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:05:59.086823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-30T13:56:05.417519+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:56:05.417519+0000","last_peered":"2023-09-30T13:56:05.417519+0000","last_clean":"2023-09-30T13:56:05.417519+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:56:05.417519+0000","last_undegraded":"2023-09-30T13:56:05.417519+0000","last_fullsized":"2023-09-30T13:56:05.417519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":781218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.435},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.495},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.378}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":189280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.441},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.626},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.504}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":189772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.495}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.62},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.443},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":190814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.318},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.435}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.62}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.376}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.498},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.628},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Sep 30 13:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":779570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.5},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.86499999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.89700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:56:13.782 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T13:56:13.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T13:56:13.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.930+0000 7f07ffbe2640 1 Processor -- start 2023-09-30T13:56:13.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.930+0000 7f07ffbe2640 1 -- start start 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07f8159af0 0x7f07f80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f80add10 0x7f07f80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 0x7f07f80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80ce590 con 0x7f07f8159af0 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80ad730 con 0x7f07f80b4410 2023-09-30T13:56:13.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07ffbe2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80b42a0 con 0x7f07f80add10 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07f8159af0 0x7f07f80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07f8159af0 0x7f07f80b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56988/0 (socket says 172.21.15.62:56988) 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 -- 172.21.15.62:0/3572057942 learned_addr learned my addr 172.21.15.62:0/3572057942 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fe17f640 1 --2- 172.21.15.62:0/3572057942 >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 0x7f07f80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd17d640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f80add10 0x7f07f80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 -- 172.21.15.62:0/3572057942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f80add10 msgr2=0x7f07f80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f80add10 0x7f07f80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 -- 172.21.15.62:0/3572057942 >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 msgr2=0x7f07f80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 --2- 172.21.15.62:0/3572057942 >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 0x7f07f80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fd97e640 1 -- 172.21.15.62:0/3572057942 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80ad910 con 0x7f07f8159af0 2023-09-30T13:56:13.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.931+0000 7f07fe17f640 1 --2- 172.21.15.62:0/3572057942 >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 0x7f07f80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.932+0000 7f07fd97e640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f8159af0 0x7f07f80b0150 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f07f815d620 tx=0x7f07f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef018fc4e309253e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.932+0000 7f07fc97c640 1 -- 172.21.15.62:0/3572057942 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0031870 con 0x7f07f8159af0 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.932+0000 7f07fc97c640 1 -- 172.21.15.62:0/3572057942 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f00319d0 con 0x7f07f8159af0 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.932+0000 7f07fc97c640 1 -- 172.21.15.62:0/3572057942 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0031d60 con 0x7f07f8159af0 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 -- 172.21.15.62:0/3572057942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f8159af0 msgr2=0x7f07f80b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f8159af0 0x7f07f80b0150 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f07f815d620 tx=0x7f07f002b910 comp rx=0 tx=0).stop 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 -- 172.21.15.62:0/3572057942 shutdown_connections 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/3572057942 >> v2:172.21.15.135:3300/0 conn(0x7f07f80b4410 0x7f07f80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f80add10 0x7f07f80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/3572057942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f8159af0 0x7f07f80b0150 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 -- 172.21.15.62:0/3572057942 >> 172.21.15.62:0/3572057942 conn(0x7f07f806a7c0 msgr2=0x7f07f80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 -- 172.21.15.62:0/3572057942 shutdown_connections 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.933+0000 7f07ffbe2640 1 -- 172.21.15.62:0/3572057942 wait complete. 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.934+0000 7f07ffbe2640 1 Processor -- start 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.934+0000 7f07ffbe2640 1 -- start start 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 0x7f07f80c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f8159af0 0x7f07f80c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f815be10 con 0x7f07f80add10 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f815c0f0 con 0x7f07f80b4410 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07ffbe2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f815c3d0 con 0x7f07f8159af0 2023-09-30T13:56:13.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56998/0 (socket says 172.21.15.62:56998) 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 -- 172.21.15.62:0/304547593 learned_addr learned my addr 172.21.15.62:0/304547593 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd17d640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 0x7f07f80c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fe17f640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f8159af0 0x7f07f80c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 -- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f8159af0 msgr2=0x7f07f80c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f8159af0 0x7f07f80c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 -- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 msgr2=0x7f07f80c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 0x7f07f80c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 -- 172.21.15.62:0/304547593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00094d0 con 0x7f07f80add10 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd17d640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 0x7f07f80c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.935+0000 7f07fd97e640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f07f002b950 tx=0x7f07f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.936+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f003ad30 con 0x7f07f80add10 2023-09-30T13:56:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.936+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f00443f0 con 0x7f07f80add10 2023-09-30T13:56:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.936+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f815c6b0 con 0x7f07f80add10 2023-09-30T13:56:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.936+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00447a0 con 0x7f07f80add10 2023-09-30T13:56:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.936+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80caed0 con 0x7f07f80add10 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.937+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f815cbd0 con 0x7f07f80add10 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.937+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f07f004d450 con 0x7f07f80add10 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.937+0000 7f07f67fc640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 0x7f07e406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.938+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07f002d040 con 0x7f07f80add10 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.938+0000 7f07fd17d640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 0x7f07e406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:13.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.938+0000 7f07fd17d640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 0x7f07e406cff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07ec006fd0 tx=0x7f07ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:13.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:13.942+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f07f815cbd0 con 0x7f07f80add10 2023-09-30T13:56:14.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.185+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f07f815cbd0 con 0x7f07f80add10 2023-09-30T13:56:14.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.187+0000 7f07f67fc640 1 -- 172.21.15.62:0/304547593 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f07f815cbd0 con 0x7f07f80add10 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ== 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stdout: caps mds = "allow" 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stdout: caps mon = "allow r" 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-30T13:56:14.187 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 msgr2=0x7f07e406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 0x7f07e406cff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07ec006fd0 tx=0x7f07ec008040 comp rx=0 tx=0).stop 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 msgr2=0x7f07f80ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f07f002b950 tx=0x7f07f00046c0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 shutdown_connections 2023-09-30T13:56:14.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f07e406ab30 0x7f07e406cff0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07f8159af0 0x7f07f80c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f80b4410 0x7f07f80c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 --2- 172.21.15.62:0/304547593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07f80add10 0x7f07f80ca990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 >> 172.21.15.62:0/304547593 conn(0x7f07f806a7c0 msgr2=0x7f07f80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 shutdown_connections 2023-09-30T13:56:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.189+0000 7f07ffbe2640 1 -- 172.21.15.62:0/304547593 wait complete. 2023-09-30T13:56:14.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:56:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.306+0000 7f8c806e5640 1 Processor -- start 2023-09-30T13:56:14.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.306+0000 7f8c806e5640 1 -- start start 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c806e5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 0x7f8c780b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c806e5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c780cc210 0x7f8c78159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c806e5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c78159540 con 0x7f8c780caea0 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c806e5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780b1ea0 con 0x7f8c780cc210 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c806e5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7806ddf0 con 0x7f8c78158c20 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7dc80640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c780cc210 0x7f8c78159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7ec82640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8c780caea0 0x7f8c780cb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55456/0 (socket says 172.21.15.62:55456) 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7ec82640 1 -- 172.21.15.62:0/1315853070 learned_addr learned my addr 172.21.15.62:0/1315853070 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:14.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7e481640 1 --2- 172.21.15.62:0/1315853070 >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 0x7f8c780b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7dc80640 1 -- 172.21.15.62:0/1315853070 >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 msgr2=0x7f8c780b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7dc80640 1 --2- 172.21.15.62:0/1315853070 >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 0x7f8c780b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7dc80640 1 -- 172.21.15.62:0/1315853070 >> v1:172.21.15.62:6789/0 conn(0x7f8c780caea0 legacy=0x7f8c780cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7dc80640 1 -- 172.21.15.62:0/1315853070 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780cdf30 con 0x7f8c780cc210 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7d47f640 1 -- 172.21.15.62:0/1315853070 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814570198 0 0) 0x7f8c78159540 con 0x7f8c780caea0 2023-09-30T13:56:14.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.307+0000 7f8c7e481640 1 --2- 172.21.15.62:0/1315853070 >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 0x7f8c780b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c7dc80640 1 --2- 172.21.15.62:0/1315853070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780cc210 0x7f8c78159000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8c7806e490 tx=0x7f8c6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19651d4315341a11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c7d47f640 1 -- 172.21.15.62:0/1315853070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68031830 con 0x7f8c780cc210 2023-09-30T13:56:14.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c7d47f640 1 -- 172.21.15.62:0/1315853070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68031990 con 0x7f8c780cc210 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c7d47f640 1 -- 172.21.15.62:0/1315853070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68031d20 con 0x7f8c780cc210 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c806e5640 1 -- 172.21.15.62:0/1315853070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780cc210 msgr2=0x7f8c78159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c806e5640 1 --2- 172.21.15.62:0/1315853070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780cc210 0x7f8c78159000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8c7806e490 tx=0x7f8c6802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c806e5640 1 -- 172.21.15.62:0/1315853070 shutdown_connections 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c806e5640 1 --2- 172.21.15.62:0/1315853070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c780cc210 0x7f8c78159000 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.308+0000 7f8c806e5640 1 --2- 172.21.15.62:0/1315853070 >> v2:172.21.15.135:3300/0 conn(0x7f8c78158c20 0x7f8c780b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.309+0000 7f8c806e5640 1 -- 172.21.15.62:0/1315853070 >> 172.21.15.62:0/1315853070 conn(0x7f8c7806a170 msgr2=0x7f8c7806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.309+0000 7f8c806e5640 1 -- 172.21.15.62:0/1315853070 shutdown_connections 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.309+0000 7f8c806e5640 1 -- 172.21.15.62:0/1315853070 wait complete. 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 Processor -- start 2023-09-30T13:56:14.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 -- start start 2023-09-30T13:56:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 0x7f8c78167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c780cc210 0x7f8c780b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781528f0 con 0x7f8c78158c20 2023-09-30T13:56:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c7bd0 con 0x7f8c780caea0 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c806e5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780b1120 con 0x7f8c780cc210 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c7ec82640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c7ec82640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57016/0 (socket says 172.21.15.62:57016) 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.310+0000 7f8c7ec82640 1 -- 172.21.15.62:0/302037137 learned_addr learned my addr 172.21.15.62:0/302037137 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7dc80640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c780cc210 0x7f8c780b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7e481640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 0x7f8c78167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 -- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c780cc210 msgr2=0x7f8c780b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c780cc210 0x7f8c780b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 -- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 msgr2=0x7f8c78167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 0x7f8c78167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 -- 172.21.15.62:0/302037137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009400 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7e481640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 0x7f8c78167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c7ec82640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000cb30 tx=0x7f8c7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000aca0 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000ae20 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780c7e90 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70012640 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.311+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c780c8450 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.312+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78067f40 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.312+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8c70007070 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.313+0000 7f8c6effd640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 0x7f8c5c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.313+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c700893c0 con 0x7f8c78158c20 2023-09-30T13:56:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.313+0000 7f8c7e481640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 0x7f8c5c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.314+0000 7f8c7e481640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 0x7f8c5c06d020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c74008870 tx=0x7f8c74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.317+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8c70054440 con 0x7f8c78158c20 2023-09-30T13:56:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.529+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c780c8640 con 0x7f8c78158c20 2023-09-30T13:56:14.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.530+0000 7f8c6effd640 1 -- 172.21.15.62:0/302037137 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f8c70057a60 con 0x7f8c78158c20 2023-09-30T13:56:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:14.530 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:56:14.530 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 msgr2=0x7f8c5c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 0x7f8c5c06d020 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c74008870 tx=0x7f8c74008040 comp rx=0 tx=0).stop 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 msgr2=0x7f8c78157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000cb30 tx=0x7f8c7000a060 comp rx=0 tx=0).stop 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 shutdown_connections 2023-09-30T13:56:14.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8c5c06ab60 0x7f8c5c06d020 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c78158c20 0x7f8c78157fc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c780cc210 0x7f8c780b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 --2- 172.21.15.62:0/302037137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c780caea0 0x7f8c78167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 >> 172.21.15.62:0/302037137 conn(0x7f8c7806a170 msgr2=0x7f8c780cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 shutdown_connections 2023-09-30T13:56:14.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:14.532+0000 7f8c806e5640 1 -- 172.21.15.62:0/302037137 wait complete. 2023-09-30T13:56:14.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T13:56:05.379093+0000', 'modified': '2023-09-30T13:56:07.370369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5529': {'gid': 5529, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/220613510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 220613510}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 220613510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T13:56:14.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T13:56:14.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-30T13:56:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.056+0000 7fe051378640 1 Processor -- start 2023-09-30T13:56:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.056+0000 7fe051378640 1 -- start start 2023-09-30T13:56:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe051378640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe051378640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 0x7fe04c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe051378640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0d1680 con 0x7fe04c0cb820 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe051378640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0cdf00 con 0x7fe04c0c43f0 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe051378640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0b1e90 con 0x7fe04c15e110 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04b7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 0x7fe04c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38024/0 (socket says 172.21.15.62:38024) 2023-09-30T13:56:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 -- 172.21.15.62:0/3426178721 learned_addr learned my addr 172.21.15.62:0/3426178721 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 -- 172.21.15.62:0/3426178721 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 msgr2=0x7fe04c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 --2- 172.21.15.62:0/3426178721 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 0x7fe04c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 -- 172.21.15.62:0/3426178721 >> v1:172.21.15.135:6789/0 conn(0x7fe04c0cb820 legacy=0x7fe04c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04affd640 1 -- 172.21.15.62:0/3426178721 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0b1bb0 con 0x7fe04c15e110 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.057+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/3426178721 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 0x7fe04c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.058+0000 7fe04affd640 1 --2- 172.21.15.62:0/3426178721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009870 tx=0x7fe03c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed63188e547964 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.058+0000 7fe04a7fc640 1 -- 172.21.15.62:0/3426178721 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c030840 con 0x7fe04c15e110 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.058+0000 7fe04a7fc640 1 -- 172.21.15.62:0/3426178721 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c0309a0 con 0x7fe04c15e110 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.058+0000 7fe04a7fc640 1 -- 172.21.15.62:0/3426178721 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c030d30 con 0x7fe04c15e110 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 -- 172.21.15.62:0/3426178721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 msgr2=0x7fe04c0cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 --2- 172.21.15.62:0/3426178721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009870 tx=0x7fe03c02b980 comp rx=0 tx=0).stop 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 -- 172.21.15.62:0/3426178721 shutdown_connections 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 --2- 172.21.15.62:0/3426178721 >> v2:172.21.15.135:3300/0 conn(0x7fe04c0c43f0 0x7fe04c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 --2- 172.21.15.62:0/3426178721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c15e110 0x7fe04c0cb2e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 -- 172.21.15.62:0/3426178721 >> 172.21.15.62:0/3426178721 conn(0x7fe04c0d0810 msgr2=0x7fe04c0d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 -- 172.21.15.62:0/3426178721 shutdown_connections 2023-09-30T13:56:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.059+0000 7fe051378640 1 -- 172.21.15.62:0/3426178721 wait complete. 2023-09-30T13:56:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.060+0000 7fe051378640 1 Processor -- start 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.060+0000 7fe051378640 1 -- start start 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0c43f0 0x7fe04c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c0cb820 0x7fe04c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c85c0 con 0x7fe04c15e110 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c57c0 con 0x7fe04c0cb820 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe051378640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1f0470 con 0x7fe04c0c43f0 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57028/0 (socket says 172.21.15.62:57028) 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe04b7fe640 1 -- 172.21.15.62:0/1719054958 learned_addr learned my addr 172.21.15.62:0/1719054958 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe0427fc640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c0cb820 0x7fe04c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.061+0000 7fe04affd640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0c43f0 0x7fe04c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 -- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0c43f0 msgr2=0x7fe04c0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0c43f0 0x7fe04c0c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 -- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c0cb820 msgr2=0x7fe04c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c0cb820 0x7fe04c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 -- 172.21.15.62:0/1719054958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009a70 con 0x7fe04c15e110 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe044009f00 tx=0x7fe04400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe043fff640 1 -- 172.21.15.62:0/1719054958 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044009d70 con 0x7fe04c15e110 2023-09-30T13:56:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe043fff640 1 -- 172.21.15.62:0/1719054958 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400f040 con 0x7fe04c15e110 2023-09-30T13:56:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c0094d0 con 0x7fe04c15e110 2023-09-30T13:56:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe043fff640 1 -- 172.21.15.62:0/1719054958 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044003bb0 con 0x7fe04c15e110 2023-09-30T13:56:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.062+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c0c5200 con 0x7fe04c15e110 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.063+0000 7fe043fff640 1 -- 172.21.15.62:0/1719054958 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe044014480 con 0x7fe04c15e110 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.064+0000 7fe043fff640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 0x7fe02c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.064+0000 7fe043fff640 1 -- 172.21.15.62:0/1719054958 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe044089e70 con 0x7fe04c15e110 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.064+0000 7fe04affd640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 0x7fe02c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.065+0000 7fe04affd640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 0x7fe02c06d020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe03c036000 tx=0x7fe03c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.065+0000 7fe053fe7740 1 Processor -- start 2023-09-30T13:56:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.065+0000 7fe053fe7740 1 -- start start 2023-09-30T13:56:15.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 0x563057a920e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 0x563057ac1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057a04770 con 0x563057a92620 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057a01e60 con 0x563057abf5c0 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630579fd750 con 0x563057abf1e0 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57030/0 (socket says 172.21.15.62:57030) 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 -- 172.21.15.62:0/3416061401 learned_addr learned my addr 172.21.15.62:0/3416061401 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04affd640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 0x563057a920e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe0427fc640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 0x563057ac1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 -- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 msgr2=0x563057a920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 0x563057a920e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 -- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 msgr2=0x563057ac1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 0x563057ac1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 -- 172.21.15.62:0/3416061401 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630579fbdd0 con 0x563057a92620 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04affd640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 0x563057a920e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe0427fc640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 0x563057ac1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe044060a10 tx=0x7fe044058db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815597f1af80d084 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe040ff9640 1 -- 172.21.15.62:0/3416061401 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044056e30 con 0x563057a92620 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe040ff9640 1 -- 172.21.15.62:0/3416061401 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044057090 con 0x563057a92620 2023-09-30T13:56:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.066+0000 7fe040ff9640 1 -- 172.21.15.62:0/3416061401 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044060ab0 con 0x563057a92620 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 -- 172.21.15.62:0/3416061401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 msgr2=0x563057ac24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe044060a10 tx=0x7fe044058db0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 -- 172.21.15.62:0/3416061401 shutdown_connections 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057a92620 0x563057ac24b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf5c0 0x563057ac1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 --2- 172.21.15.62:0/3416061401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf1e0 0x563057a920e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 -- 172.21.15.62:0/3416061401 >> 172.21.15.62:0/3416061401 conn(0x563057a943f0 msgr2=0x563057adcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 -- 172.21.15.62:0/3416061401 shutdown_connections 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.067+0000 7fe053fe7740 1 -- 172.21.15.62:0/3416061401 wait complete. 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.068+0000 7fe053fe7740 1 -- start start 2023-09-30T13:56:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.068+0000 7fe053fe7740 1 Processor -- start 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf5c0 0x563057ad7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057ab2d80 0x563057ab3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305799b820 con 0x563057abf1e0 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305799b4c0 con 0x563057ab2d80 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56305797e240 con 0x563057abf5c0 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 10 client.0 _ll_register_callbacks cb 0x5630579bd9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57036/0 (socket says 172.21.15.62:57036) 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 -- 172.21.15.62:0/243614910 learned_addr learned my addr 172.21.15.62:0/243614910 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe0427fc640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf5c0 0x563057ad7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057ab2d80 0x563057ab3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 -- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf5c0 msgr2=0x563057ad7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf5c0 0x563057ad7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 -- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057ab2d80 msgr2=0x563057ab3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057ab2d80 0x563057ab3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 -- 172.21.15.62:0/243614910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c0c5200 con 0x563057abf1e0 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe04affd640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009990 tx=0x7fe03c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281dfb147026bde0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c045a80 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe03c045be0 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.069+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563057a231b0 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe03c045da0 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 10 client.5742 fetch_fsmap learned FSMap version 16 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5630579d8470 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563057a231b0 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe03c050070 con 0x563057abf1e0 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 10 client.5742 fetch_fsmap finished waiting for FSMap version 16 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 10 client.5742 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 20 client.5742 populate_metadata read hostname 'smithi062' 2023-09-30T13:56:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057aefda0 0x563057ac4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 4 client.5742 mds_command: new command op to 5529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 --> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630579d0e60 con 0x563057aefda0 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe0427fc640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057aefda0 0x563057ac4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe029ffb640 10 client.5742 ms_handle_connect on v2:172.21.15.62:6833/220613510 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.070+0000 7fe0427fc640 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057aefda0 0x563057ac4290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeaa84f0bf5545f7 server_cookie=2799ffc9c068b8aa in_seq=0 out_seq=0 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe029ffb640 1 -- 172.21.15.62:0/243614910 <== mds.0 v2:172.21.15.62:6833/220613510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630579d0e60 con 0x563057aefda0 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe029ffb640 10 client.5742 handle_command_reply: tid=0 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 client.5742 shutdown 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 msgr2=0x563057ac57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009990 tx=0x7fe03c02e000 comp rx=0 tx=0).stop 2023-09-30T13:56:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 shutdown_connections 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057aefda0 0x563057ac4290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057ab2d80 0x563057ab3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057abf5c0 0x563057ad7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 --2- 172.21.15.62:0/243614910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf1e0 0x563057ac57b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 >> 172.21.15.62:0/243614910 conn(0x563057a92620 msgr2=0x563057a96060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe029ffb640 0 client.5742 ms_handle_reset on v2:172.21.15.62:6833/220613510 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 shutdown_connections 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 1 -- 172.21.15.62:0/243614910 wait complete. 2023-09-30T13:56:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.071+0000 7fe053fe7740 20 client.5742 trim_cache size 0 max 16384 2023-09-30T13:56:15.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.086+0000 7fe053fe7740 1 Processor -- start 2023-09-30T13:56:15.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 -- start start 2023-09-30T13:56:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057b006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057abe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057ac2440 con 0x563057abf5c0 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057ad8970 con 0x563057abf1e0 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563057ac56c0 con 0x563057ab2d80 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57042/0 (socket says 172.21.15.62:57042) 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.087+0000 7fe04b7fe640 1 -- 172.21.15.62:0/12908109 learned_addr learned my addr 172.21.15.62:0/12908109 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 -- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 msgr2=0x563057b006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057b006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 -- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 msgr2=0x563057abe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe0427fc640 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057abe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057abe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 -- 172.21.15.62:0/12908109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563057a2c500 con 0x563057abf5c0 2023-09-30T13:56:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0440587c0 tx=0x7fe04405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2654ffb7936d7c29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe0417fa640 1 -- 172.21.15.62:0/12908109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044058830 con 0x563057abf5c0 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe0417fa640 1 -- 172.21.15.62:0/12908109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044055030 con 0x563057abf5c0 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe0417fa640 1 -- 172.21.15.62:0/12908109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044056e30 con 0x563057abf5c0 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 -- 172.21.15.62:0/12908109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 msgr2=0x563057ac5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0440587c0 tx=0x7fe04405c000 comp rx=0 tx=0).stop 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 -- 172.21.15.62:0/12908109 shutdown_connections 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ac5180 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057abe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 --2- 172.21.15.62:0/12908109 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057b006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 -- 172.21.15.62:0/12908109 >> 172.21.15.62:0/12908109 conn(0x563057a92620 msgr2=0x563057ad3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 -- 172.21.15.62:0/12908109 shutdown_connections 2023-09-30T13:56:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.088+0000 7fe053fe7740 1 -- 172.21.15.62:0/12908109 wait complete. 2023-09-30T13:56:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.089+0000 7fe053fe7740 1 -- start start 2023-09-30T13:56:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.089+0000 7fe053fe7740 1 Processor -- start 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057ad4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057ad4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057ad2b30 con 0x563057abf5c0 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563057ad4530 con 0x563057abf1e0 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563057adc300 con 0x563057ab2d80 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 10 client.0 _ll_register_callbacks cb 0x7fe03c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:56:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57054/0 (socket says 172.21.15.62:57054) 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 -- 172.21.15.62:0/2751783613 learned_addr learned my addr 172.21.15.62:0/2751783613 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04affd640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057ad4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 -- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 msgr2=0x563057ad4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe0427fc640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057ad4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057ad4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 -- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 msgr2=0x563057ad4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057ad4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 -- 172.21.15.62:0/2751783613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630579fbdd0 con 0x563057abf5c0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe04b7fe640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c990 tx=0x7fe04400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e28a947e665731 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:56:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044060ab0 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe044060c10 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.090+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe044057090 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0440700d0 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 10 client.5748 fetch_fsmap learned FSMap version 16 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56305799acd0 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044057090 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe04407e070 con 0x563057abf5c0 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 10 client.5748 fetch_fsmap finished waiting for FSMap version 16 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 10 client.5748 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 20 client.5748 populate_metadata read hostname 'smithi062' 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057add8d0 0x563057ad3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 4 client.5748 mds_command: new command op to 5529 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T13:56:15.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 --> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5630579f6730 con 0x563057add8d0 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe04affd640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057add8d0 0x563057ad3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 10 client.5748 ms_handle_connect on v2:172.21.15.62:6833/220613510 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe04affd640 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057add8d0 0x563057ad3490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50cad490a568bcbd server_cookie=f113b41cc4e0b0ce in_seq=0 out_seq=0 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 1 -- 172.21.15.62:0/2751783613 <== mds.0 v2:172.21.15.62:6833/220613510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5630579f6730 con 0x563057add8d0 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe029ffb640 10 client.5748 handle_command_reply: tid=0 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.091+0000 7fe053fe7740 1 client.5748 shutdown 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 msgr2=0x563057ad2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c990 tx=0x7fe04400cac0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 shutdown_connections 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x563057add8d0 0x563057ad3490 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563057abf5c0 0x563057ad2f50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563057abf1e0 0x563057ad4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe029ffb640 0 client.5748 ms_handle_reset on v2:172.21.15.62:6833/220613510 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 --2- 172.21.15.62:0/2751783613 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563057ab2d80 0x563057ad4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 >> 172.21.15.62:0/2751783613 conn(0x563057a92620 msgr2=0x563057a97440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 shutdown_connections 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 1 -- 172.21.15.62:0/2751783613 wait complete. 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe053fe7740 20 client.5748 trim_cache size 0 max 16384 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "79595c1b-6895-4c76-9183-336503666b5b", 2023-09-30T13:56:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 5529, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 9.0740744150000001, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 16, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 38, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 38, 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 15.951021722 2023-09-30T13:56:15.099 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 msgr2=0x7fe02c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 0x7fe02c06d020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe03c036000 tx=0x7fe03c03b040 comp rx=0 tx=0).stop 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 msgr2=0x7fe04c0b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe044009f00 tx=0x7fe04400c490 comp rx=0 tx=0).stop 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 shutdown_connections 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe02c06ab60 0x7fe02c06d020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe04c15e110 0x7fe04c0b5580 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe04c0cb820 0x7fe04c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 --2- 172.21.15.62:0/1719054958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe04c0c43f0 0x7fe04c0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 >> 172.21.15.62:0/1719054958 conn(0x7fe04c0d0810 msgr2=0x7fe04c0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 shutdown_connections 2023-09-30T13:56:15.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.092+0000 7fe051378640 1 -- 172.21.15.62:0/1719054958 wait complete. 2023-09-30T13:56:15.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:56:15.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.209+0000 7f0ff254e640 1 Processor -- start 2023-09-30T13:56:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.209+0000 7f0ff254e640 1 -- start start 2023-09-30T13:56:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.209+0000 7f0ff254e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0fec15a8c0 0x7f0fec15d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.209+0000 7f0ff254e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 0x7f0fec069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0ff254e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec06d0b0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0ff254e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec06d390 con 0x7f0fec15a8c0 2023-09-30T13:56:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0ff254e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec06d670 con 0x7f0fec06cb40 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0febfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0fec15a8c0 0x7f0fec15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0ff0aeb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0fec06dcd0 0x7f0fec0ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55472/0 (socket says 172.21.15.62:55472) 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0ff0aeb640 1 -- 172.21.15.62:0/440543009 learned_addr learned my addr 172.21.15.62:0/440543009 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0febfff640 1 -- 172.21.15.62:0/440543009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 msgr2=0x7f0fec069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0feb7fe640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 0x7f0fec069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0febfff640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 0x7f0fec069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0febfff640 1 -- 172.21.15.62:0/440543009 >> v1:172.21.15.62:6789/0 conn(0x7f0fec06dcd0 legacy=0x7f0fec0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0feaffd640 1 -- 172.21.15.62:0/440543009 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435265911 0 0) 0x7f0fec06d0b0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0febfff640 1 -- 172.21.15.62:0/440543009 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06d950 con 0x7f0fec15a8c0 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.210+0000 7f0feb7fe640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 0x7f0fec069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0febfff640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec15a8c0 0x7f0fec15d150 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0097a0 tx=0x7f0fdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3a10becb5af0c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0feaffd640 1 -- 172.21.15.62:0/440543009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc02e070 con 0x7f0fec15a8c0 2023-09-30T13:56:15.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0feaffd640 1 -- 172.21.15.62:0/440543009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0315a0 con 0x7f0fec15a8c0 2023-09-30T13:56:15.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0feaffd640 1 -- 172.21.15.62:0/440543009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc031930 con 0x7f0fec15a8c0 2023-09-30T13:56:15.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 -- 172.21.15.62:0/440543009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec15a8c0 msgr2=0x7f0fec15d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec15a8c0 0x7f0fec15d150 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0097a0 tx=0x7f0fdc02b840 comp rx=0 tx=0).stop 2023-09-30T13:56:15.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 -- 172.21.15.62:0/440543009 shutdown_connections 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec06cb40 0x7f0fec069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 --2- 172.21.15.62:0/440543009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec15a8c0 0x7f0fec15d150 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 -- 172.21.15.62:0/440543009 >> 172.21.15.62:0/440543009 conn(0x7f0fec0b0b50 msgr2=0x7f0fec0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 -- 172.21.15.62:0/440543009 shutdown_connections 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.211+0000 7f0ff254e640 1 -- 172.21.15.62:0/440543009 wait complete. 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 Processor -- start 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 -- start start 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 0x7f0fec15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec15a8c0 0x7f0fec1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec15b0f0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec15b3d0 con 0x7f0fec06cb40 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.213+0000 7f0ff254e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec15b6b0 con 0x7f0fec15a8c0 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57078/0 (socket says 172.21.15.62:57078) 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 -- 172.21.15.62:0/1179305317 learned_addr learned my addr 172.21.15.62:0/1179305317 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0febfff640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 0x7f0fec15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0ff0aeb640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec15a8c0 0x7f0fec1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 -- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec15a8c0 msgr2=0x7f0fec1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec15a8c0 0x7f0fec1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 -- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 msgr2=0x7f0fec15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 0x7f0fec15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 -- 172.21.15.62:0/1179305317 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc009400 con 0x7f0fec06dcd0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0febfff640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 0x7f0fec15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0feb7fe640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c7f0 tx=0x7f0fe000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0007a30 con 0x7f0fec06dcd0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0007b90 con 0x7f0fec06dcd0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec15b990 con 0x7f0fec06dcd0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000ce40 con 0x7f0fec06dcd0 2023-09-30T13:56:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.214+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec154410 con 0x7f0fec06dcd0 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.215+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec04e0d0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.216+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0fe00113f0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.216+0000 7f0fe8ff9640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 0x7f0fd806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.216+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fe0089500 con 0x7f0fec06dcd0 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.216+0000 7f0febfff640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 0x7f0fd806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.217+0000 7f0febfff640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 0x7f0fd806d020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc036000 tx=0x7f0fdc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.221+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0fe0054580 con 0x7f0fec06dcd0 2023-09-30T13:56:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.434+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fec0ccdb0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.434+0000 7f0fe8ff9640 1 -- 172.21.15.62:0/1179305317 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fe0057ba0 con 0x7f0fec06dcd0 2023-09-30T13:56:15.434 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T13:56:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 msgr2=0x7f0fd806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 0x7f0fd806d020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc036000 tx=0x7f0fdc03d040 comp rx=0 tx=0).stop 2023-09-30T13:56:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 msgr2=0x7f0fec1e89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c7f0 tx=0x7f0fe000cbf0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 shutdown_connections 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0fd806ab60 0x7f0fd806d020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0fec15a8c0 0x7f0fec1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fec06dcd0 0x7f0fec1e89a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 --2- 172.21.15.62:0/1179305317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0fec06cb40 0x7f0fec15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.436+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 >> 172.21.15.62:0/1179305317 conn(0x7f0fec0b0b50 msgr2=0x7f0fec160ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.437+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 shutdown_connections 2023-09-30T13:56:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:15.437+0000 7f0ff254e640 1 -- 172.21.15.62:0/1179305317 wait complete. 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:56:15.447 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:56:15.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.448 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:56:15.463 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:56:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:56:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:56:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:15.464 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42618sec preferred_lft 42618sec 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1036:68ff:fe6f:69f4/64 scope link 2023-09-30T13:56:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 76:90:4c:92:44:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::7490:4cff:fe92:4462/64 scope link 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::19:42ff:fea1:ef3d/64 scope link 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:15.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.467 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:56:15.532 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:56:15.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.534 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:56:15.590 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:56:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:56:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:56:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:56:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:56:15.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.591 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:56:15.591 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:56:15.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:56:15.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:56:15.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:56:15.592 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:56:15.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.696 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:56:15.711 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T13:56:15.711 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T13:56:15.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:56:15.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:15.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-09-30T13:56:15.782 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T13:56:15.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:56:15.783 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:56:15.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:56:15.838 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:15.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:56:15.964 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:56:16.019 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:56:16.020 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:56:16.021 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:56:16.022 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:56:16.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.023 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:56:16.078 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:56:16.078 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T13:56:16.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:56:16.151 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:56:16.207 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:56:16.208 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:56:16.209 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:56:16.210 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:56:16.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.211 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:56:16.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:2023-09-30T13:56:16.213+0000 7fa530768480 -1 init, newargv = 0x5584a5903d10 newargc=15 2023-09-30T13:56:16.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[104350]: starting ceph client 2023-09-30T13:56:16.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[104350]: starting fuse 2023-09-30T13:56:16.228 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:56:16.228 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:16.228 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:56:16.229 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2023-09-30T13:56:16.230 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:16.353 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.104350.asok 2023-09-30T13:56:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:16.363 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104350.asok 2023-09-30T13:56:16.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104350.asok status 2023-09-30T13:56:16.504 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:56:16.504 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:56:16.504 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "0", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "104350", 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:56:16.505 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 5763, 2023-09-30T13:56:16.506 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:56:16.506 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:56:16.506 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:56:16.507 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:56:16.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:16.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:56:16.507 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:56:16.507 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2534614440 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:56:16.509 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2534614440 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.5763 192.168.0.1:0/2534614440", 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/2534614440", 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 16, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 38, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:56:16.510 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:56:16.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.512 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:56:16.512 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:16.527 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:56:16.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:16.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:56:16.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:56:16.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.745+0000 7f670aea9640 1 Processor -- start 2023-09-30T13:56:16.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 -- start start 2023-09-30T13:56:16.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67040d1410 0x7f67040d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f670406b650 0x7f670406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040cf450 con 0x7f670415cbe0 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040cfcf0 con 0x7f67040d1410 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f670aea9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040cf730 con 0x7f670406b650 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.746+0000 7f6703fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67040d1410 0x7f67040d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67040d1410 0x7f67040d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57086/0 (socket says 172.21.15.62:57086) 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 -- 172.21.15.62:0/997294709 learned_addr learned my addr 172.21.15.62:0/997294709 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 -- 172.21.15.62:0/997294709 >> v2:172.21.15.135:3300/0 conn(0x7f670406b650 msgr2=0x7f670406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 --2- 172.21.15.62:0/997294709 >> v2:172.21.15.135:3300/0 conn(0x7f670406b650 0x7f670406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 -- 172.21.15.62:0/997294709 >> v1:172.21.15.135:6789/0 conn(0x7f670415cbe0 legacy=0x7f67040d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:16.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.747+0000 7f6703fff640 1 -- 172.21.15.62:0/997294709 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040cfa10 con 0x7f67040d1410 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f6703fff640 1 --2- 172.21.15.62:0/997294709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040d1410 0x7f67040d06b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f67040ccfb0 tx=0x7f66ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164dc3bb3da3df3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f67037fe640 1 -- 172.21.15.62:0/997294709 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec030860 con 0x7f67040d1410 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f67037fe640 1 -- 172.21.15.62:0/997294709 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec0309c0 con 0x7f67040d1410 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f67037fe640 1 -- 172.21.15.62:0/997294709 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec030d50 con 0x7f67040d1410 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 -- 172.21.15.62:0/997294709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040d1410 msgr2=0x7f67040d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 --2- 172.21.15.62:0/997294709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040d1410 0x7f67040d06b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f67040ccfb0 tx=0x7f66ec02b9a0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 -- 172.21.15.62:0/997294709 shutdown_connections 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 --2- 172.21.15.62:0/997294709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040d1410 0x7f67040d06b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 --2- 172.21.15.62:0/997294709 >> v2:172.21.15.135:3300/0 conn(0x7f670406b650 0x7f670406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 -- 172.21.15.62:0/997294709 >> 172.21.15.62:0/997294709 conn(0x7f6704089fe0 msgr2=0x7f67040d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 -- 172.21.15.62:0/997294709 shutdown_connections 2023-09-30T13:56:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.748+0000 7f670aea9640 1 -- 172.21.15.62:0/997294709 wait complete. 2023-09-30T13:56:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.749+0000 7f670aea9640 1 Processor -- start 2023-09-30T13:56:16.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.749+0000 7f670aea9640 1 -- start start 2023-09-30T13:56:16.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 0x7f67040b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 0x7f6704159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c9020 con 0x7f670406b650 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040ce2f0 con 0x7f67040d1410 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f670aea9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040b59f0 con 0x7f670415cbe0 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f6708c45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f6708c45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57088/0 (socket says 172.21.15.62:57088) 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.750+0000 7f6708c45640 1 -- 172.21.15.62:0/3448189501 learned_addr learned my addr 172.21.15.62:0/3448189501 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6703fff640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 0x7f67040b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 -- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 msgr2=0x7f6704159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6709446640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 0x7f6704159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:16.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 0x7f6704159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 -- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 msgr2=0x7f67040b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 0x7f67040b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 -- 172.21.15.62:0/3448189501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0094d0 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6703fff640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 0x7f67040b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6709446640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 0x7f6704159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f6708c45640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c7b0 tx=0x7f66fc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc003dd0 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc005070 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040cec60 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc005420 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.751+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040c6180 con 0x7f670406b650 2023-09-30T13:56:16.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.752+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040c6380 con 0x7f670406b650 2023-09-30T13:56:16.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.753+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f66fc005580 con 0x7f670406b650 2023-09-30T13:56:16.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.753+0000 7f67017fa640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 0x7f66e406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:16.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.753+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f66fc088a70 con 0x7f670406b650 2023-09-30T13:56:16.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.754+0000 7f6703fff640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 0x7f66e406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:16.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.754+0000 7f6703fff640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 0x7f66e406cff0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66ec036000 tx=0x7f66ec03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:16.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.758+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f67040c6380 con 0x7f670406b650 2023-09-30T13:56:16.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.970+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f67040cec60 con 0x7f670406b650 2023-09-30T13:56:16.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.970+0000 7f67017fa640 1 -- 172.21.15.62:0/3448189501 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f67040cec60 con 0x7f670406b650 2023-09-30T13:56:16.970 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 msgr2=0x7f66e406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 0x7f66e406cff0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66ec036000 tx=0x7f66ec03b040 comp rx=0 tx=0).stop 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 msgr2=0x7f67040c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c7b0 tx=0x7f66fc00cc70 comp rx=0 tx=0).stop 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 shutdown_connections 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f66e406ab30 0x7f66e406cff0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f670415cbe0 0x7f6704159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67040d1410 0x7f67040b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 --2- 172.21.15.62:0/3448189501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f670406b650 0x7f67040c8ae0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 >> 172.21.15.62:0/3448189501 conn(0x7f6704089fe0 msgr2=0x7f67040af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 shutdown_connections 2023-09-30T13:56:16.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:16.972+0000 7f670aea9640 1 -- 172.21.15.62:0/3448189501 wait complete. 2023-09-30T13:56:16.982 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:56:16.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:56:16.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-09-30T13:56:16.982 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T13:56:16.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:16.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:56:16.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:56:16.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:56:16.983 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:56:16.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:16.983 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-09-30T13:56:17.002 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:56:17.002 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:56:17.002 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:17.003 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:17.004 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42618sec preferred_lft 42618sec 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.005 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::6cbb:34ff:fe6b:3087/64 scope link 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.006 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:56:17.007 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:56:17.007 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::9413:a8ff:fed8:bd0b/64 scope link 2023-09-30T13:56:17.007 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.007 INFO:teuthology.orchestra.run.smithi135.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:56:17.007 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether be:ca:13:d8:10:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:56:17.008 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::bcca:13ff:fed8:10d9/64 scope link 2023-09-30T13:56:17.008 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:56:17.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.010 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:56:17.073 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-09-30T13:56:17.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.074 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-09-30T13:56:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-09-30T13:56:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:56:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:56:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:56:17.133 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:56:17.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:56:17.134 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:56:17.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.235 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:56:17.250 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T13:56:17.251 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T13:56:17.251 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:56:17.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.251 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-09-30T13:56:17.318 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-09-30T13:56:17.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:56:17.319 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:17.374 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:56:17.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:56:17.374 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:17.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:56:17.496 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:56:17.552 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:56:17.552 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:56:17.552 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:56:17.553 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:56:17.554 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:56:17.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.555 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:56:17.607 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:56:17.607 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-09-30T13:56:17.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:56:17.676 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:56:17.731 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:56:17.732 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:56:17.733 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:56:17.734 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:56:17.735 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:56:17.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.735 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:56:17.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:2023-09-30T13:56:17.735+0000 7f0cb45f8480 -1 init, newargv = 0x55b586d16ae0 newargc=15 2023-09-30T13:56:17.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[94749]: starting ceph client 2023-09-30T13:56:17.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[94749]: starting fuse 2023-09-30T13:56:17.750 INFO:teuthology.orchestra.run.smithi135.stdout:41 2023-09-30T13:56:17.750 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> import re 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> import os 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2023-09-30T13:56:17.751 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2023-09-30T13:56:17.752 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2023-09-30T13:56:17.753 DEBUG:teuthology.orchestra.run.smithi135:> return f 2023-09-30T13:56:17.753 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:56:17.753 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:56:17.753 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.1")) 2023-09-30T13:56:17.753 DEBUG:teuthology.orchestra.run.smithi135:> ' 2023-09-30T13:56:17.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.1.94749.asok 2023-09-30T13:56:17.872 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:56:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:17.879 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94749.asok 2023-09-30T13:56:17.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:17.880 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.94749.asok status 2023-09-30T13:56:18.014 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "1", 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2023-09-30T13:56:18.063 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "94749", 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 5359, 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 5359 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:56:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2183759468 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2183759468 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.5359 192.168.0.1:0/2183759468", 2023-09-30T13:56:18.065 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/2183759468", 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 16, 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 38, 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2023-09-30T13:56:18.066 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-30T13:56:18.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:18.067 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2023-09-30T13:56:18.068 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:18.082 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2023-09-30T13:56:18.083 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:18.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:18.083 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:56:18.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2023-09-30T13:56:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.271+0000 7f4156abb640 1 Processor -- start 2023-09-30T13:56:18.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.271+0000 7f4156abb640 1 -- start start 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 0x7f415006b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415006b070 0x7f415006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f41501609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41500cdd40 con 0x7f415006b070 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41500d0050 con 0x7f41500cd960 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4156abb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415006b500 con 0x7f41500b18a0 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415006b070 0x7f415006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415006b070 0x7f415006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34616/0 (socket says 172.21.15.62:34616) 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 -- 172.21.15.62:0/2949704304 learned_addr learned my addr 172.21.15.62:0/2949704304 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4155058640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f41501609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4154857640 1 --2- 172.21.15.62:0/2949704304 >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 0x7f415006b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 -- 172.21.15.62:0/2949704304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 msgr2=0x7f41501609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f41501609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 -- 172.21.15.62:0/2949704304 >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 msgr2=0x7f415006b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 --2- 172.21.15.62:0/2949704304 >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 0x7f415006b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f414ffff640 1 -- 172.21.15.62:0/2949704304 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500cf720 con 0x7f415006b070 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4154857640 1 --2- 172.21.15.62:0/2949704304 >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 0x7f415006b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.272+0000 7f4155058640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f41501609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.273+0000 7f414ffff640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415006b070 0x7f415006bdb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4150070cf0 tx=0x7f413c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb0343b69acf033 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.273+0000 7f414f7fe640 1 -- 172.21.15.62:0/2949704304 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031870 con 0x7f415006b070 2023-09-30T13:56:18.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.273+0000 7f414f7fe640 1 -- 172.21.15.62:0/2949704304 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0319d0 con 0x7f415006b070 2023-09-30T13:56:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.273+0000 7f414f7fe640 1 -- 172.21.15.62:0/2949704304 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031d60 con 0x7f415006b070 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 -- 172.21.15.62:0/2949704304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415006b070 msgr2=0x7f415006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415006b070 0x7f415006bdb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4150070cf0 tx=0x7f413c02b910 comp rx=0 tx=0).stop 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 -- 172.21.15.62:0/2949704304 shutdown_connections 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f41501609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 --2- 172.21.15.62:0/2949704304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415006b070 0x7f415006bdb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 --2- 172.21.15.62:0/2949704304 >> v2:172.21.15.135:3300/0 conn(0x7f41500cd960 0x7f415006b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 -- 172.21.15.62:0/2949704304 >> 172.21.15.62:0/2949704304 conn(0x7f41500d08e0 msgr2=0x7f41500d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 -- 172.21.15.62:0/2949704304 shutdown_connections 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.274+0000 7f4156abb640 1 -- 172.21.15.62:0/2949704304 wait complete. 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.275+0000 7f4156abb640 1 Processor -- start 2023-09-30T13:56:18.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.275+0000 7f4156abb640 1 -- start start 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f415015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415015d3c0 0x7f41500b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500b35d0 con 0x7f41500cd960 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500b2d20 con 0x7f415015d3c0 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4156abb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415015dba0 con 0x7f41500b18a0 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34626/0 (socket says 172.21.15.62:34626) 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 -- 172.21.15.62:0/1010099663 learned_addr learned my addr 172.21.15.62:0/1010099663 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4154857640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f415015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f4155058640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415015d3c0 0x7f41500b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 -- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 msgr2=0x7f415015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f415015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 -- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415015d3c0 msgr2=0x7f41500b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415015d3c0 0x7f41500b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 -- 172.21.15.62:0/1010099663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0094d0 con 0x7f41500cd960 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.276+0000 7f414ffff640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097c0 tx=0x7f413c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.277+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031820 con 0x7f41500cd960 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.277+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0443f0 con 0x7f41500cd960 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.277+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41500b6080 con 0x7f41500cd960 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.277+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0447a0 con 0x7f41500cd960 2023-09-30T13:56:18.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.277+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415015d8c0 con 0x7f41500cd960 2023-09-30T13:56:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.278+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500b3710 con 0x7f41500cd960 2023-09-30T13:56:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.278+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f413c04d450 con 0x7f41500cd960 2023-09-30T13:56:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.278+0000 7f414d7fa640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 0x7f413406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.279+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f413c02d040 con 0x7f41500cd960 2023-09-30T13:56:18.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.279+0000 7f4154857640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 0x7f413406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.279+0000 7f4154857640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 0x7f413406cff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f414400ab60 tx=0x7f4144008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.283+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f41500b3710 con 0x7f41500cd960 2023-09-30T13:56:18.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.461+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) v1 -- 0x7f41500b3710 con 0x7f41500cd960 2023-09-30T13:56:18.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.464+0000 7f414d7fa640 1 -- 172.21.15.62:0/1010099663 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f41500b3710 con 0x7f41500cd960 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 msgr2=0x7f413406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 0x7f413406cff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f414400ab60 tx=0x7f4144008040 comp rx=0 tx=0).stop 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 msgr2=0x7f4150159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097c0 tx=0x7f413c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 shutdown_connections 2023-09-30T13:56:18.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f413406ab30 0x7f413406cff0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415015d3c0 0x7f41500b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41500cd960 0x7f4150159f60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 --2- 172.21.15.62:0/1010099663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41500b18a0 0x7f415015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 >> 172.21.15.62:0/1010099663 conn(0x7f41500d08e0 msgr2=0x7f41500cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 shutdown_connections 2023-09-30T13:56:18.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.466+0000 7f4156abb640 1 -- 172.21.15.62:0/1010099663 wait complete. 2023-09-30T13:56:18.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2023-09-30T13:56:18.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.585+0000 7fde62ee7640 1 Processor -- start 2023-09-30T13:56:18.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.585+0000 7fde62ee7640 1 -- start start 2023-09-30T13:56:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde62ee7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 0x7fde5c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde62ee7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0d0050 con 0x7fde5c06bf80 2023-09-30T13:56:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde62ee7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c06b500 con 0x7fde5c0cd960 2023-09-30T13:56:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde62ee7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0cdd40 con 0x7fde5c06b070 2023-09-30T13:56:18.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde61484640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fde5c06bf80 0x7fde5c0b0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59802/0 (socket says 172.21.15.62:59802) 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde61484640 1 -- 172.21.15.62:0/1657411865 learned_addr learned my addr 172.21.15.62:0/1657411865 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde53fff640 1 --2- 172.21.15.62:0/1657411865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 0x7fde5c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232308883 0 0) 0x7fde5c0d0050 con 0x7fde5c06bf80 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde44003520 con 0x7fde5c06bf80 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669732809 0 0) 0x7fde5c06b500 con 0x7fde5c0cd960 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde5c0d0050 con 0x7fde5c0cd960 2023-09-30T13:56:18.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde53fff640 1 -- 172.21.15.62:0/1657411865 >> v1:172.21.15.135:6789/0 conn(0x7fde5c0cd960 legacy=0x7fde5c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1947438652 0 0) 0x7fde44003520 con 0x7fde5c06bf80 2023-09-30T13:56:18.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde53fff640 1 -- 172.21.15.62:0/1657411865 >> v1:172.21.15.62:6789/0 conn(0x7fde5c06bf80 legacy=0x7fde5c0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.586+0000 7fde53fff640 1 -- 172.21.15.62:0/1657411865 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0cf720 con 0x7fde5c06b070 2023-09-30T13:56:18.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.587+0000 7fde53fff640 1 --2- 172.21.15.62:0/1657411865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 0x7fde5c0b04c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097d0 tx=0x7fde4c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70afa970f67d897f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.587+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540019f0 con 0x7fde5c06b070 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.587+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c02e050 con 0x7fde5c06b070 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.587+0000 7fde537fe640 1 -- 172.21.15.62:0/1657411865 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c030730 con 0x7fde5c06b070 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 -- 172.21.15.62:0/1657411865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 msgr2=0x7fde5c0b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1657411865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 0x7fde5c0b04c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097d0 tx=0x7fde4c02b800 comp rx=0 tx=0).stop 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 -- 172.21.15.62:0/1657411865 shutdown_connections 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1657411865 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c06b070 0x7fde5c0b04c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 -- 172.21.15.62:0/1657411865 >> 172.21.15.62:0/1657411865 conn(0x7fde5c0d08e0 msgr2=0x7fde5c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 -- 172.21.15.62:0/1657411865 shutdown_connections 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.588+0000 7fde62ee7640 1 -- 172.21.15.62:0/1657411865 wait complete. 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.589+0000 7fde62ee7640 1 Processor -- start 2023-09-30T13:56:18.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.589+0000 7fde62ee7640 1 -- start start 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde5c06bf80 0x7fde5c146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c148e40 0x7fde5c1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15b060 con 0x7fde5c0cd960 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c147340 con 0x7fde5c06bf80 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde62ee7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c146b60 con 0x7fde5c148e40 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34636/0 (socket says 172.21.15.62:34636) 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 -- 172.21.15.62:0/1614876081 learned_addr learned my addr 172.21.15.62:0/1614876081 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde61484640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c148e40 0x7fde5c1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde60c83640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde5c06bf80 0x7fde5c146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 -- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c148e40 msgr2=0x7fde5c1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c148e40 0x7fde5c1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 -- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde5c06bf80 msgr2=0x7fde5c146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde5c06bf80 0x7fde5c146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 -- 172.21.15.62:0/1614876081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009400 con 0x7fde5c0cd960 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.590+0000 7fde53fff640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.591+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004230 con 0x7fde5c0cd960 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.591+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0043b0 con 0x7fde5c0cd960 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.591+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c147530 con 0x7fde5c0cd960 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.591+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004520 con 0x7fde5c0cd960 2023-09-30T13:56:18.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.591+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c149c10 con 0x7fde5c0cd960 2023-09-30T13:56:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.592+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c15b1a0 con 0x7fde5c0cd960 2023-09-30T13:56:18.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.592+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fde4c039040 con 0x7fde5c0cd960 2023-09-30T13:56:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.592+0000 7fde517fa640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 0x7fde4806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.592+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde4c0aa810 con 0x7fde5c0cd960 2023-09-30T13:56:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.593+0000 7fde60c83640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 0x7fde4806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:18.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.593+0000 7fde60c83640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 0x7fde4806cff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde580011e0 tx=0x7fde58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:18.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.597+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fde5c15b1a0 con 0x7fde5c0cd960 2023-09-30T13:56:18.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.773+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) v1 -- 0x7fde5c15b1a0 con 0x7fde5c0cd960 2023-09-30T13:56:18.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.777+0000 7fde517fa640 1 -- 172.21.15.62:0/1614876081 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v12)=0 v12) v1 ==== 135+0+0 (secure 0 0 0) 0x7fde5c15b1a0 con 0x7fde5c0cd960 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 msgr2=0x7fde4806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 0x7fde4806cff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde580011e0 tx=0x7fde58009040 comp rx=0 tx=0).stop 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 msgr2=0x7fde5c146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 shutdown_connections 2023-09-30T13:56:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fde4806ab30 0x7fde4806cff0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde5c148e40 0x7fde5c1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde5c0cd960 0x7fde5c146620 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 --2- 172.21.15.62:0/1614876081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde5c06bf80 0x7fde5c146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 >> 172.21.15.62:0/1614876081 conn(0x7fde5c0d08e0 msgr2=0x7fde5c0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 shutdown_connections 2023-09-30T13:56:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:18.779+0000 7fde62ee7640 1 -- 172.21.15.62:0/1614876081 wait complete. 2023-09-30T13:56:18.790 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:56:18.791 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> n = 25 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:56:18.807 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:56:18.808 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:56:18.809 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:56:18.810 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:19.029 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:56:19.030 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:56:19.085 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:56:19.085 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:19.085 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:56:19.085 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> n = 25 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:56:19.086 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.087 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:56:19.088 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:19.327 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:56:19.327 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:56:19.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:56:19.383 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:56:19.384 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:19.384 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:56:19.384 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.384 DEBUG:teuthology.orchestra.run.smithi062:> n = 25 2023-09-30T13:56:19.384 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:56:19.385 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:56:19.385 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:56:19.385 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2023-09-30T13:56:19.385 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.385 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:56:19.386 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:56:19.386 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:56:19.386 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.386 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:56:19.387 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.388 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:19.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:56:19.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:19.603 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:56:19.603 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:56:19.618 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> n = 25 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.620 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:56:19.621 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:19.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:19.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:56:19.838 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:56:19.839 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2023-09-30T13:56:19.840 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:56:19.963 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.104350.asok 2023-09-30T13:56:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:56:19.974 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104350.asok 2023-09-30T13:56:19.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:19.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104350.asok mds_sessions 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 5763, 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:56:20.116 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2534614440 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.5763 v1:192.168.0.1:0/2534614440", 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "v1:192.168.0.1:0/2534614440", 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions": [ 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:20.117 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": 0, 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addrs": { 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6833", 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 220613510 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6835", 2023-09-30T13:56:20.118 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 220613510 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "seq": 204, 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_gen": 0, 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_ttl": "2023-09-30T13:57:17.215805+0000", 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "last_cap_renew_request": "2023-09-30T13:56:17.215805+0000", 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_renew_seq": 2, 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "num_caps": 105, 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "open" 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:56:20.119 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:56:20.120 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 16 2023-09-30T13:56:20.120 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:56:20.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:56:20.124 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'find . | wc') 2023-09-30T13:56:49.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:56:49.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:56:59.171 INFO:teuthology.orchestra.run.smithi062.stdout: 105 105 1490 2023-09-30T13:56:59.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:56:59.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.290+0000 7fb398d1d640 1 Processor -- start 2023-09-30T13:56:59.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.290+0000 7fb398d1d640 1 -- start start 2023-09-30T13:56:59.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb398d1d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3940ace50 0x7fb3940b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb398d1d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39415b9a0 con 0x7fb3940cf140 2023-09-30T13:56:59.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb398d1d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3940cc950 con 0x7fb3940b31c0 2023-09-30T13:56:59.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb398d1d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940b2e50 con 0x7fb3940ace50 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb392d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb3940cf140 0x7fb3940ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46318/0 (socket says 172.21.15.62:46318) 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb392d9d640 1 -- 172.21.15.62:0/1979085146 learned_addr learned my addr 172.21.15.62:0/1979085146 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb39259c640 1 --2- 172.21.15.62:0/1979085146 >> v2:172.21.15.135:3300/0 conn(0x7fb3940ace50 0x7fb3940b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.291+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440480008 0 0) 0x7fb39415b9a0 con 0x7fb3940cf140 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb37c003520 con 0x7fb3940cf140 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013068093 0 0) 0x7fb3940cc950 con 0x7fb3940b31c0 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb39415b9a0 con 0x7fb3940b31c0 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454906794 0 0) 0x7fb37c003520 con 0x7fb3940cf140 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 >> v2:172.21.15.135:3300/0 conn(0x7fb3940ace50 msgr2=0x7fb3940b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 --2- 172.21.15.62:0/1979085146 >> v2:172.21.15.135:3300/0 conn(0x7fb3940ace50 0x7fb3940b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 >> v1:172.21.15.135:6789/0 conn(0x7fb3940b31c0 legacy=0x7fb3940cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39415add0 con 0x7fb3940cf140 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb38c0019f0 con 0x7fb3940cf140 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 >> v1:172.21.15.62:6789/0 conn(0x7fb3940cf140 legacy=0x7fb3940ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb37c003b00 0x7fb37c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940b2e50 con 0x7fb37c005180 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c00c0b0 con 0x7fb37c003b00 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c00c270 con 0x7fb37c0047c0 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39259c640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb37c003b00 0x7fb37c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb391d9b640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 -- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb37c0047c0 msgr2=0x7fb37c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb37c0047c0 0x7fb37c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 -- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb37c003b00 msgr2=0x7fb37c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb37c003b00 0x7fb37c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb392d9d640 1 -- 172.21.15.62:0/1979085146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c003520 con 0x7fb37c005180 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.292+0000 7fb39259c640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb37c003b00 0x7fb37c003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.293+0000 7fb392d9d640 1 -- 172.21.15.62:0/1979085146 reap_dead start 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.293+0000 7fb392d9d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb37c00b980 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb3940ad420 tx=0x7fb37c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9effe0ac65f1a600 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.293+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c034630 con 0x7fb37c005180 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.293+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c02f070 con 0x7fb37c005180 2023-09-30T13:56:59.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.293+0000 7fb39159a640 1 -- 172.21.15.62:0/1979085146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0349f0 con 0x7fb37c005180 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 -- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 msgr2=0x7fb37c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb37c00b980 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb3940ad420 tx=0x7fb37c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 -- 172.21.15.62:0/1979085146 shutdown_connections 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 --2- 172.21.15.62:0/1979085146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb37c00b980 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 -- 172.21.15.62:0/1979085146 >> 172.21.15.62:0/1979085146 conn(0x7fb39406a170 msgr2=0x7fb39406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 -- 172.21.15.62:0/1979085146 shutdown_connections 2023-09-30T13:56:59.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.294+0000 7fb398d1d640 1 -- 172.21.15.62:0/1979085146 wait complete. 2023-09-30T13:56:59.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.295+0000 7fb398d1d640 1 Processor -- start 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.295+0000 7fb398d1d640 1 -- start start 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940c8700 0x7fb3941efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394157850 0x7fb3940ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940c66f0 con 0x7fb37c005180 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3941effc0 con 0x7fb3940c8700 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb398d1d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940c5cd0 con 0x7fb394157850 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50930/0 (socket says 172.21.15.62:50930) 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 -- 172.21.15.62:0/3996687067 learned_addr learned my addr 172.21.15.62:0/3996687067 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:59.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb392d9d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394157850 0x7fb3940ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb391d9b640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940c8700 0x7fb3941efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 -- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394157850 msgr2=0x7fb3940ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394157850 0x7fb3940ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 -- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940c8700 msgr2=0x7fb3941efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940c8700 0x7fb3941efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 -- 172.21.15.62:0/3996687067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940c5710 con 0x7fb37c005180 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.296+0000 7fb39259c640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb3840090e0 tx=0x7fb384011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.297+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384005e00 con 0x7fb37c005180 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.297+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384004020 con 0x7fb37c005180 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.297+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3940c59f0 con 0x7fb37c005180 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.297+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840043d0 con 0x7fb37c005180 2023-09-30T13:56:59.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.297+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3940c6380 con 0x7fb37c005180 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.298+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39404e0d0 con 0x7fb37c005180 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.298+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb384003610 con 0x7fb37c005180 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.299+0000 7fb382ffd640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 0x7fb37406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.299+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb384089540 con 0x7fb37c005180 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.299+0000 7fb391d9b640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 0x7fb37406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.299+0000 7fb391d9b640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 0x7fb37406cff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb388007fd0 tx=0x7fb388009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.303+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb3840546c0 con 0x7fb37c005180 2023-09-30T13:56:59.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.513+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb39415d310 con 0x7fb37c005180 2023-09-30T13:56:59.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.514+0000 7fb382ffd640 1 -- 172.21.15.62:0/3996687067 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fb384057ce0 con 0x7fb37c005180 2023-09-30T13:56:59.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:59.514 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:56:59.514 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:56:59.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 msgr2=0x7fb37406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 0x7fb37406cff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb388007fd0 tx=0x7fb388009040 comp rx=0 tx=0).stop 2023-09-30T13:56:59.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 msgr2=0x7fb39415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb3840090e0 tx=0x7fb384011a60 comp rx=0 tx=0).stop 2023-09-30T13:56:59.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 shutdown_connections 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb37406ab30 0x7fb37406cff0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb394157850 0x7fb3940ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3940c8700 0x7fb3941efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 --2- 172.21.15.62:0/3996687067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb37c005180 0x7fb39415d530 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.515+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 >> 172.21.15.62:0/3996687067 conn(0x7fb39406a170 msgr2=0x7fb39415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.516+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 shutdown_connections 2023-09-30T13:56:59.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.516+0000 7fb398d1d640 1 -- 172.21.15.62:0/3996687067 wait complete. 2023-09-30T13:56:59.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-09-30T13:56:59.647 INFO:teuthology.orchestra.run.smithi062.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":183,"msgr_send_messages":143,"msgr_recv_bytes":52429,"msgr_send_bytes":662088,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.018423305,"msgr_running_send_time":0.005831924,"msgr_running_recv_time":0.005911125,"msgr_running_fast_dispatch_time":0.004710544,"msgr_send_messages_queue_lat":{"avgcount":142,"sum":0.028610074,"avgtime":0.000201479},"msgr_handle_ack_lat":{"avgcount":55,"sum":0.000008204,"avgtime":0.000000149},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":79,"msgr_send_messages":74,"msgr_recv_bytes":117192,"msgr_send_bytes":22776,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.007398759,"msgr_running_send_time":0.002129024,"msgr_running_recv_time":0.006495446,"msgr_running_fast_dispatch_time":0.000620154,"msgr_send_messages_queue_lat":{"avgcount":73,"sum":0.016385824,"avgtime":0.000224463},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":114480,"msgr_send_encrypted_bytes":18192},"AsyncMessenger::Worker-2":{"msgr_recv_messages":496,"msgr_send_messages":479,"msgr_recv_bytes":148832,"msgr_send_bytes":361120,"msgr_created_connections":8,"msgr_active_connections":7,"msgr_running_total_time":0.034867197,"msgr_running_send_time":0.014177920,"msgr_running_recv_time":0.026981648,"msgr_running_fast_dispatch_time":0.002084181,"msgr_send_messages_queue_lat":{"avgcount":478,"sum":0.019197273,"avgtime":0.000040161},"msgr_handle_ack_lat":{"avgcount":933,"sum":0.000148530,"avgtime":0.000000159},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":106224},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":276,"sum":0.062586384,"avgtime":0.000226762}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012060,"avgtime":0.000006030}},"mds":{"request":130,"reply":130,"reply_latency":{"avgcount":130,"sum":39.076391524,"avgtime":0.300587627},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":100,"caps":101,"subtrees":2,"traverse":155,"traverse_hit":144,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":1221,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":9,"ceph_cap_op_grant":103,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":204,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":105},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":313,"evex":0,"evtrm":0,"ev":313,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4796138,"rdpos":0,"jlat":{"avgcount":110,"sum":0.181044948,"avgtime":0.001645863},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":114,"dn-":0,"cap":101,"cap+":106,"cap-":5,"rss":48892,"heap":207196},"mds_server":{"dispatch_client_request":217,"dispatch_server_request":0,"handle_client_request":130,"handle_client_session":110,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.050573432,"avgtime":0.000505734},"req_getattr_latency":{"avgcount":17,"sum":0.003053653,"avgtime":0.000179626},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":3,"sum":0.000345325,"avgtime":0.000115108},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.004729708,"avgtime":0.001182427},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":5,"sum":39.017452855,"avgtime":7.803490571},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000236551,"avgtime":0.000236551},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":82,"average_load":41,"avg_session_uptime":42,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":242456,"buffer_anon_items":94,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5520,"osdmap_items":78,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":383872,"mds_co_items":2313,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":152,"op_send_bytes":621042,"op_resend":37,"op_reply":152,"op_latency":{"avgcount":152,"sum":0.509992449,"avgtime":0.003355213},"op_inflight":0,"oplen_avg":{"avgcount":152,"sum":180},"op":152,"op_r":0,"op_w":152,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":110,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":0,"omap_del":3},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":2},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":753,"get_sum":245695,"get_or_fail_fail":0,"get_or_fail_success":753,"take":0,"take_sum":0,"put":753,"put_sum":245695,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":152,"take_sum":621042,"put":152,"put_sum":621042,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":152,"take_sum":152,"put":152,"put_sum":152,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x564fbfe686e0":{"val":0,"max":3758096384,"get_started":0,"get":313,"get_sum":601834,"get_or_fail_fail":0,"get_or_fail_success":313,"take":0,"take_sum":0,"put":110,"put_sum":601834,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-09-30T13:56:59.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 55, "avgtime": 1.49e-07, "sum": 8.204e-06 }, "msgr_recv_bytes": 52429, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 183, "msgr_running_fast_dispatch_time": 0.004710544, "msgr_running_recv_time": 0.005911125, "msgr_running_send_time": 0.005831924, "msgr_running_total_time": 0.018423305, "msgr_send_bytes": 662088, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 143, "msgr_send_messages_queue_lat": { "avgcount": 142, "avgtime": 0.000201479, "sum": 0.028610074 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 117192, "msgr_recv_encrypted_bytes": 114480, "msgr_recv_messages": 79, "msgr_running_fast_dispatch_time": 0.000620154, "msgr_running_recv_time": 0.006495446, "msgr_running_send_time": 0.002129024, "msgr_running_total_time": 0.007398759, "msgr_send_bytes": 22776, "msgr_send_encrypted_bytes": 18192, "msgr_send_messages": 74, "msgr_send_messages_queue_lat": { "avgcount": 73, "avgtime": 0.000224463, "sum": 0.016385824 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 7, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 933, "avgtime": 1.59e-07, "sum": 0.00014853 }, "msgr_recv_bytes": 148832, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 496, "msgr_running_fast_dispatch_time": 0.002084181, "msgr_running_recv_time": 0.026981648, "msgr_running_send_time": 0.01417792, "msgr_running_total_time": 0.034867197, "msgr_send_bytes": 361120, "msgr_send_encrypted_bytes": 106224, "msgr_send_messages": 479, "msgr_send_messages_queue_lat": { "avgcount": 478, "avgtime": 4.0161e-05, "sum": 0.019197273 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 276, "avgtime": 0.000226762, "sum": 0.062586384 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.03e-06, "sum": 1.206e-05 }, "queue_len": 0 }, "mds": { "caps": 101, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 103, "ceph_cap_op_revoke": 9, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 204, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 100, "load_cent": 1221, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 105, "q": 0, "reply": 130, "reply_latency": { "avgcount": 130, "avgtime": 0.300587627, "sum": 39.076391524 }, "request": 130, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 155, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 144, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 313, "evadd": 313, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 110, "avgtime": 0.001645863, "sum": 0.181044948 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4796138 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 114, "dn-": 0, "heap": 207196, "ino": 117, "ino+": 117, "ino-": 0, "rss": 48892 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 217, "dispatch_server_request": 0, "handle_client_request": 130, "handle_client_session": 110, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.000505734, "sum": 0.050573432 }, "req_getattr_latency": { "avgcount": 17, "avgtime": 0.000179626, "sum": 0.003053653 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 3, "avgtime": 0.000115108, "sum": 0.000345325 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.001182427, "sum": 0.004729708 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.803490571, "sum": 39.017452855 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000236551, "sum": 0.000236551 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 41, "avg_session_uptime": 42, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 82 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 242456, "buffer_anon_items": 94, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 383872, "mds_co_items": 2313, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5520, "osdmap_items": 78, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 3, "omap_del": 3, "omap_rd": 0, "omap_wr": 20, "op": 152, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 152, "avgtime": 0.003355213, "sum": 0.509992449 }, "op_pg": 0, "op_r": 0, "op_reply": 152, "op_resend": 37, "op_rmw": 0, "op_send": 152, "op_send_bytes": 621042, "op_w": 152, "oplen_avg": { "avgcount": 152, "sum": 180 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 110, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 753, "get_or_fail_fail": 0, "get_or_fail_success": 753, "get_started": 0, "get_sum": 245695, "max": 104857600, "put": 753, "put_sum": 245695, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 152, "put_sum": 621042, "take": 152, "take_sum": 621042, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 152, "put_sum": 152, "take": 152, "take_sum": 152, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x564fbfe686e0": { "get": 313, "get_or_fail_fail": 0, "get_or_fail_success": 313, "get_started": 0, "get_sum": 601834, "max": 3758096384, "put": 110, "put_sum": 601834, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-09-30T13:56:59.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:56:59.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 Processor -- start 2023-09-30T13:56:59.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 -- start start 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3f980cf140 0x7f3f980ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f980c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980b1e20 con 0x7f3f981598c0 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980b1530 con 0x7f3f980cf140 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f9df0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b17d0 con 0x7f3f980c8c90 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f977fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3f981598c0 0x7f3f980cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46328/0 (socket says 172.21.15.62:46328) 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.757+0000 7f3f977fe640 1 -- 172.21.15.62:0/704530752 learned_addr learned my addr 172.21.15.62:0/704530752 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/704530752 >> v2:172.21.15.135:3300/0 conn(0x7f3f980cf140 0x7f3f980ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f97fff640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f980c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925275161 0 0) 0x7f3f980b1e20 con 0x7f3f981598c0 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f80003520 con 0x7f3f981598c0 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884372765 0 0) 0x7f3f80003520 con 0x7f3f981598c0 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 msgr2=0x7f3f980c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f980c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 >> v2:172.21.15.135:3300/0 conn(0x7f3f980cf140 msgr2=0x7f3f980ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 --2- 172.21.15.62:0/704530752 >> v2:172.21.15.135:3300/0 conn(0x7f3f980cf140 0x7f3f980ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980b1ab0 con 0x7f3f981598c0 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f3f880017f0 con 0x7f3f981598c0 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 >> v1:172.21.15.62:6789/0 conn(0x7f3f981598c0 legacy=0x7f3f980cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f80003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f80003ef0 0x7f3f800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b1530 con 0x7f3f80003ef0 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b17d0 con 0x7f3f80004d00 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8000b980 con 0x7f3f980c8c90 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f80003ef0 0x7f3f800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f977fe640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f80003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.758+0000 7f3f97fff640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 -- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 msgr2=0x7f3f80003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f980c8c90 0x7f3f80003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 -- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80004d00 msgr2=0x7f3f80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:56:59.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f80004d00 0x7f3f80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 -- 172.21.15.62:0/704530752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80003520 con 0x7f3f80003ef0 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f80003ef0 0x7f3f800047c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009ac0 tx=0x7f3f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe1b61ff772d0ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.759+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c02c6d0 con 0x7f3f80003ef0 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c02c830 con 0x7f3f80003ef0 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f967fc640 1 -- 172.21.15.62:0/704530752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c02cbc0 con 0x7f3f80003ef0 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 -- 172.21.15.62:0/704530752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f80003ef0 msgr2=0x7f3f800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/704530752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f80003ef0 0x7f3f800047c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009ac0 tx=0x7f3f800057f0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f97fff640 1 -- 172.21.15.62:0/704530752 reap_dead start 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 -- 172.21.15.62:0/704530752 shutdown_connections 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 -- 172.21.15.62:0/704530752 >> 172.21.15.62:0/704530752 conn(0x7f3f9806a170 msgr2=0x7f3f9806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 -- 172.21.15.62:0/704530752 shutdown_connections 2023-09-30T13:56:59.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.760+0000 7f3f9df0f640 1 -- 172.21.15.62:0/704530752 wait complete. 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.761+0000 7f3f9df0f640 1 Processor -- start 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.761+0000 7f3f9df0f640 1 -- start start 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f80003ef0 0x7f3f9806be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f98154850 0x7f3f98156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980afec0 con 0x7f3f98154cd0 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98156ec0 con 0x7f3f98154850 2023-09-30T13:56:59.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f9df0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980af800 con 0x7f3f80003ef0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f97fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f97fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50950/0 (socket says 172.21.15.62:50950) 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.762+0000 7f3f97fff640 1 -- 172.21.15.62:0/2899228363 learned_addr learned my addr 172.21.15.62:0/2899228363 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 -- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f80003ef0 msgr2=0x7f3f9806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f96ffd640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f98154850 0x7f3f98156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f80003ef0 0x7f3f9806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 -- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f98154850 msgr2=0x7f3f98156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f98154850 0x7f3f98156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 -- 172.21.15.62:0/2899228363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980afae0 con 0x7f3f98154cd0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f97fff640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3f980cf620 tx=0x7f3f9000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000e040 con 0x7f3f98154cd0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000f040 con 0x7f3f98154cd0 2023-09-30T13:56:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f981571a0 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90015430 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.763+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98156970 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.764+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f980b0000 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.764+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3f90015590 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.765+0000 7f3f7ffff640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 0x7f3f8406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.765+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f90089cd0 con 0x7f3f98154cd0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.765+0000 7f3f977fe640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 0x7f3f8406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:56:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.766+0000 7f3f977fe640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 0x7f3f8406cff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3f88001130 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:56:59.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.769+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3f980b0000 con 0x7f3f98154cd0 2023-09-30T13:56:59.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.979+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f980b0000 con 0x7f3f98154cd0 2023-09-30T13:56:59.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.980+0000 7f3f7ffff640 1 -- 172.21.15.62:0/2899228363 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f3f980b0000 con 0x7f3f98154cd0 2023-09-30T13:56:59.980 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:56:59.980 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:56:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 msgr2=0x7f3f8406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 0x7f3f8406cff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3f88001130 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 msgr2=0x7f3f981f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3f980cf620 tx=0x7f3f9000f580 comp rx=0 tx=0).stop 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 shutdown_connections 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3f8406ab30 0x7f3f8406cff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f98154cd0 0x7f3f981f2160 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f98154850 0x7f3f98156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 --2- 172.21.15.62:0/2899228363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f80003ef0 0x7f3f9806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:56:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 >> 172.21.15.62:0/2899228363 conn(0x7f3f9806a170 msgr2=0x7f3f980ab640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:56:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 shutdown_connections 2023-09-30T13:56:59.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:56:59.982+0000 7f3f9df0f640 1 -- 172.21.15.62:0/2899228363 wait complete. 2023-09-30T13:56:59.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-09-30T13:57:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:[{"id":5359,"entity":{"name":{"type":"client","num":5359},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2183759468}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":42.369371534999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.72520056772471,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5359 192.168.0.1:0/2183759468","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"1d10b71792f3be8887a7631e69851ac2df3585af","ceph_version":"ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)","entity_id":"1","hostname":"smithi135","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"94749","root":"/"}},{"id":5763,"entity":{"name":{"type":"client","num":5763},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2534614440}},"state":"open","num_leases":0,"num_caps":100,"request_load_avg":81,"uptime":43.891348991999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":6.3303195279938933,"halflife":60},"release_caps":{"value":3.2205806999663973,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":295.36933174791017,"halflife":300},"cap_acquisition":{"value":60.458182199144701,"halflife":30},"last_trim_completed_requests_tid":128,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5763 192.168.0.1:0/2534614440","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"1d10b71792f3be8887a7631e69851ac2df3585af","ceph_version":"ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)","entity_id":"0","hostname":"smithi062","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"104350","root":"/"}}] 2023-09-30T13:57:00.115 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi135", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "94749", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2183759468, "type": "any" }, "name": { "num": 5359, "type": "client" } }, "id": 5359, "inst": "client.5359 192.168.0.1:0/2183759468", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.72520056772471 }, "state": "open", "uptime": 42.369371535 }, { "cap_acquisition": { "halflife": 30, "value": 60.4581821991447 }, "client_metadata": { "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi062", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "104350", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2534614440, "type": "any" }, "name": { "num": 5763, "type": "client" } }, "id": 5763, "inst": "client.5763 192.168.0.1:0/2534614440", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 128, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 6.330319527993893 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 3.2205806999663973 }, "request_load_avg": 81, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 295.36933174791017 }, "state": "open", "uptime": 43.891348992 } ] 2023-09-30T13:57:00.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2023-09-30T13:57:00.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.222+0000 7f0a3959e640 1 Processor -- start 2023-09-30T13:57:00.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.222+0000 7f0a3959e640 1 -- start start 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a3959e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a340d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a3959e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a340b42b0 con 0x7f0a340d2e50 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a3959e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a340cd2b0 con 0x7f0a3415c840 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a3959e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340d32e0 con 0x7f0a340b57d0 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a38d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a340d2e50 0x7f0a340ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46340/0 (socket says 172.21.15.62:46340) 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.223+0000 7f0a38d9d640 1 -- 172.21.15.62:0/3807967377 learned_addr learned my addr 172.21.15.62:0/3807967377 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a340d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223843995 0 0) 0x7f0a340b42b0 con 0x7f0a340d2e50 2023-09-30T13:57:00.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a1c003520 con 0x7f0a340d2e50 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 732836736 0 0) 0x7f0a1c003520 con 0x7f0a340d2e50 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 msgr2=0x7f0a340d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a340d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 >> v1:172.21.15.135:6789/0 conn(0x7f0a3415c840 legacy=0x7f0a340b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340cd590 con 0x7f0a340d2e50 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f0a2c0019f0 con 0x7f0a340d2e50 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a340d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 >> v1:172.21.15.62:6789/0 conn(0x7f0a340d2e50 legacy=0x7f0a340ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c0039a0 0x7f0a1c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c004d00 0x7f0a1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340d32e0 con 0x7f0a1c0039a0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c00b980 con 0x7f0a1c004d00 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c00baf0 con 0x7f0a340b57d0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c0039a0 0x7f0a1c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.224+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c004d00 0x7f0a1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 -- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 msgr2=0x7f0a1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a340b57d0 0x7f0a1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 -- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c004d00 msgr2=0x7f0a1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c004d00 0x7f0a1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 -- 172.21.15.62:0/3807967377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009400 con 0x7f0a1c0039a0 2023-09-30T13:57:00.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c004d00 0x7f0a1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c0039a0 0x7f0a1c003d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0a24001920 tx=0x7f0a1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5c69423c953c88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a240052d0 con 0x7f0a1c0039a0 2023-09-30T13:57:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24005450 con 0x7f0a1c0039a0 2023-09-30T13:57:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.225+0000 7f0a32ffd640 1 -- 172.21.15.62:0/3807967377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24003830 con 0x7f0a1c0039a0 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 -- 172.21.15.62:0/3807967377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c0039a0 msgr2=0x7f0a1c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 --2- 172.21.15.62:0/3807967377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c0039a0 0x7f0a1c003d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0a24001920 tx=0x7f0a1c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a38d9d640 1 -- 172.21.15.62:0/3807967377 reap_dead start 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 -- 172.21.15.62:0/3807967377 shutdown_connections 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 -- 172.21.15.62:0/3807967377 >> 172.21.15.62:0/3807967377 conn(0x7f0a34089fe0 msgr2=0x7f0a3409bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 -- 172.21.15.62:0/3807967377 shutdown_connections 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.226+0000 7f0a3959e640 1 -- 172.21.15.62:0/3807967377 wait complete. 2023-09-30T13:57:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.227+0000 7f0a3959e640 1 Processor -- start 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 -- start start 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 0x7f0a340cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3415f4d0 0x7f0a341f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340ca6d0 con 0x7f0a34159af0 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3415a4b0 con 0x7f0a1c0039a0 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a3959e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a341532f0 con 0x7f0a3415f4d0 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a38d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a38d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50970/0 (socket says 172.21.15.62:50970) 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.228+0000 7f0a38d9d640 1 -- 172.21.15.62:0/1869564130 learned_addr learned my addr 172.21.15.62:0/1869564130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a337fe640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3415f4d0 0x7f0a341f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 0x7f0a340cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 -- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3415f4d0 msgr2=0x7f0a341f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3415f4d0 0x7f0a341f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 -- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 msgr2=0x7f0a340cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 0x7f0a340cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 -- 172.21.15.62:0/1869564130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340c9a50 con 0x7f0a34159af0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 0x7f0a340cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a340d0440 tx=0x7f0a2c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a30ff9640 1 -- 172.21.15.62:0/1869564130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00eb90 con 0x7f0a34159af0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a30ff9640 1 -- 172.21.15.62:0/1869564130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00ecf0 con 0x7f0a34159af0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a340c9d30 con 0x7f0a34159af0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a30ff9640 1 -- 172.21.15.62:0/1869564130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c013660 con 0x7f0a34159af0 2023-09-30T13:57:00.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.229+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a340ca2f0 con 0x7f0a34159af0 2023-09-30T13:57:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.230+0000 7f0a30ff9640 1 -- 172.21.15.62:0/1869564130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0a2c0137c0 con 0x7f0a34159af0 2023-09-30T13:57:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.231+0000 7f0a30ff9640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 0x7f0a2006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.231+0000 7f0a30ff9640 1 -- 172.21.15.62:0/1869564130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a2c089750 con 0x7f0a34159af0 2023-09-30T13:57:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.231+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 0x7f0a2006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.232+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 0x7f0a2006d020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034000 tx=0x7f0a24009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.232+0000 7f0a3d393740 1 Processor -- start 2023-09-30T13:57:00.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.232+0000 7f0a3d393740 1 -- start start 2023-09-30T13:57:00.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a56bf0 0x559d21a86a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d219c94e0 con 0x559d21a83b90 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d219c6bd0 con 0x559d21a56bf0 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d219c24c0 con 0x559d21a837b0 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50986/0 (socket says 172.21.15.62:50986) 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 -- 172.21.15.62:0/4189745010 learned_addr learned my addr 172.21.15.62:0/4189745010 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a56bf0 0x559d21a86a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a33fff640 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 -- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 msgr2=0x559d21a566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 -- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a56bf0 msgr2=0x559d21a86a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a56bf0 0x559d21a86a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 -- 172.21.15.62:0/4189745010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d219c7130 con 0x559d21a83b90 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.233+0000 7f0a337fe640 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009c90 tx=0x7f0a28009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172370ae52e83754 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a19ffb640 1 -- 172.21.15.62:0/4189745010 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28014ee0 con 0x559d21a83b90 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a19ffb640 1 -- 172.21.15.62:0/4189745010 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2801f480 con 0x559d21a83b90 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a19ffb640 1 -- 172.21.15.62:0/4189745010 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2801f830 con 0x559d21a83b90 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 -- 172.21.15.62:0/4189745010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 msgr2=0x559d21a86540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009c90 tx=0x7f0a28009190 comp rx=0 tx=0).stop 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 -- 172.21.15.62:0/4189745010 shutdown_connections 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a56bf0 0x559d21a86a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a86540 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 --2- 172.21.15.62:0/4189745010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 -- 172.21.15.62:0/4189745010 >> 172.21.15.62:0/4189745010 conn(0x559d21a589c0 msgr2=0x559d21aa1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 -- 172.21.15.62:0/4189745010 shutdown_connections 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.234+0000 7f0a3d393740 1 -- 172.21.15.62:0/4189745010 wait complete. 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.235+0000 7f0a3d393740 1 -- start start 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.235+0000 7f0a3d393740 1 Processor -- start 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a6a9f0 0x559d21a6ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2197d330 con 0x559d21a83b90 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2197cfd0 con 0x559d21a6a9f0 2023-09-30T13:57:00.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d21942d70 con 0x559d21a837b0 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a3d393740 10 client.0 _ll_register_callbacks cb 0x559d21980600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50988/0 (socket says 172.21.15.62:50988) 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a33fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 -- 172.21.15.62:0/3953129988 learned_addr learned my addr 172.21.15.62:0/3953129988 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a38d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a6a9f0 0x559d21a6ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 -- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 msgr2=0x559d21a88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 -- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a6a9f0 msgr2=0x559d21a6ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a6a9f0 0x559d21a6ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 -- 172.21.15.62:0/3953129988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280098c0 con 0x559d21a83b90 2023-09-30T13:57:00.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a337fe640 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801b000 tx=0x7f0a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a228399075180725 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.236+0000 7f0a12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28024070 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d2199a170 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a2801a070 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a28014ee0 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 10 client.5808 fetch_fsmap learned FSMap version 16 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559d219c0b40 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d2199a170 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a28011030 con 0x559d21a83b90 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 10 client.5808 fetch_fsmap finished waiting for FSMap version 16 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 10 client.5808 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-09-30T13:57:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 20 client.5808 populate_metadata read hostname 'smithi062' 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21a6b3b0 0x559d21a6d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 4 client.5808 mds_command: new command op to 5529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 --> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d21997a80 con 0x559d21a6b3b0 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.237+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21a6b3b0 0x559d21a6d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a12ffd640 10 client.5808 ms_handle_connect on v2:172.21.15.62:6833/220613510 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a33fff640 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21a6b3b0 0x559d21a6d290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=727c942157d1b3dd server_cookie=fcaf87a45d2a3861 in_seq=0 out_seq=0 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a12ffd640 1 -- 172.21.15.62:0/3953129988 <== mds.0 v2:172.21.15.62:6833/220613510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d21997a80 con 0x559d21a6b3b0 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a12ffd640 10 client.5808 handle_command_reply: tid=0 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 client.5808 shutdown 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 msgr2=0x559d21a7fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801b000 tx=0x7f0a280046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 shutdown_connections 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21a6b3b0 0x559d21a6d290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a6a9f0 0x559d21a6ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a83b90 0x559d21a7fda0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 --2- 172.21.15.62:0/3953129988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a837b0 0x559d21a88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a12ffd640 0 client.5808 ms_handle_reset on v2:172.21.15.62:6833/220613510 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 >> 172.21.15.62:0/3953129988 conn(0x559d21a56bf0 msgr2=0x559d21a5a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 shutdown_connections 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.238+0000 7f0a3d393740 1 -- 172.21.15.62:0/3953129988 wait complete. 2023-09-30T13:57:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.239+0000 7f0a3d393740 20 client.5808 trim_cache size 0 max 16384 2023-09-30T13:57:00.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 Processor -- start 2023-09-30T13:57:00.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 -- start start 2023-09-30T13:57:00.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a837b0 0x559d21a7f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a83b90 0x559d21a7b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d21a7fdf0 con 0x559d21a6a9f0 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d21a524b0 con 0x559d21a837b0 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d21a80c60 con 0x559d21a83b90 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a33fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a33fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50994/0 (socket says 172.21.15.62:50994) 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.252+0000 7f0a33fff640 1 -- 172.21.15.62:0/1991808273 learned_addr learned my addr 172.21.15.62:0/1991808273 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 -- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a83b90 msgr2=0x559d21a7b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a83b90 0x559d21a7b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 -- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a837b0 msgr2=0x559d21a7f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a837b0 0x559d21a7f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 -- 172.21.15.62:0/1991808273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d219f4c20 con 0x559d21a6a9f0 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a33fff640 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a24001a10 tx=0x7f0a24031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4963c60bc53073b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a1a7fc640 1 -- 172.21.15.62:0/1991808273 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2404f040 con 0x559d21a6a9f0 2023-09-30T13:57:00.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a1a7fc640 1 -- 172.21.15.62:0/1991808273 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24041070 con 0x559d21a6a9f0 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a1a7fc640 1 -- 172.21.15.62:0/1991808273 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24055970 con 0x559d21a6a9f0 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a3d393740 1 -- 172.21.15.62:0/1991808273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 msgr2=0x559d21a7eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.253+0000 7f0a3d393740 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a24001a10 tx=0x7f0a24031000 comp rx=0 tx=0).stop 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 -- 172.21.15.62:0/1991808273 shutdown_connections 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a83b90 0x559d21a7b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a837b0 0x559d21a7f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 --2- 172.21.15.62:0/1991808273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a6a9f0 0x559d21a7eee0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 -- 172.21.15.62:0/1991808273 >> 172.21.15.62:0/1991808273 conn(0x559d21a56bf0 msgr2=0x559d21a6b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 -- 172.21.15.62:0/1991808273 shutdown_connections 2023-09-30T13:57:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 -- 172.21.15.62:0/1991808273 wait complete. 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 -- start start 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.254+0000 7f0a3d393740 1 Processor -- start 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 0x559d21b090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a83b90 0x559d21ab3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d21aa2d60 con 0x559d21a837b0 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d21ab0c70 con 0x559d21a83b90 2023-09-30T13:57:00.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d21b09600 con 0x559d21a6a9f0 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a3d393740 10 client.0 _ll_register_callbacks cb 0x7f0a28009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51006/0 (socket says 172.21.15.62:51006) 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 -- 172.21.15.62:0/724272736 learned_addr learned my addr 172.21.15.62:0/724272736 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a33fff640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 0x559d21b090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a38d9d640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a83b90 0x559d21ab3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 -- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 msgr2=0x559d21b090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 0x559d21b090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 -- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a83b90 msgr2=0x559d21ab3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a83b90 0x559d21ab3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a337fe640 1 -- 172.21.15.62:0/724272736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a28009400 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.255+0000 7f0a33fff640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 0x559d21b090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a337fe640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009bb0 tx=0x7f0a28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356884266bd6a0b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28014ee0 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a280038c0 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d219eb120 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a280045a0 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 10 client.5814 fetch_fsmap learned FSMap version 16 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559d2195f710 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d219eb120 con 0x559d21a837b0 2023-09-30T13:57:00.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a28011070 con 0x559d21a837b0 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 10 client.5814 fetch_fsmap finished waiting for FSMap version 16 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 10 client.5814 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 20 client.5814 populate_metadata read hostname 'smithi062' 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21ab3750 0x559d21aaf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 4 client.5814 mds_command: new command op to 5529 tid=0 multi_id=0 [{"prefix": "dump_historic_ops"}] 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 --> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] -- command(tid 0: {"prefix": "dump_historic_ops"}) v1 -- 0x559d219bb4a0 con 0x559d21ab3750 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.256+0000 7f0a33fff640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21ab3750 0x559d21aaf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.257+0000 7f0a12ffd640 10 client.5814 ms_handle_connect on v2:172.21.15.62:6833/220613510 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.257+0000 7f0a33fff640 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21ab3750 0x559d21aaf940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99be97b6f8bce925 server_cookie=596475043eec8318 in_seq=0 out_seq=0 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a12ffd640 1 -- 172.21.15.62:0/724272736 <== mds.0 v2:172.21.15.62:6833/220613510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+70458 (crc 0 0 0) 0x559d219bb4a0 con 0x559d21ab3750 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a12ffd640 10 client.5814 handle_command_reply: tid=0 2023-09-30T13:57:00.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 client.5814 shutdown 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 msgr2=0x559d21aa2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009bb0 tx=0x7f0a28004730 comp rx=0 tx=0).stop 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 shutdown_connections 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:6833/220613510,v1:172.21.15.62:6835/220613510] conn(0x559d21ab3750 0x559d21aaf940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d21a83b90 0x559d21ab3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559d21a837b0 0x559d21aa2610 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a12ffd640 0 client.5814 ms_handle_reset on v2:172.21.15.62:6833/220613510 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 --2- 172.21.15.62:0/724272736 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559d21a6a9f0 0x559d21b090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 >> 172.21.15.62:0/724272736 conn(0x559d21a56bf0 msgr2=0x559d21a7b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 shutdown_connections 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.258+0000 7f0a3d393740 1 -- 172.21.15.62:0/724272736 wait complete. 2023-09-30T13:57:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3d393740 20 client.5814 trim_cache size 0 max 16384 2023-09-30T13:57:00.266 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 20, 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 600, 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:2 setattr mode=041777 #0x1 2023-09-30T13:56:16.598920+0000 caller_uid=0, caller_gid=0{0,})", 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:16.599023+0000", 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 43.658965721000001, 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 1.141601401, 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.267 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 2 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599023+0000", 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.268 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599023+0000", 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599024+0000", 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599036+0000", 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599071+0000", 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599198+0000", 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599266+0000", 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:16.599266+0000", 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:17.740411+0000", 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:17.740470+0000", 2023-09-30T13:57:00.271 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:17.740590+0000", 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:17.740624+0000", 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:17.740625+0000", 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.272 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:5 create owner_uid=1000, owner_gid=1301 #0x10000000000/file_0 2023-09-30T13:56:18.923727+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:18.923809+0000", 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.334179841999998, 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052691179999999997, 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.273 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 5 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.923809+0000", 2023-09-30T13:57:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.923809+0000", 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.923810+0000", 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.923814+0000", 2023-09-30T13:57:00.275 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.923833+0000", 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.924041+0000", 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "failed to rdlock, waiting" 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.924183+0000", 2023-09-30T13:57:00.276 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.924467+0000", 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.924468+0000", 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.928863+0000", 2023-09-30T13:57:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.928996+0000", 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.929045+0000", 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.929078+0000", 2023-09-30T13:57:00.278 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:18.929078+0000", 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:32 mkdir owner_uid=1000, owner_gid=1301 #0x1/dir2 2023-09-30T13:56:19.200292+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.200360+0000", 2023-09-30T13:57:00.279 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.057628716000004, 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0056426569999999997, 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 32 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.280 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200360+0000", 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200360+0000", 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.281 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200361+0000", 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200364+0000", 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200378+0000", 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.282 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.200799+0000", 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.201253+0000", 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.201254+0000", 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.283 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.205655+0000", 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.205820+0000", 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.205942+0000", 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206002+0000", 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206003+0000", 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.285 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:33 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_0 2023-09-30T13:56:19.201964+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.202040+0000", 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.055949374999997, 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.00433549, 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.286 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 33 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202040+0000", 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202040+0000", 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202040+0000", 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202045+0000", 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202060+0000", 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202366+0000", 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "failed to rdlock, waiting" 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.202634+0000", 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.203163+0000", 2023-09-30T13:57:00.289 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.203164+0000", 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206005+0000", 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206216+0000", 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206305+0000", 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206373+0000", 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.206375+0000", 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.291 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:36 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_3 2023-09-30T13:56:19.213935+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.214006+0000", 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.043983107000003, 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0050024220000000003, 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.292 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 36 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214006+0000", 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214006+0000", 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214006+0000", 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214010+0000", 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.294 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214029+0000", 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214128+0000", 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214432+0000", 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.295 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.214432+0000", 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.218728+0000", 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.218861+0000", 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.218946+0000", 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.219007+0000", 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.219008+0000", 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.297 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:38 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_5 2023-09-30T13:56:19.222980+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.223055+0000", 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.034933924000001, 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051475690000000003, 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.298 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 38 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223055+0000", 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.299 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223055+0000", 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223056+0000", 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223060+0000", 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.300 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223079+0000", 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223181+0000", 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223492+0000", 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.301 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.223493+0000", 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.227841+0000", 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.228044+0000", 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.228135+0000", 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.228201+0000", 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.228203+0000", 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.303 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:41 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_8 2023-09-30T13:56:19.238020+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.238097+0000", 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.019892357000003, 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0079512090000000007, 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.304 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 41 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238097+0000", 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238097+0000", 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238097+0000", 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238101+0000", 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238125+0000", 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238230+0000", 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238549+0000", 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.307 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.238550+0000", 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.245673+0000", 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.245889+0000", 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.308 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.245977+0000", 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246046+0000", 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246048+0000", 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.309 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:42 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_9 2023-09-30T13:56:19.246586+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.246661+0000", 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 41.011327672999997, 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0062692039999999996, 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.310 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 42 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246661+0000", 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246661+0000", 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246662+0000", 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246666+0000", 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.312 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246685+0000", 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.246788+0000", 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.247097+0000", 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.247097+0000", 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.252710+0000", 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.252848+0000", 2023-09-30T13:57:00.314 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.252897+0000", 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.252930+0000", 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.252931+0000", 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:46 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_13 2023-09-30T13:56:19.263508+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.263577+0000", 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.994411585999998, 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005142148, 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 46 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263577+0000", 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263577+0000", 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263578+0000", 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263582+0000", 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.318 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263601+0000", 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.263698+0000", 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.264007+0000", 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.264007+0000", 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.268512+0000", 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.268637+0000", 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.268684+0000", 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.268719+0000", 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.268720+0000", 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.321 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:47 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_14 2023-09-30T13:56:19.269256+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.269327+0000", 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.988662128999998, 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005057466, 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.322 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 47 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269327+0000", 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269327+0000", 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269327+0000", 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269332+0000", 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269351+0000", 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269450+0000", 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269760+0000", 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.269761+0000", 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.274171+0000", 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.274301+0000", 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.274350+0000", 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.274384+0000", 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.274384+0000", 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.327 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:52 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_19 2023-09-30T13:56:19.291491+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.291559+0000", 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.9664304, 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0052273299999999997, 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.328 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 52 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291559+0000", 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291559+0000", 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291559+0000", 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291563+0000", 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291581+0000", 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.291684+0000", 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.292008+0000", 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.292009+0000", 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.296516+0000", 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.296642+0000", 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.332 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.296702+0000", 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.296785+0000", 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.296786+0000", 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.333 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:55 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_22 2023-09-30T13:56:19.304243+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.304316+0000", 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.953673404, 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.005218037, 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.334 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 55 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304316+0000", 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304316+0000", 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304316+0000", 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304322+0000", 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304339+0000", 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304438+0000", 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304742+0000", 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.304742+0000", 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.309277+0000", 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.309404+0000", 2023-09-30T13:57:00.338 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.309463+0000", 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.309532+0000", 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.309534+0000", 2023-09-30T13:57:00.339 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:57 create owner_uid=1000, owner_gid=1301 #0x1000000020e/file_24 2023-09-30T13:56:19.313511+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.313587+0000", 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.944401659999997, 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0047741420000000003, 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.340 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 57 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313587+0000", 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313587+0000", 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313588+0000", 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313592+0000", 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313609+0000", 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.313705+0000", 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.314013+0000", 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.314013+0000", 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.318111+0000", 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.318232+0000", 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.318294+0000", 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.318360+0000", 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.318362+0000", 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.345 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:60 mkdir owner_uid=1000, owner_gid=1301 #0x1/dir3 2023-09-30T13:56:19.498147+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.498214+0000", 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.759775347000001, 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0046105979999999996, 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.346 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 60 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498214+0000", 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.347 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498214+0000", 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498214+0000", 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498220+0000", 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498236+0000", 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498452+0000", 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498721+0000", 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.498722+0000", 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.502610+0000", 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.502708+0000", 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.350 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.502792+0000", 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.502824+0000", 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.502824+0000", 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.351 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:67 create owner_uid=1000, owner_gid=1301 #0x10000000228/file_6 2023-09-30T13:56:19.520975+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.521049+0000", 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.736940367999999, 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0053909600000000002, 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.352 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 67 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521049+0000", 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.353 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521049+0000", 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521049+0000", 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521054+0000", 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.354 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521092+0000", 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521194+0000", 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521503+0000", 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.355 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.521503+0000", 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.526222+0000", 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.526349+0000", 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.526403+0000", 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.526439+0000", 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.526440+0000", 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.357 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:71 create owner_uid=1000, owner_gid=1301 #0x10000000228/file_10 2023-09-30T13:56:19.538265+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.538342+0000", 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.719647315000003, 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0049745359999999999, 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.358 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 71 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538342+0000", 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.359 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538342+0000", 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538342+0000", 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538347+0000", 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.360 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538363+0000", 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538461+0000", 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538776+0000", 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.361 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.538776+0000", 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.543110+0000", 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.543231+0000", 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.362 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.543282+0000", 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.543316+0000", 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.543316+0000", 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.363 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:88 mkdir owner_uid=1000, owner_gid=1301 #0x1/dir4 2023-09-30T13:56:19.732083+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.732148+0000", 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.525841202999999, 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0046366150000000002, 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.364 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 88 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732148+0000", 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732148+0000", 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732148+0000", 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732152+0000", 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732169+0000", 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732391+0000", 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732663+0000", 2023-09-30T13:57:00.367 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.732663+0000", 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.736574+0000", 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.736674+0000", 2023-09-30T13:57:00.368 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.736744+0000", 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.736784+0000", 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.736784+0000", 2023-09-30T13:57:00.369 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:106 create owner_uid=1000, owner_gid=1301 #0x10000000242/file_17 2023-09-30T13:56:19.798527+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:19.798603+0000", 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.459385660000002, 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 0.0051361999999999996, 2023-09-30T13:57:00.370 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 106 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.371 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798603+0000", 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798603+0000", 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798604+0000", 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798608+0000", 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798627+0000", 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.798731+0000", 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.799045+0000", 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "early_replied" 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.799045+0000", 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "submit entry: journal_and_reply" 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.803492+0000", 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "journal_committed: " 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.374 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.803624+0000", 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.803687+0000", 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.803739+0000", 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.375 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:19.803740+0000", 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:126 readdir #0x10000000242 2023-09-30T13:56:20.152073+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:20.152133+0000", 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 40.105856195999998, 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 16.507067654, 2023-09-30T13:57:00.376 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 126 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.377 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152133+0000", 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152133+0000", 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152133+0000", 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152136+0000", 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152149+0000", 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.152193+0000", 2023-09-30T13:57:00.379 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:20.652361+0000", 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:21.152452+0000", 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:21.652643+0000", 2023-09-30T13:57:00.380 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:22.152831+0000", 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:22.652958+0000", 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:23.153126+0000", 2023-09-30T13:57:00.381 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:23.653293+0000", 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:24.153473+0000", 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.382 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:24.653636+0000", 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:25.153831+0000", 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:25.654010+0000", 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.383 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:26.154186+0000", 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:26.654400+0000", 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:27.154576+0000", 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.384 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:27.654787+0000", 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:28.154973+0000", 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:28.655172+0000", 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.385 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:29.155368+0000", 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:29.655563+0000", 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:30.155770+0000", 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.386 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:30.655975+0000", 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:31.156160+0000", 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:31.656327+0000", 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:32.156526+0000", 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:32.656716+0000", 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:33.156891+0000", 2023-09-30T13:57:00.388 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:33.657056+0000", 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:34.157173+0000", 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:34.657264+0000", 2023-09-30T13:57:00.389 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:35.157433+0000", 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:35.657612+0000", 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.390 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.157802+0000", 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.658107+0000", 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "failed to rdlock, waiting" 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.658593+0000", 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.391 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.659054+0000", 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.659104+0000", 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.659199+0000", 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.392 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.659201+0000", 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "description": "client_request(client.5763:129 readdir #0x10000000228 2023-09-30T13:56:36.662134+0000 caller_uid=1000, caller_gid=1301{6,36,1000,1301,})", 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "initiated_at": "2023-09-30T13:56:36.662244+0000", 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 23.595745044000001, 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "duration": 22.508804648000002, 2023-09-30T13:57:00.393 INFO:teuthology.orchestra.run.smithi062.stdout: "type_data": { 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "flag_point": "done", 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "reqid": { 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": { 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 5763 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 129 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "op_type": "client_request", 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: "events": [ 2023-09-30T13:57:00.394 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662244+0000", 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "initiated" 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662244+0000", 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "header_read" 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662245+0000", 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "throttled" 2023-09-30T13:57:00.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662250+0000", 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "all_read" 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662269+0000", 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "dispatched" 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:36.662326+0000", 2023-09-30T13:57:00.396 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:37.162504+0000", 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:37.662706+0000", 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:38.162891+0000", 2023-09-30T13:57:00.397 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:38.663047+0000", 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:39.163188+0000", 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.398 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:39.663378+0000", 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:40.163569+0000", 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:40.663786+0000", 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.399 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:41.163946+0000", 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:41.664038+0000", 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:42.164169+0000", 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.400 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:42.664353+0000", 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:43.164530+0000", 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:43.664698+0000", 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.401 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:44.164836+0000", 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:44.664989+0000", 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:45.165176+0000", 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.402 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:45.665381+0000", 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:46.165549+0000", 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:46.665714+0000", 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.403 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:47.165901+0000", 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:47.666073+0000", 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:48.166250+0000", 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.404 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:48.666375+0000", 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:49.166572+0000", 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:49.666779+0000", 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.405 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:50.166879+0000", 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:50.666987+0000", 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:51.167072+0000", 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.406 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:51.667216+0000", 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:52.167403+0000", 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:52.667607+0000", 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.407 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:53.167813+0000", 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:53.667974+0000", 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:54.168134+0000", 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:54.668332+0000", 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:55.168507+0000", 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:55.668699+0000", 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:56.168882+0000", 2023-09-30T13:57:00.409 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:56.669068+0000", 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:57.169227+0000", 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:57.669406+0000", 2023-09-30T13:57:00.410 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:58.169582+0000", 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:58.669790+0000", 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cap_acquisition_throttle" 2023-09-30T13:57:00.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.169964+0000", 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "failed to rdlock, waiting" 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.170447+0000", 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "acquired locks" 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.412 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.170905+0000", 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "replying" 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.170951+0000", 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "finishing request" 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.171048+0000", 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "cleaned up request" 2023-09-30T13:57:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: "time": "2023-09-30T13:56:59.171049+0000", 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: "event": "done" 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: "locks": null 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-09-30T13:57:00.414 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 msgr2=0x7f0a2006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 0x7f0a2006d020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034000 tx=0x7f0a24009030 comp rx=0 tx=0).stop 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 msgr2=0x7f0a34159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a340d0440 tx=0x7f0a2c00e530 comp rx=0 tx=0).stop 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 shutdown_connections 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0a2006ab60 0x7f0a2006d020 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34159af0 0x7f0a34159f70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0a3415f4d0 0x7f0a341f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 --2- 172.21.15.62:0/1869564130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1c0039a0 0x7f0a340cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 >> 172.21.15.62:0/1869564130 conn(0x7f0a34089fe0 msgr2=0x7f0a340b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 shutdown_connections 2023-09-30T13:57:00.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.259+0000 7f0a3959e640 1 -- 172.21.15.62:0/1869564130 wait complete. 2023-09-30T13:57:00.418 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T13:57:00.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:57:00.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:57:00.509 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T13:57:00.510 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:00.510 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:00.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:00.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.672+0000 7f184a689640 1 Processor -- start 2023-09-30T13:57:00.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.672+0000 7f184a689640 1 -- start start 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18441598c0 0x7f18440ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18440cea30 0x7f18440cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f184415d520 0x7f184415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18440b1e20 con 0x7f184415d520 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18440cf3b0 con 0x7f18440cea30 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f184a689640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440b1530 con 0x7f18441598c0 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f1848c26640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f184415d520 0x7f184415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f1848c26640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f184415d520 0x7f184415d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51020/0 (socket says 172.21.15.62:51020) 2023-09-30T13:57:00.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f1848c26640 1 -- 172.21.15.62:0/763279456 learned_addr learned my addr 172.21.15.62:0/763279456 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f18437fe640 1 --2- 172.21.15.62:0/763279456 >> v2:172.21.15.135:3300/0 conn(0x7f18440cea30 0x7f18440cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.673+0000 7f1843fff640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18441598c0 0x7f18440ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 -- 172.21.15.62:0/763279456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18441598c0 msgr2=0x7f18440ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18441598c0 0x7f18440ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 -- 172.21.15.62:0/763279456 >> v2:172.21.15.135:3300/0 conn(0x7f18440cea30 msgr2=0x7f18440cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 --2- 172.21.15.62:0/763279456 >> v2:172.21.15.135:3300/0 conn(0x7f18440cea30 0x7f18440cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 -- 172.21.15.62:0/763279456 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18440b17d0 con 0x7f184415d520 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1848c26640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f184415d520 0x7f184415d9b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f18440cf6a0 tx=0x7f183c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7950ff4f0410fe85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1842ffd640 1 -- 172.21.15.62:0/763279456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c02ca70 con 0x7f184415d520 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1842ffd640 1 -- 172.21.15.62:0/763279456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c02cbd0 con 0x7f184415d520 2023-09-30T13:57:00.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.674+0000 7f1842ffd640 1 -- 172.21.15.62:0/763279456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0343f0 con 0x7f184415d520 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 -- 172.21.15.62:0/763279456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f184415d520 msgr2=0x7f184415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f184415d520 0x7f184415d9b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f18440cf6a0 tx=0x7f183c02bed0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 -- 172.21.15.62:0/763279456 shutdown_connections 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f184415d520 0x7f184415d9b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 --2- 172.21.15.62:0/763279456 >> v2:172.21.15.135:3300/0 conn(0x7f18440cea30 0x7f18440cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 --2- 172.21.15.62:0/763279456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18441598c0 0x7f18440ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 -- 172.21.15.62:0/763279456 >> 172.21.15.62:0/763279456 conn(0x7f184406a170 msgr2=0x7f184406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 -- 172.21.15.62:0/763279456 shutdown_connections 2023-09-30T13:57:00.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.675+0000 7f184a689640 1 -- 172.21.15.62:0/763279456 wait complete. 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.676+0000 7f184a689640 1 Processor -- start 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.676+0000 7f184a689640 1 -- start start 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18440cea30 0x7f18441555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184415d520 0x7f18440cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844155b10 con 0x7f18441598c0 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c25e0 con 0x7f184415d520 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f184a689640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c28c0 con 0x7f18440cea30 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51028/0 (socket says 172.21.15.62:51028) 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 -- 172.21.15.62:0/3264442227 learned_addr learned my addr 172.21.15.62:0/3264442227 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f1843fff640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18440cea30 0x7f18441555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f1848c26640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184415d520 0x7f18440cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 -- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18440cea30 msgr2=0x7f18441555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18440cea30 0x7f18441555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 -- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184415d520 msgr2=0x7f18440cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184415d520 0x7f18440cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.677+0000 7f18437fe640 1 -- 172.21.15.62:0/3264442227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c009b30 con 0x7f18441598c0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f18437fe640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f183400d800 tx=0x7f183400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400b6c0 con 0x7f18441598c0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400b820 con 0x7f18441598c0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400bbb0 con 0x7f18441598c0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440c2ba0 con 0x7f18441598c0 2023-09-30T13:57:00.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.678+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18440c3160 con 0x7f18441598c0 2023-09-30T13:57:00.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.679+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184404e0d0 con 0x7f18441598c0 2023-09-30T13:57:00.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.679+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f183400bd10 con 0x7f18441598c0 2023-09-30T13:57:00.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.680+0000 7f1840ff9640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 0x7f183006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.680+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1834089930 con 0x7f18441598c0 2023-09-30T13:57:00.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.680+0000 7f1843fff640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 0x7f183006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.680+0000 7f1843fff640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 0x7f183006cff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f183800b930 tx=0x7f1838008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.684+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1834054a20 con 0x7f18441598c0 2023-09-30T13:57:00.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.864+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18440c5480 con 0x7f18441598c0 2023-09-30T13:57:00.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.865+0000 7f1840ff9640 1 -- 172.21.15.62:0/3264442227 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f1834058040 con 0x7f18441598c0 2023-09-30T13:57:00.865 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:32.493691+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:00.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 msgr2=0x7f183006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 0x7f183006cff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f183800b930 tx=0x7f1838008040 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 msgr2=0x7f18440cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f183400d800 tx=0x7f183400dcc0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 shutdown_connections 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f183006ab30 0x7f183006cff0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184415d520 0x7f18440cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18441598c0 0x7f18440cb0f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 --2- 172.21.15.62:0/3264442227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18440cea30 0x7f18441555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 >> 172.21.15.62:0/3264442227 conn(0x7f184406a170 msgr2=0x7f18440aca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 shutdown_connections 2023-09-30T13:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.867+0000 7f184a689640 1 -- 172.21.15.62:0/3264442227 wait complete. 2023-09-30T13:57:00.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:56:03.919978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:56:04.353687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:00.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.986+0000 7f4fe3494640 1 Processor -- start 2023-09-30T13:57:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 -- start start 2023-09-30T13:57:00.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4fdc15cb00 0x7f4fdc071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc0c9a00 con 0x7f4fdc0ae300 2023-09-30T13:57:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc06d740 con 0x7f4fdc15cee0 2023-09-30T13:57:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe3494640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc06da20 con 0x7f4fdc15cb00 2023-09-30T13:57:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.987+0000 7f4fe0a2f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51036/0 (socket says 172.21.15.62:51036) 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 -- 172.21.15.62:0/4263259455 learned_addr learned my addr 172.21.15.62:0/4263259455 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe1230640 1 --2- 172.21.15.62:0/4263259455 >> v2:172.21.15.135:3300/0 conn(0x7f4fdc15cb00 0x7f4fdc071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 -- 172.21.15.62:0/4263259455 >> v2:172.21.15.135:3300/0 conn(0x7f4fdc15cb00 msgr2=0x7f4fdc071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 --2- 172.21.15.62:0/4263259455 >> v2:172.21.15.135:3300/0 conn(0x7f4fdc15cb00 0x7f4fdc071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 -- 172.21.15.62:0/4263259455 >> v1:172.21.15.135:6789/0 conn(0x7f4fdc0ae300 legacy=0x7f4fdc06ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.988+0000 7f4fe0a2f640 1 -- 172.21.15.62:0/4263259455 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc06dd00 con 0x7f4fdc15cee0 2023-09-30T13:57:00.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe0a2f640 1 --2- 172.21.15.62:0/4263259455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc066910 tx=0x7f4fcc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4146f9d9305f8d48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fd3fff640 1 -- 172.21.15.62:0/4263259455 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030860 con 0x7f4fdc15cee0 2023-09-30T13:57:00.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fd3fff640 1 -- 172.21.15.62:0/4263259455 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0309c0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fd3fff640 1 -- 172.21.15.62:0/4263259455 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030d50 con 0x7f4fdc15cee0 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 -- 172.21.15.62:0/4263259455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 msgr2=0x7f4fdc0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 --2- 172.21.15.62:0/4263259455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc066910 tx=0x7f4fcc02b9a0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 -- 172.21.15.62:0/4263259455 shutdown_connections 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 --2- 172.21.15.62:0/4263259455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc0c94c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 --2- 172.21.15.62:0/4263259455 >> v2:172.21.15.135:3300/0 conn(0x7f4fdc15cb00 0x7f4fdc071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 -- 172.21.15.62:0/4263259455 >> 172.21.15.62:0/4263259455 conn(0x7f4fdc070970 msgr2=0x7f4fdc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 -- 172.21.15.62:0/4263259455 shutdown_connections 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.989+0000 7f4fe3494640 1 -- 172.21.15.62:0/4263259455 wait complete. 2023-09-30T13:57:00.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.990+0000 7f4fe3494640 1 Processor -- start 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 -- start start 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 0x7f4fdc15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc15cb00 0x7f4fdc15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc1f3420 con 0x7f4fdc15cee0 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc1f69d0 con 0x7f4fdc0ae300 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe3494640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc1f5c10 con 0x7f4fdc15cb00 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe1a31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe1a31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51040/0 (socket says 172.21.15.62:51040) 2023-09-30T13:57:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.991+0000 7f4fe1a31640 1 -- 172.21.15.62:0/2161681966 learned_addr learned my addr 172.21.15.62:0/2161681966 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe0a2f640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc15cb00 0x7f4fdc15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1230640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 0x7f4fdc15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 -- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc15cb00 msgr2=0x7f4fdc15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc15cb00 0x7f4fdc15a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 -- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 msgr2=0x7f4fdc15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 0x7f4fdc15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 -- 172.21.15.62:0/2161681966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0094d0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1230640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 0x7f4fdc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe1a31640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c760 tx=0x7f4fd400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4003b70 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4003cf0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400aa90 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc1f5ef0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.992+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc1f64b0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.993+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc0666d0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.994+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4fd400abf0 con 0x7f4fdc15cee0 2023-09-30T13:57:00.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.994+0000 7f4fd1ffb640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 0x7f4fc006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.994+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4fd4089040 con 0x7f4fdc15cee0 2023-09-30T13:57:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.994+0000 7f4fe1230640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 0x7f4fc006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.995+0000 7f4fe1230640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 0x7f4fc006cff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8006fd0 tx=0x7f4fd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:00.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:00.998+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4fd40541c0 con 0x7f4fdc15cee0 2023-09-30T13:57:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.174+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fdc0c9870 con 0x7f4fdc15cee0 2023-09-30T13:57:01.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.175+0000 7f4fd1ffb640 1 -- 172.21.15.62:0/2161681966 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fd4003e60 con 0x7f4fdc15cee0 2023-09-30T13:57:01.174 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 msgr2=0x7f4fc006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 0x7f4fc006cff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8006fd0 tx=0x7f4fd8008040 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 msgr2=0x7f4fdc15ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c760 tx=0x7f4fd400cc20 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 shutdown_connections 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4fc006ab30 0x7f4fc006cff0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fdc15cee0 0x7f4fdc15ae80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fdc15cb00 0x7f4fdc15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 --2- 172.21.15.62:0/2161681966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fdc0ae300 0x7f4fdc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.176+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 >> 172.21.15.62:0/2161681966 conn(0x7f4fdc070970 msgr2=0x7f4fdc06ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.177+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 shutdown_connections 2023-09-30T13:57:01.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.177+0000 7f4fe3494640 1 -- 172.21.15.62:0/2161681966 wait complete. 2023-09-30T13:57:01.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:57:01.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.301+0000 7f797e056640 1 Processor -- start 2023-09-30T13:57:01.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.301+0000 7f797e056640 1 -- start start 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79780b2030 0x7f79780b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b0a70 0x7f79780b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79780b3fe0 0x7f797815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797815bc30 con 0x7f79780b3fe0 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79780b0ef0 con 0x7f79780b2030 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f797e056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797815b290 con 0x7f79780b0a70 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79780b3fe0 0x7f797815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f79780b3fe0 0x7f797815e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51046/0 (socket says 172.21.15.62:51046) 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 -- 172.21.15.62:0/4223180329 learned_addr learned my addr 172.21.15.62:0/4223180329 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7976ffd640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b0a70 0x7f79780b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f79777fe640 1 --2- 172.21.15.62:0/4223180329 >> v2:172.21.15.135:3300/0 conn(0x7f79780b2030 0x7f79780b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 -- 172.21.15.62:0/4223180329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b0a70 msgr2=0x7f79780b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b0a70 0x7f79780b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 -- 172.21.15.62:0/4223180329 >> v2:172.21.15.135:3300/0 conn(0x7f79780b2030 msgr2=0x7f79780b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 --2- 172.21.15.62:0/4223180329 >> v2:172.21.15.135:3300/0 conn(0x7f79780b2030 0x7f79780b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.302+0000 7f7977fff640 1 -- 172.21.15.62:0/4223180329 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797815b570 con 0x7f79780b3fe0 2023-09-30T13:57:01.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.303+0000 7f7977fff640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b3fe0 0x7f797815e5c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f79780cbd70 tx=0x7f797002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2214a4786a4d313 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.303+0000 7f79767fc640 1 -- 172.21.15.62:0/4223180329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797002ca70 con 0x7f79780b3fe0 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.303+0000 7f79767fc640 1 -- 172.21.15.62:0/4223180329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797002cbd0 con 0x7f79780b3fe0 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.303+0000 7f79767fc640 1 -- 172.21.15.62:0/4223180329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700343f0 con 0x7f79780b3fe0 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 -- 172.21.15.62:0/4223180329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b3fe0 msgr2=0x7f797815e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b3fe0 0x7f797815e5c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f79780cbd70 tx=0x7f797002bed0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 -- 172.21.15.62:0/4223180329 shutdown_connections 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b3fe0 0x7f797815e5c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 --2- 172.21.15.62:0/4223180329 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b0a70 0x7f79780b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 --2- 172.21.15.62:0/4223180329 >> v2:172.21.15.135:3300/0 conn(0x7f79780b2030 0x7f79780b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 -- 172.21.15.62:0/4223180329 >> 172.21.15.62:0/4223180329 conn(0x7f79780cb720 msgr2=0x7f79780ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 -- 172.21.15.62:0/4223180329 shutdown_connections 2023-09-30T13:57:01.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.304+0000 7f797e056640 1 -- 172.21.15.62:0/4223180329 wait complete. 2023-09-30T13:57:01.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.306+0000 7f797e056640 1 Processor -- start 2023-09-30T13:57:01.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.306+0000 7f797e056640 1 -- start start 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 0x7f79781599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 0x7f79780ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797814b430 con 0x7f79780b0a70 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978159550 con 0x7f79780b3fe0 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f797e056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7978158660 con 0x7f79780b2030 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f79777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f79777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51056/0 (socket says 172.21.15.62:51056) 2023-09-30T13:57:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.307+0000 7f79777fe640 1 -- 172.21.15.62:0/1964851898 learned_addr learned my addr 172.21.15.62:0/1964851898 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f7977fff640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 0x7f79780ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f7976ffd640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 0x7f79781599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 -- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 msgr2=0x7f79781599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 0x7f79781599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 -- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 msgr2=0x7f79780ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 0x7f79780ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 -- 172.21.15.62:0/1964851898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009b30 con 0x7f79780b0a70 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f7977fff640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 0x7f79780ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f7976ffd640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 0x7f79781599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f79777fe640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f796800e9b0 tx=0x7f796800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968009670 con 0x7f79780b0a70 2023-09-30T13:57:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800c9a0 con 0x7f79780b0a70 2023-09-30T13:57:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7978158940 con 0x7f79780b0a70 2023-09-30T13:57:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800cd50 con 0x7f79780b0a70 2023-09-30T13:57:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.308+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7978158f00 con 0x7f79780b0a70 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.309+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797806c640 con 0x7f79780b0a70 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.309+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7968013470 con 0x7f79780b0a70 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.310+0000 7f795ffff640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 0x7f796406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.310+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7968089570 con 0x7f79780b0a70 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.310+0000 7f7976ffd640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 0x7f796406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.311+0000 7f7976ffd640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 0x7f796406cff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7978070aa0 tx=0x7f796c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.314+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f79680546f0 con 0x7f79780b0a70 2023-09-30T13:57:01.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.508+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f797804e0d0 con 0x7f79780b0a70 2023-09-30T13:57:01.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.509+0000 7f795ffff640 1 -- 172.21.15.62:0/1964851898 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7968057d10 con 0x7f79780b0a70 2023-09-30T13:57:01.509 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:57:01.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 msgr2=0x7f796406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 0x7f796406cff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7978070aa0 tx=0x7f796c008040 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 msgr2=0x7f797814aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f796800e9b0 tx=0x7f796800ee70 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 shutdown_connections 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f796406ab30 0x7f796406cff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79780b3fe0 0x7f79780ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79780b2030 0x7f79781599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 --2- 172.21.15.62:0/1964851898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79780b0a70 0x7f797814aef0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 >> 172.21.15.62:0/1964851898 conn(0x7f79780cb720 msgr2=0x7f797815e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 shutdown_connections 2023-09-30T13:57:01.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.511+0000 7f797e056640 1 -- 172.21.15.62:0/1964851898 wait complete. 2023-09-30T13:57:01.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:57:01.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 Processor -- start 2023-09-30T13:57:01.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 -- start start 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48a806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80cdb30 con 0x7f48a815dc60 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80ccf20 con 0x7f48a80cdfc0 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48adee0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80cd200 con 0x7f48a80cca40 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48a77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48a815dc60 0x7f48a80b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46354/0 (socket says 172.21.15.62:46354) 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.632+0000 7f48a77fe640 1 -- 172.21.15.62:0/2634403849 learned_addr learned my addr 172.21.15.62:0/2634403849 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48a806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264448188 0 0) 0x7f48a80cdb30 con 0x7f48a815dc60 2023-09-30T13:57:01.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003520 con 0x7f48a815dc60 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701075890 0 0) 0x7f4890003520 con 0x7f48a815dc60 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 msgr2=0x7f48a806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48a806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 >> v1:172.21.15.135:6789/0 conn(0x7f48a80cdfc0 legacy=0x7f48a806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80cd4e0 con 0x7f48a815dc60 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f489c001670 con 0x7f48a815dc60 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 >> v1:172.21.15.62:6789/0 conn(0x7f48a815dc60 legacy=0x7f48a80b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48900039a0 0x7f4890003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4890004d00 0x7f4890005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80cd200 con 0x7f4890004d00 2023-09-30T13:57:01.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489000bab0 con 0x7f48900039a0 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489000bc70 con 0x7f48a80cca40 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a7fff640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4890004d00 0x7f4890005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a77fe640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48900039a0 0x7f4890003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.633+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 -- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 msgr2=0x7f48900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80cca40 0x7f48900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 -- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48900039a0 msgr2=0x7f4890003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48900039a0 0x7f4890003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 -- 172.21.15.62:0/2634403849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890003520 con 0x7f4890004d00 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a7fff640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4890004d00 0x7f4890005180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f48a0001e50 tx=0x7f48900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2cf37b4f97e9f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0003b70 con 0x7f4890004d00 2023-09-30T13:57:01.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0003cd0 con 0x7f4890004d00 2023-09-30T13:57:01.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.634+0000 7f48a67fc640 1 -- 172.21.15.62:0/2634403849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0005310 con 0x7f4890004d00 2023-09-30T13:57:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 -- 172.21.15.62:0/2634403849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4890004d00 msgr2=0x7f4890005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 --2- 172.21.15.62:0/2634403849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4890004d00 0x7f4890005180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f48a0001e50 tx=0x7f48900057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48a7fff640 1 -- 172.21.15.62:0/2634403849 reap_dead start 2023-09-30T13:57:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 -- 172.21.15.62:0/2634403849 shutdown_connections 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 -- 172.21.15.62:0/2634403849 >> 172.21.15.62:0/2634403849 conn(0x7f48a8070970 msgr2=0x7f48a8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 -- 172.21.15.62:0/2634403849 shutdown_connections 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.635+0000 7f48adee0640 1 -- 172.21.15.62:0/2634403849 wait complete. 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.636+0000 7f48adee0640 1 Processor -- start 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.636+0000 7f48adee0640 1 -- start start 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 0x7f48a80c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80c76c0 0x7f48a80c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80c7c00 con 0x7f48a81efd60 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80c7ee0 con 0x7f48a80c7240 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48adee0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80c81c0 con 0x7f48a80c76c0 2023-09-30T13:57:01.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51064/0 (socket says 172.21.15.62:51064) 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 -- 172.21.15.62:0/1774344207 learned_addr learned my addr 172.21.15.62:0/1774344207 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 0x7f48a80c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a7fff640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80c76c0 0x7f48a80c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 -- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80c76c0 msgr2=0x7f48a80c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80c76c0 0x7f48a80c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 -- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 msgr2=0x7f48a80c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 0x7f48a80c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a77fe640 1 -- 172.21.15.62:0/1774344207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80c84a0 con 0x7f48a81efd60 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.637+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 0x7f48a80c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f48a77fe640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f489c0072c0 tx=0x7f489c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00f8e0 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00fa40 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a80c8780 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00fdf0 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.638+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a80b0120 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.639+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a80666d0 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.639+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f489c01d460 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.640+0000 7f488ffff640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 0x7f489406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.640+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f489c0895d0 con 0x7f48a81efd60 2023-09-30T13:57:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.640+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 0x7f489406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.640+0000 7f48a6ffd640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 0x7f489406cff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48a814ea80 tx=0x7f4898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.644+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f489c0546c0 con 0x7f48a81efd60 2023-09-30T13:57:01.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.817+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48a80b0340 con 0x7f48a81efd60 2023-09-30T13:57:01.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.818+0000 7f488ffff640 1 -- 172.21.15.62:0/1774344207 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f489c057ce0 con 0x7f48a81efd60 2023-09-30T13:57:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:57:01.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 msgr2=0x7f489406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 0x7f489406cff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48a814ea80 tx=0x7f4898008040 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 msgr2=0x7f48a80c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f489c0072c0 tx=0x7f489c007780 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 shutdown_connections 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f489406ab30 0x7f489406cff0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48a80c76c0 0x7f48a80c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48a80c7240 0x7f48a80c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 --2- 172.21.15.62:0/1774344207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48a81efd60 0x7f48a80c8ca0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 >> 172.21.15.62:0/1774344207 conn(0x7f48a8070970 msgr2=0x7f48a80c1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 shutdown_connections 2023-09-30T13:57:01.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.820+0000 7f48adee0640 1 -- 172.21.15.62:0/1774344207 wait complete. 2023-09-30T13:57:01.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:57:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.937+0000 7f152f9b0640 1 Processor -- start 2023-09-30T13:57:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 -- start start 2023-09-30T13:57:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 0x7f15280ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15280cb600 0x7f15280b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15280b0000 con 0x7f152815e100 2023-09-30T13:57:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280b0c40 con 0x7f15280cb600 2023-09-30T13:57:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.938+0000 7f152f9b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15280cad30 con 0x7f152815dd20 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152df4d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15280cb600 0x7f15280b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152cf4b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f152815e100 0x7f15280caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:46286/0 (socket says 172.21.15.62:46286) 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152d74c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 0x7f15280ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152cf4b640 1 -- 172.21.15.62:0/2703779140 learned_addr learned my addr 172.21.15.62:0/2703779140 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f1527fff640 1 -- 172.21.15.62:0/2703779140 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013898278 0 0) 0x7f15280b0000 con 0x7f152815e100 2023-09-30T13:57:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f1527fff640 1 -- 172.21.15.62:0/2703779140 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1510003520 con 0x7f152815e100 2023-09-30T13:57:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152df4d640 1 -- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 msgr2=0x7f15280ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152df4d640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 0x7f15280ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152df4d640 1 -- 172.21.15.62:0/2703779140 >> v1:172.21.15.135:6789/0 conn(0x7f152815e100 legacy=0x7f15280caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152df4d640 1 -- 172.21.15.62:0/2703779140 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15280b02a0 con 0x7f15280cb600 2023-09-30T13:57:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.939+0000 7f152d74c640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 0x7f15280ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.940+0000 7f152df4d640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280cb600 0x7f15280b13c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3489e124be11bce3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.940+0000 7f1527fff640 1 -- 172.21.15.62:0/2703779140 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151802cc50 con 0x7f15280cb600 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.940+0000 7f1527fff640 1 -- 172.21.15.62:0/2703779140 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151802cdb0 con 0x7f15280cb600 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.940+0000 7f1527fff640 1 -- 172.21.15.62:0/2703779140 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518034660 con 0x7f15280cb600 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 -- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280cb600 msgr2=0x7f15280b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280cb600 0x7f15280b13c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151802bea0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 -- 172.21.15.62:0/2703779140 shutdown_connections 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15280cb600 0x7f15280b13c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 --2- 172.21.15.62:0/2703779140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f152815dd20 0x7f15280ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 -- 172.21.15.62:0/2703779140 >> 172.21.15.62:0/2703779140 conn(0x7f152806a430 msgr2=0x7f152806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 -- 172.21.15.62:0/2703779140 shutdown_connections 2023-09-30T13:57:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.941+0000 7f152f9b0640 1 -- 172.21.15.62:0/2703779140 wait complete. 2023-09-30T13:57:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.942+0000 7f152f9b0640 1 Processor -- start 2023-09-30T13:57:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.942+0000 7f152f9b0640 1 -- start start 2023-09-30T13:57:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15280cb600 0x7f152814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 0x7f15280af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280cc120 con 0x7f152815dd20 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c44a0 con 0x7f152815e100 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152f9b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c4780 con 0x7f15280cb600 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51074/0 (socket says 172.21.15.62:51074) 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 -- 172.21.15.62:0/1910895427 learned_addr learned my addr 172.21.15.62:0/1910895427 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152d74c640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15280cb600 0x7f152814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152df4d640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 0x7f15280af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 -- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15280cb600 msgr2=0x7f152814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15280cb600 0x7f152814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 -- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 msgr2=0x7f15280af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 0x7f15280af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152cf4b640 1 -- 172.21.15.62:0/1910895427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520009400 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.943+0000 7f152df4d640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 0x7f15280af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f152cf4b640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f151c00c410 tx=0x7f151c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c005ce0 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c005e40 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0072f0 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518009a70 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.944+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15280c4d40 con 0x7f152815dd20 2023-09-30T13:57:01.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.945+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528073e70 con 0x7f152815dd20 2023-09-30T13:57:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.945+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f151c007510 con 0x7f152815dd20 2023-09-30T13:57:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.946+0000 7f1525ffb640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 0x7f151406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.946+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f151c088990 con 0x7f152815dd20 2023-09-30T13:57:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.946+0000 7f152d74c640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 0x7f151406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:01.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.946+0000 7f152d74c640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 0x7f151406cff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1520009c60 tx=0x7f1520008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:01.950+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f151c053bd0 con 0x7f152815dd20 2023-09-30T13:57:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.137+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1528070e30 con 0x7f152815dd20 2023-09-30T13:57:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.137+0000 7f1525ffb640 1 -- 172.21.15.62:0/1910895427 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f151c017080 con 0x7f152815dd20 2023-09-30T13:57:02.137 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 msgr2=0x7f151406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 0x7f151406cff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1520009c60 tx=0x7f1520008040 comp rx=0 tx=0).stop 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 msgr2=0x7f15280c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f151c00c410 tx=0x7f151c00c8d0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 shutdown_connections 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151406ab30 0x7f151406cff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f152815e100 0x7f15280af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f152815dd20 0x7f15280c3b70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 --2- 172.21.15.62:0/1910895427 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15280cb600 0x7f152814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 >> 172.21.15.62:0/1910895427 conn(0x7f152806a430 msgr2=0x7f1528159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 shutdown_connections 2023-09-30T13:57:02.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.139+0000 7f152f9b0640 1 -- 172.21.15.62:0/1910895427 wait complete. 2023-09-30T13:57:02.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:57:02.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:02.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:02.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[104350]: fuse finished with error 0 and tester_r 0 2023-09-30T13:57:02.180 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:57:02.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:02.180 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T13:57:02.266 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:57:02.267 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:02.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.412+0000 7fd066768640 1 Processor -- start 2023-09-30T13:57:02.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.412+0000 7fd066768640 1 -- start start 2023-09-30T13:57:02.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd066768640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd0600d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd066768640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd06006c660 0x7fd0600d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd066768640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600d16a0 con 0x7fd0600d0d00 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd066768640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600cfcf0 con 0x7fd06006c660 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd066768640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600cf450 con 0x7fd06015cbe0 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd05f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0600d0d00 0x7fd0600cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46358/0 (socket says 172.21.15.62:46358) 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.413+0000 7fd05f7fe640 1 -- 172.21.15.62:0/2371433429 learned_addr learned my addr 172.21.15.62:0/2371433429 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911910573 0 0) 0x7fd0600d16a0 con 0x7fd0600d0d00 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd048003520 con 0x7fd0600d0d00 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd064d05640 1 --2- 172.21.15.62:0/2371433429 >> v2:172.21.15.135:3300/0 conn(0x7fd06006c660 0x7fd0600d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd0600d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21555268 0 0) 0x7fd048003520 con 0x7fd0600d0d00 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 msgr2=0x7fd0600d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:02.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd0600d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 >> v2:172.21.15.135:3300/0 conn(0x7fd06006c660 msgr2=0x7fd0600d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 --2- 172.21.15.62:0/2371433429 >> v2:172.21.15.135:3300/0 conn(0x7fd06006c660 0x7fd0600d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600cf730 con 0x7fd0600d0d00 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd054001670 con 0x7fd0600d0d00 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 >> v1:172.21.15.62:6789/0 conn(0x7fd0600d0d00 legacy=0x7fd0600cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd048003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0480047c0 0x7fd048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd048005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600cfcf0 con 0x7fd048003970 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600cf450 con 0x7fd0480047c0 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04800b9b0 con 0x7fd06015cbe0 2023-09-30T13:57:02.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd048003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05f7fe640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0480047c0 0x7fd048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd064d05640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd048005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 -- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 msgr2=0x7fd048005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd06015cbe0 0x7fd048005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 -- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0480047c0 msgr2=0x7fd048004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0480047c0 0x7fd048004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.414+0000 7fd05ffff640 1 -- 172.21.15.62:0/2371433429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048003520 con 0x7fd048003970 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.415+0000 7fd05ffff640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd048003d90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ab0 tx=0x7fd0480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622191ea8b60da30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.415+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050005990 con 0x7fd048003970 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.415+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050005af0 con 0x7fd048003970 2023-09-30T13:57:02.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.415+0000 7fd05effd640 1 -- 172.21.15.62:0/2371433429 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050005ea0 con 0x7fd048003970 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 -- 172.21.15.62:0/2371433429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 msgr2=0x7fd048003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 --2- 172.21.15.62:0/2371433429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd048003d90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ab0 tx=0x7fd0480057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd064d05640 1 -- 172.21.15.62:0/2371433429 reap_dead start 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 -- 172.21.15.62:0/2371433429 shutdown_connections 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 -- 172.21.15.62:0/2371433429 >> 172.21.15.62:0/2371433429 conn(0x7fd060089fe0 msgr2=0x7fd0600d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 -- 172.21.15.62:0/2371433429 shutdown_connections 2023-09-30T13:57:02.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.416+0000 7fd066768640 1 -- 172.21.15.62:0/2371433429 wait complete. 2023-09-30T13:57:02.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.417+0000 7fd066768640 1 Processor -- start 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.417+0000 7fd066768640 1 -- start start 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b7970 0x7fd0600b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600b3710 0x7fd060150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b2740 con 0x7fd048003970 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b2950 con 0x7fd0600b3710 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd066768640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b2c30 con 0x7fd0600b7970 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51092/0 (socket says 172.21.15.62:51092) 2023-09-30T13:57:02.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 -- 172.21.15.62:0/3591466283 learned_addr learned my addr 172.21.15.62:0/3591466283 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd064d05640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600b3710 0x7fd060150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05f7fe640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b7970 0x7fd0600b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 -- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b7970 msgr2=0x7fd0600b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b7970 0x7fd0600b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 -- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600b3710 msgr2=0x7fd060150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600b3710 0x7fd060150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.418+0000 7fd05ffff640 1 -- 172.21.15.62:0/3591466283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600b2f10 con 0x7fd048003970 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd05ffff640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd050036040 tx=0x7fd050004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050005e70 con 0x7fd048003970 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050004020 con 0x7fd048003970 2023-09-30T13:57:02.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600b31f0 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500043d0 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.419+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600b5bd0 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.420+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06004e0d0 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.420+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd050003610 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.421+0000 7fd05cff9640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 0x7fd04c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.421+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd0500ab4f0 con 0x7fd048003970 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.421+0000 7fd05f7fe640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 0x7fd04c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.421+0000 7fd05f7fe640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 0x7fd04c06cff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b7db0 tx=0x7fd054007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.425+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd050076690 con 0x7fd048003970 2023-09-30T13:57:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.602+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0600b02c0 con 0x7fd048003970 2023-09-30T13:57:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.603+0000 7fd05cff9640 1 -- 172.21.15.62:0/3591466283 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fd050079cb0 con 0x7fd048003970 2023-09-30T13:57:02.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:02.603 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:32.493691+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 msgr2=0x7fd04c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 0x7fd04c06cff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b7db0 tx=0x7fd054007040 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 msgr2=0x7fd0600b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd050036040 tx=0x7fd050004730 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 shutdown_connections 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd04c06ab30 0x7fd04c06cff0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0600b3710 0x7fd060150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd0600b7970 0x7fd0600b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 --2- 172.21.15.62:0/3591466283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd048003970 0x7fd0600b4570 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 >> 172.21.15.62:0/3591466283 conn(0x7fd060089fe0 msgr2=0x7fd0600b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 shutdown_connections 2023-09-30T13:57:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.605+0000 7fd066768640 1 -- 172.21.15.62:0/3591466283 wait complete. 2023-09-30T13:57:02.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:56:03.919978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:56:04.353687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:02.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.725+0000 7f962b2a2640 1 Processor -- start 2023-09-30T13:57:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 -- start start 2023-09-30T13:57:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f96240b8760 0x7f96240d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 0x7f96240cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240d1410 con 0x7f962415cbc0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96240ce290 con 0x7f96240b8760 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.726+0000 7f962b2a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240d16f0 con 0x7f96240cd8c0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962983f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 0x7f96240cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962903e640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f962415cbc0 0x7f96240d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:46302/0 (socket says 172.21.15.62:46302) 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962903e640 1 -- 172.21.15.62:0/602681126 learned_addr learned my addr 172.21.15.62:0/602681126 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962883d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f96240b8760 0x7f96240d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f9623fff640 1 -- 172.21.15.62:0/602681126 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758976938 0 0) 0x7f96240d1410 con 0x7f962415cbc0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f9623fff640 1 -- 172.21.15.62:0/602681126 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c003520 con 0x7f962415cbc0 2023-09-30T13:57:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962883d640 1 -- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 msgr2=0x7f96240cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962883d640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 0x7f96240cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962883d640 1 -- 172.21.15.62:0/602681126 >> v1:172.21.15.135:6789/0 conn(0x7f962415cbc0 legacy=0x7f96240d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962883d640 1 -- 172.21.15.62:0/602681126 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240d19d0 con 0x7f96240b8760 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.727+0000 7f962983f640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 0x7f96240cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.728+0000 7f962883d640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240b8760 0x7f96240d24b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96180097a0 tx=0x7f961802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df38ca2795e05d06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.728+0000 7f9623fff640 1 -- 172.21.15.62:0/602681126 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618031830 con 0x7f96240b8760 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.728+0000 7f9623fff640 1 -- 172.21.15.62:0/602681126 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618031990 con 0x7f96240b8760 2023-09-30T13:57:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.728+0000 7f9623fff640 1 -- 172.21.15.62:0/602681126 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618031d00 con 0x7f96240b8760 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 -- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240b8760 msgr2=0x7f96240d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240b8760 0x7f96240d24b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96180097a0 tx=0x7f961802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 -- 172.21.15.62:0/602681126 shutdown_connections 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96240cd8c0 0x7f96240cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 --2- 172.21.15.62:0/602681126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240b8760 0x7f96240d24b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 -- 172.21.15.62:0/602681126 >> 172.21.15.62:0/602681126 conn(0x7f96240718a0 msgr2=0x7f9624071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 -- 172.21.15.62:0/602681126 shutdown_connections 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.729+0000 7f962b2a2640 1 -- 172.21.15.62:0/602681126 wait complete. 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.730+0000 7f962b2a2640 1 Processor -- start 2023-09-30T13:57:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.730+0000 7f962b2a2640 1 -- start start 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240cd8c0 0x7f9624157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f962415cbc0 0x7f9624158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b2520 con 0x7f96240b8760 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624155e00 con 0x7f96240cd8c0 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962b2a2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b27c0 con 0x7f962415cbc0 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51096/0 (socket says 172.21.15.62:51096) 2023-09-30T13:57:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 -- 172.21.15.62:0/1747237606 learned_addr learned my addr 172.21.15.62:0/1747237606 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962883d640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240cd8c0 0x7f9624157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962983f640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f962415cbc0 0x7f9624158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 -- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f962415cbc0 msgr2=0x7f9624158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f962415cbc0 0x7f9624158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 -- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240cd8c0 msgr2=0x7f9624157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240cd8c0 0x7f9624157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 -- 172.21.15.62:0/1747237606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009a70 con 0x7f96240b8760 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f962903e640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f961c00c390 tx=0x7f961c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c005ce0 con 0x7f96240b8760 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c005e40 con 0x7f96240b8760 2023-09-30T13:57:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.731+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0072f0 con 0x7f96240b8760 2023-09-30T13:57:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.732+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9618009400 con 0x7f96240b8760 2023-09-30T13:57:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.732+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240b2d80 con 0x7f96240b8760 2023-09-30T13:57:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.733+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962404e0d0 con 0x7f96240b8760 2023-09-30T13:57:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.733+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f961c007450 con 0x7f96240b8760 2023-09-30T13:57:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.733+0000 7f9621ffb640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 0x7f961006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.733+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f961c088800 con 0x7f96240b8760 2023-09-30T13:57:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.734+0000 7f962883d640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 0x7f961006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.734+0000 7f962883d640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 0x7f961006cff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9618036000 tx=0x7f961803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.738+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f961c0539a0 con 0x7f96240b8760 2023-09-30T13:57:02.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.910+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f962406a070 con 0x7f96240b8760 2023-09-30T13:57:02.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.911+0000 7f9621ffb640 1 -- 172.21.15.62:0/1747237606 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f961c017020 con 0x7f96240b8760 2023-09-30T13:57:02.911 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:02.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 msgr2=0x7f961006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 0x7f961006cff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9618036000 tx=0x7f961803c040 comp rx=0 tx=0).stop 2023-09-30T13:57:02.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 msgr2=0x7f96241558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:02.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f961c00c390 tx=0x7f961c00c790 comp rx=0 tx=0).stop 2023-09-30T13:57:02.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 shutdown_connections 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f961006ab30 0x7f961006cff0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f962415cbc0 0x7f9624158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96240cd8c0 0x7f9624157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 --2- 172.21.15.62:0/1747237606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96240b8760 0x7f96241558c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 >> 172.21.15.62:0/1747237606 conn(0x7f96240718a0 msgr2=0x7f9624071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 shutdown_connections 2023-09-30T13:57:02.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:02.913+0000 7f962b2a2640 1 -- 172.21.15.62:0/1747237606 wait complete. 2023-09-30T13:57:02.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:57:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.033+0000 7fbc057f5640 1 Processor -- start 2023-09-30T13:57:03.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.033+0000 7fbc057f5640 1 -- start start 2023-09-30T13:57:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbc057f5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc0015c950 0x7fbc000d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbc057f5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbc0015cd30 0x7fbc000cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbc057f5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc000cdfa0 con 0x7fbc000cf960 2023-09-30T13:57:03.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbc057f5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000b5c30 con 0x7fbc0015c950 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbc057f5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000d2fe0 con 0x7fbc0015cd30 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbbfeffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc0015c950 0x7fbc000d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbbff7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbc000cf960 0x7fbc000cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46368/0 (socket says 172.21.15.62:46368) 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.034+0000 7fbbff7fe640 1 -- 172.21.15.62:0/526755594 learned_addr learned my addr 172.21.15.62:0/526755594 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfe7fc640 1 --2- 172.21.15.62:0/526755594 >> v2:172.21.15.135:3300/0 conn(0x7fbc0015cd30 0x7fbc000cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfeffd640 1 -- 172.21.15.62:0/526755594 >> v2:172.21.15.135:3300/0 conn(0x7fbc0015cd30 msgr2=0x7fbc000cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfeffd640 1 --2- 172.21.15.62:0/526755594 >> v2:172.21.15.135:3300/0 conn(0x7fbc0015cd30 0x7fbc000cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfeffd640 1 -- 172.21.15.62:0/526755594 >> v1:172.21.15.62:6789/0 conn(0x7fbc000cf960 legacy=0x7fbc000cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfeffd640 1 -- 172.21.15.62:0/526755594 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000d32c0 con 0x7fbc0015c950 2023-09-30T13:57:03.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfdffb640 1 -- 172.21.15.62:0/526755594 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914432464 0 0) 0x7fbc000cdfa0 con 0x7fbc000cf960 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.035+0000 7fbbfeffd640 1 --2- 172.21.15.62:0/526755594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc0015c950 0x7fbc000d2970 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbc000b56b0 tx=0x7fbbf802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dad1819275f6a8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbbfdffb640 1 -- 172.21.15.62:0/526755594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf802e070 con 0x7fbc0015c950 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbbfdffb640 1 -- 172.21.15.62:0/526755594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf80315a0 con 0x7fbc0015c950 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbbfdffb640 1 -- 172.21.15.62:0/526755594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8031930 con 0x7fbc0015c950 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 -- 172.21.15.62:0/526755594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc0015c950 msgr2=0x7fbc000d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 --2- 172.21.15.62:0/526755594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc0015c950 0x7fbc000d2970 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbc000b56b0 tx=0x7fbbf802b840 comp rx=0 tx=0).stop 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 -- 172.21.15.62:0/526755594 shutdown_connections 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 --2- 172.21.15.62:0/526755594 >> v2:172.21.15.135:3300/0 conn(0x7fbc0015cd30 0x7fbc000cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 --2- 172.21.15.62:0/526755594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc0015c950 0x7fbc000d2970 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 -- 172.21.15.62:0/526755594 >> 172.21.15.62:0/526755594 conn(0x7fbc00071660 msgr2=0x7fbc00071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 -- 172.21.15.62:0/526755594 shutdown_connections 2023-09-30T13:57:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.036+0000 7fbc057f5640 1 -- 172.21.15.62:0/526755594 wait complete. 2023-09-30T13:57:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.037+0000 7fbc057f5640 1 Processor -- start 2023-09-30T13:57:03.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.037+0000 7fbc057f5640 1 -- start start 2023-09-30T13:57:03.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 0x7fbc00156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc0015cd30 0x7fbc0015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00157570 con 0x7fbc000cf960 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00156960 con 0x7fbc0015c950 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbc057f5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00156c40 con 0x7fbc0015cd30 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbbfeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbbfeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51106/0 (socket says 172.21.15.62:51106) 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbbfeffd640 1 -- 172.21.15.62:0/1597580953 learned_addr learned my addr 172.21.15.62:0/1597580953 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbbff7fe640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc0015cd30 0x7fbc0015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.038+0000 7fbbfe7fc640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 0x7fbc00156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 -- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc0015cd30 msgr2=0x7fbc0015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc0015cd30 0x7fbc0015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 -- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 msgr2=0x7fbc00156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 0x7fbc00156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 -- 172.21.15.62:0/1597580953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009400 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfe7fc640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 0x7fbc00156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbfeffd640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8034040 tx=0x7fbbf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8004230 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8031f00 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc00156f20 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8032640 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.039+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00156550 con 0x7fbc000cf960 2023-09-30T13:57:03.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.040+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc00156710 con 0x7fbc000cf960 2023-09-30T13:57:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.041+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbbf80327a0 con 0x7fbc000cf960 2023-09-30T13:57:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.041+0000 7fbbf77fe640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 0x7fbbe006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.041+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbbf80ab270 con 0x7fbc000cf960 2023-09-30T13:57:03.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.041+0000 7fbbfe7fc640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 0x7fbbe006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.042+0000 7fbbfe7fc640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 0x7fbbe006d020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006fd0 tx=0x7fbbe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.045+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbbf80763f0 con 0x7fbc000cf960 2023-09-30T13:57:03.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.219+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc00073e70 con 0x7fbc000cf960 2023-09-30T13:57:03.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.220+0000 7fbbf77fe640 1 -- 172.21.15.62:0/1597580953 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbf8079a10 con 0x7fbc000cf960 2023-09-30T13:57:03.219 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:57:03.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 msgr2=0x7fbbe006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 0x7fbbe006d020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006fd0 tx=0x7fbbe8008040 comp rx=0 tx=0).stop 2023-09-30T13:57:03.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 msgr2=0x7fbc00147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8034040 tx=0x7fbbf80046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 shutdown_connections 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbbe006ab60 0x7fbbe006d020 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc0015cd30 0x7fbc0015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc0015c950 0x7fbc00156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 --2- 172.21.15.62:0/1597580953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc000cf960 0x7fbc00147f80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 >> 172.21.15.62:0/1597580953 conn(0x7fbc00071660 msgr2=0x7fbc0015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 shutdown_connections 2023-09-30T13:57:03.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.221+0000 7fbc057f5640 1 -- 172.21.15.62:0/1597580953 wait complete. 2023-09-30T13:57:03.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:57:03.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.341+0000 7f835a4c9640 1 Processor -- start 2023-09-30T13:57:03.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.341+0000 7f835a4c9640 1 -- start start 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f835a4c9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f835415ce90 0x7f835406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f835a4c9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83540ce3f0 con 0x7f835406f440 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f835a4c9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835406a120 con 0x7f835406b420 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f835a4c9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835406a400 con 0x7f835415ce90 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f835415ce90 0x7f835406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f835415ce90 0x7f835406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51114/0 (socket says 172.21.15.62:51114) 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 -- 172.21.15.62:0/27086223 learned_addr learned my addr 172.21.15.62:0/27086223 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 -- 172.21.15.62:0/27086223 >> v1:172.21.15.135:6789/0 conn(0x7f835406b420 legacy=0x7f835406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 -- 172.21.15.62:0/27086223 >> v1:172.21.15.62:6789/0 conn(0x7f835406f440 legacy=0x7f83540ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8353fff640 1 -- 172.21.15.62:0/27086223 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835406a6e0 con 0x7f835415ce90 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.342+0000 7f8352ffd640 1 -- 172.21.15.62:0/27086223 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999721902 0 0) 0x7f83540ce3f0 con 0x7f835406f440 2023-09-30T13:57:03.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f8353fff640 1 --2- 172.21.15.62:0/27086223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415ce90 0x7f835406aee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8344009870 tx=0x7f834402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa011576d24febfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f8352ffd640 1 -- 172.21.15.62:0/27086223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834402f840 con 0x7f835415ce90 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f8352ffd640 1 -- 172.21.15.62:0/27086223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834402f9a0 con 0x7f835415ce90 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f8352ffd640 1 -- 172.21.15.62:0/27086223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834402fd30 con 0x7f835415ce90 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f835a4c9640 1 -- 172.21.15.62:0/27086223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415ce90 msgr2=0x7f835406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f835a4c9640 1 --2- 172.21.15.62:0/27086223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415ce90 0x7f835406aee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8344009870 tx=0x7f834402ba20 comp rx=0 tx=0).stop 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f835a4c9640 1 -- 172.21.15.62:0/27086223 shutdown_connections 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.343+0000 7f835a4c9640 1 --2- 172.21.15.62:0/27086223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415ce90 0x7f835406aee0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.344+0000 7f835a4c9640 1 -- 172.21.15.62:0/27086223 >> 172.21.15.62:0/27086223 conn(0x7f83540cc180 msgr2=0x7f83540cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.344+0000 7f835a4c9640 1 -- 172.21.15.62:0/27086223 shutdown_connections 2023-09-30T13:57:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.344+0000 7f835a4c9640 1 -- 172.21.15.62:0/27086223 wait complete. 2023-09-30T13:57:03.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.345+0000 7f835a4c9640 1 Processor -- start 2023-09-30T13:57:03.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.345+0000 7f835a4c9640 1 -- start start 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f835406f440 0x7f835415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 0x7f8354158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83541603e0 con 0x7f835415de00 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835415f710 con 0x7f835415ce90 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835415e300 con 0x7f835406f440 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51118/0 (socket says 172.21.15.62:51118) 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 -- 172.21.15.62:0/1076654248 learned_addr learned my addr 172.21.15.62:0/1076654248 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8353fff640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f835406f440 0x7f835415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f83537fe640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 0x7f8354158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 -- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f835406f440 msgr2=0x7f835415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f835406f440 0x7f835415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 -- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 msgr2=0x7f8354158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 0x7f8354158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 -- 172.21.15.62:0/1076654248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440094d0 con 0x7f835415de00 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f83537fe640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 0x7f8354158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:03.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8358a66640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c760 tx=0x7f834c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c003da0 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00ce70 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835415e5e0 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c005290 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.346+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835415eba0 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.347+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835404e0d0 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.348+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f834c0053f0 con 0x7f835415de00 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.348+0000 7f8350ff9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 0x7f834006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.348+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f834c089050 con 0x7f835415de00 2023-09-30T13:57:03.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.349+0000 7f8353fff640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 0x7f834006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.349+0000 7f8353fff640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 0x7f834006d020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8344036000 tx=0x7f8344008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.353+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f834c0541d0 con 0x7f835415de00 2023-09-30T13:57:03.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.527+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8354069f00 con 0x7f835415de00 2023-09-30T13:57:03.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.528+0000 7f8350ff9640 1 -- 172.21.15.62:0/1076654248 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f834c0577f0 con 0x7f835415de00 2023-09-30T13:57:03.527 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:57:03.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 msgr2=0x7f834006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 0x7f834006d020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8344036000 tx=0x7f8344008030 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 msgr2=0x7f83541f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c760 tx=0x7f834c00cc20 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 shutdown_connections 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f834006ab60 0x7f834006d020 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f835415de00 0x7f83541f5c70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835415ce90 0x7f8354158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 --2- 172.21.15.62:0/1076654248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f835406f440 0x7f835415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.529+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 >> 172.21.15.62:0/1076654248 conn(0x7f83540cc180 msgr2=0x7f8354161210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.530+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 shutdown_connections 2023-09-30T13:57:03.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.530+0000 7f835a4c9640 1 -- 172.21.15.62:0/1076654248 wait complete. 2023-09-30T13:57:03.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:57:03.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.647+0000 7f903e9fb640 1 Processor -- start 2023-09-30T13:57:03.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.647+0000 7f903e9fb640 1 -- start start 2023-09-30T13:57:03.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903e9fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f9038065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903e9fb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90380ce700 0x7f9038069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903e9fb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380cafe0 con 0x7f903806d570 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903e9fb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903806d150 con 0x7f90380ce700 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903e9fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cb510 con 0x7f90380cac00 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90380ce700 0x7f9038069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90380ce700 0x7f9038069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51120/0 (socket says 172.21.15.62:51120) 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 -- 172.21.15.62:0/3408413280 learned_addr learned my addr 172.21.15.62:0/3408413280 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 -- 172.21.15.62:0/3408413280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 msgr2=0x7f9038065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 --2- 172.21.15.62:0/3408413280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f9038065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 -- 172.21.15.62:0/3408413280 >> v1:172.21.15.135:6789/0 conn(0x7f903806d570 legacy=0x7f90380cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:03.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.648+0000 7f903cf98640 1 -- 172.21.15.62:0/3408413280 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903806cb20 con 0x7f90380ce700 2023-09-30T13:57:03.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.649+0000 7f903cf98640 1 --2- 172.21.15.62:0/3408413280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038069d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9030009e50 tx=0x7f903002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb08a1311afe0bea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.649+0000 7f9036ffd640 1 -- 172.21.15.62:0/3408413280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903002c950 con 0x7f90380ce700 2023-09-30T13:57:03.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.649+0000 7f9036ffd640 1 -- 172.21.15.62:0/3408413280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903002cab0 con 0x7f90380ce700 2023-09-30T13:57:03.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.649+0000 7f9036ffd640 1 -- 172.21.15.62:0/3408413280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903002ce40 con 0x7f90380ce700 2023-09-30T13:57:03.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 -- 172.21.15.62:0/3408413280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 msgr2=0x7f9038069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 --2- 172.21.15.62:0/3408413280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038069d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9030009e50 tx=0x7f903002bdb0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 -- 172.21.15.62:0/3408413280 shutdown_connections 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 --2- 172.21.15.62:0/3408413280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038069d50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 --2- 172.21.15.62:0/3408413280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f9038065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 -- 172.21.15.62:0/3408413280 >> 172.21.15.62:0/3408413280 conn(0x7f90380b0850 msgr2=0x7f90380b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 -- 172.21.15.62:0/3408413280 shutdown_connections 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.650+0000 7f903e9fb640 1 -- 172.21.15.62:0/3408413280 wait complete. 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.651+0000 7f903e9fb640 1 Processor -- start 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.651+0000 7f903e9fb640 1 -- start start 2023-09-30T13:57:03.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903806d570 0x7f90380c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f903814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038151350 con 0x7f90380ce700 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038150430 con 0x7f903806d570 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903e9fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90381506d0 con 0x7f90380cac00 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51136/0 (socket says 172.21.15.62:51136) 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 -- 172.21.15.62:0/685031715 learned_addr learned my addr 172.21.15.62:0/685031715 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f9037fff640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903806d570 0x7f90380c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f90377fe640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f903814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 -- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 msgr2=0x7f903814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f903814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 -- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903806d570 msgr2=0x7f90380c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903806d570 0x7f90380c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.652+0000 7f903cf98640 1 -- 172.21.15.62:0/685031715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009b30 con 0x7f90380ce700 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f903cf98640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9030036040 tx=0x7f9030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903003e450 con 0x7f90380ce700 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903003e5d0 con 0x7f90380ce700 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90381509b0 con 0x7f90380ce700 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903003e980 con 0x7f90380ce700 2023-09-30T13:57:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.653+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9038150f70 con 0x7f90380ce700 2023-09-30T13:57:03.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.654+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9038151490 con 0x7f90380ce700 2023-09-30T13:57:03.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.654+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f903003eae0 con 0x7f90380ce700 2023-09-30T13:57:03.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.654+0000 7f9034ff9640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 0x7f902406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:03.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.655+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90300abff0 con 0x7f90380ce700 2023-09-30T13:57:03.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.655+0000 7f9037fff640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 0x7f902406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:03.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.655+0000 7f9037fff640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 0x7f902406cff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f902c0098e0 tx=0x7f902c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:03.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.659+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9038151490 con 0x7f90380ce700 2023-09-30T13:57:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.846+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90380cafe0 con 0x7f90380ce700 2023-09-30T13:57:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.846+0000 7f9034ff9640 1 -- 172.21.15.62:0/685031715 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90380cafe0 con 0x7f90380ce700 2023-09-30T13:57:03.846 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 msgr2=0x7f902406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 0x7f902406cff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f902c0098e0 tx=0x7f902c009060 comp rx=0 tx=0).stop 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 msgr2=0x7f9038151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9030036040 tx=0x7f9030004a40 comp rx=0 tx=0).stop 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 shutdown_connections 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f902406ab30 0x7f902406cff0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90380ce700 0x7f9038151770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90380cac00 0x7f903814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 --2- 172.21.15.62:0/685031715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903806d570 0x7f90380c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 >> 172.21.15.62:0/685031715 conn(0x7f90380b0850 msgr2=0x7f903809f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 shutdown_connections 2023-09-30T13:57:03.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:03.848+0000 7f903e9fb640 1 -- 172.21.15.62:0/685031715 wait complete. 2023-09-30T13:57:03.858 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2023-09-30T13:57:03.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:03.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:03.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[94749]: fuse finished with error 0 and tester_r 0 2023-09-30T13:57:03.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:57:03.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:03.891 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T13:57:03.990 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:03.990 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:04.006 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:57:04.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:57:04.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:04.006 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-30T13:57:04.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:57:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-30T13:57:04.062 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:57:04.062 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:04.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:57:04.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:57:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:04.080 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-30T13:57:04.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:57:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-30T13:57:04.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:04.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.243+0000 7fd138056640 1 Processor -- start 2023-09-30T13:57:04.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.243+0000 7fd138056640 1 -- start start 2023-09-30T13:57:04.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd138056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd1300b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd138056640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13006ddf0 con 0x7fd1300caea0 2023-09-30T13:57:04.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd138056640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300cdf30 con 0x7fd130158c20 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd138056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b1ea0 con 0x7fd1300cc210 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd1365f3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd1300caea0 0x7fd13006be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46390/0 (socket says 172.21.15.62:46390) 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd1365f3640 1 -- 172.21.15.62:0/4195940403 learned_addr learned my addr 172.21.15.62:0/4195940403 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766674701 0 0) 0x7fd13006ddf0 con 0x7fd1300caea0 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd1355f1640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd1300b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.244+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd11c003440 con 0x7fd1300caea0 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294850668 0 0) 0x7fd11c003440 con 0x7fd1300caea0 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 msgr2=0x7fd1300b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:04.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd1300b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 >> v1:172.21.15.135:6789/0 conn(0x7fd130158c20 legacy=0x7fd130159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300ce210 con 0x7fd1300caea0 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd128001a10 con 0x7fd1300caea0 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 >> v1:172.21.15.62:6789/0 conn(0x7fd1300caea0 legacy=0x7fd13006be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11c003a90 0x7fd11c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c008850 0x7fd11c00ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd11c00d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b1ea0 con 0x7fd11c003a90 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c00dc40 con 0x7fd11c008850 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c00de00 con 0x7fd1300cc210 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11c003a90 0x7fd11c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd1355f1640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c008850 0x7fd11c00ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd1365f3640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd11c00d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 -- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 msgr2=0x7fd11c00d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300cc210 0x7fd11c00d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 -- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c008850 msgr2=0x7fd11c00ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c008850 0x7fd11c00ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.245+0000 7fd135df2640 1 -- 172.21.15.62:0/4195940403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c003440 con 0x7fd11c003a90 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd135df2640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11c003a90 0x7fd11c003eb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001770 tx=0x7fd11c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3143095e8b2cc6a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0052d0 con 0x7fd11c003a90 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c02e050 con 0x7fd11c003a90 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd134df0640 1 -- 172.21.15.62:0/4195940403 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c003640 con 0x7fd11c003a90 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd138056640 1 -- 172.21.15.62:0/4195940403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11c003a90 msgr2=0x7fd11c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd138056640 1 --2- 172.21.15.62:0/4195940403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11c003a90 0x7fd11c003eb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd12c001770 tx=0x7fd11c0036f0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.246+0000 7fd1365f3640 1 -- 172.21.15.62:0/4195940403 reap_dead start 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.247+0000 7fd138056640 1 -- 172.21.15.62:0/4195940403 shutdown_connections 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.247+0000 7fd138056640 1 -- 172.21.15.62:0/4195940403 >> 172.21.15.62:0/4195940403 conn(0x7fd13006a170 msgr2=0x7fd13006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:04.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.247+0000 7fd138056640 1 -- 172.21.15.62:0/4195940403 shutdown_connections 2023-09-30T13:57:04.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.247+0000 7fd138056640 1 -- 172.21.15.62:0/4195940403 wait complete. 2023-09-30T13:57:04.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 Processor -- start 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 -- start start 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 0x7fd130158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 0x7fd1301e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130159000 con 0x7fd13015a2f0 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301589b0 con 0x7fd11c003a90 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.248+0000 7fd138056640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130159250 con 0x7fd13015a770 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51152/0 (socket says 172.21.15.62:51152) 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 -- 172.21.15.62:0/3931474140 learned_addr learned my addr 172.21.15.62:0/3931474140 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1365f3640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 0x7fd1301e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd135df2640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 0x7fd130158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 -- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 msgr2=0x7fd1301e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 0x7fd1301e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 -- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 msgr2=0x7fd130158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 0x7fd130158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 -- 172.21.15.62:0/3931474140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130159530 con 0x7fd13015a2f0 2023-09-30T13:57:04.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1365f3640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 0x7fd1301e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:04.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd135df2640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 0x7fd130158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:04.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1355f1640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd120011600 tx=0x7fd120011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000f920 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000fa80 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000fdf0 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd130159810 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.249+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd130159dd0 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.250+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13004e0d0 con 0x7fd13015a2f0 2023-09-30T13:57:04.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.251+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd120015460 con 0x7fd13015a2f0 2023-09-30T13:57:04.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.251+0000 7fd1267fc640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 0x7fd11406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.251+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd120089820 con 0x7fd13015a2f0 2023-09-30T13:57:04.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.252+0000 7fd135df2640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 0x7fd11406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.252+0000 7fd135df2640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 0x7fd11406cff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd12c033000 tx=0x7fd12c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.256+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd120054890 con 0x7fd13015a2f0 2023-09-30T13:57:04.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.466+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd13006b080 con 0x7fd13015a2f0 2023-09-30T13:57:04.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.466+0000 7fd1267fc640 1 -- 172.21.15.62:0/3931474140 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fd120057eb0 con 0x7fd13015a2f0 2023-09-30T13:57:04.466 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:04.466 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:57:04.467 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 msgr2=0x7fd11406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 0x7fd11406cff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd12c033000 tx=0x7fd12c009030 comp rx=0 tx=0).stop 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 msgr2=0x7fd1301e23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd120011600 tx=0x7fd120011ac0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 shutdown_connections 2023-09-30T13:57:04.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd11406ab30 0x7fd11406cff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd13015a770 0x7fd1301e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd13015a2f0 0x7fd1301e23c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 --2- 172.21.15.62:0/3931474140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c003a90 0x7fd130158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 >> 172.21.15.62:0/3931474140 conn(0x7fd13006a170 msgr2=0x7fd130071600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 shutdown_connections 2023-09-30T13:57:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.468+0000 7fd138056640 1 -- 172.21.15.62:0/3931474140 wait complete. 2023-09-30T13:57:04.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.585+0000 7fe6e97c9640 1 Processor -- start 2023-09-30T13:57:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.585+0000 7fe6e97c9640 1 -- start start 2023-09-30T13:57:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e97c9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6e415cbe0 0x7fe6e40d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e97c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e406c660 0x7fe6e40d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e97c9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40d16a0 con 0x7fe6e40d0d00 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e97c9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40cfcf0 con 0x7fe6e415cbe0 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e97c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40cf450 con 0x7fe6e406c660 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e2ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6e415cbe0 0x7fe6e40d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6dbfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe6e40d0d00 0x7fe6e40cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46400/0 (socket says 172.21.15.62:46400) 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6dbfff640 1 -- 172.21.15.62:0/515492136 learned_addr learned my addr 172.21.15.62:0/515492136 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e37fe640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e406c660 0x7fe6e40d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/515492136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e406c660 msgr2=0x7fe6e40d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.586+0000 7fe6e2ffd640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e406c660 0x7fe6e40d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/515492136 >> v1:172.21.15.62:6789/0 conn(0x7fe6e40d0d00 legacy=0x7fe6e40cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e27fc640 1 -- 172.21.15.62:0/515492136 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566942529 0 0) 0x7fe6e40d16a0 con 0x7fe6e40d0d00 2023-09-30T13:57:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/515492136 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40cf730 con 0x7fe6e415cbe0 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e2ffd640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e415cbe0 0x7fe6e40d06b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009790 tx=0x7fe6d402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34450f2872ee6cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e27fc640 1 -- 172.21.15.62:0/515492136 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4031890 con 0x7fe6e415cbe0 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e27fc640 1 -- 172.21.15.62:0/515492136 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40319f0 con 0x7fe6e415cbe0 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.587+0000 7fe6e27fc640 1 -- 172.21.15.62:0/515492136 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4031d80 con 0x7fe6e415cbe0 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 -- 172.21.15.62:0/515492136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e415cbe0 msgr2=0x7fe6e40d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e415cbe0 0x7fe6e40d06b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009790 tx=0x7fe6d402b930 comp rx=0 tx=0).stop 2023-09-30T13:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 -- 172.21.15.62:0/515492136 shutdown_connections 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e406c660 0x7fe6e40d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/515492136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e415cbe0 0x7fe6e40d06b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 -- 172.21.15.62:0/515492136 >> 172.21.15.62:0/515492136 conn(0x7fe6e4089fe0 msgr2=0x7fe6e40d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 -- 172.21.15.62:0/515492136 shutdown_connections 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.588+0000 7fe6e97c9640 1 -- 172.21.15.62:0/515492136 wait complete. 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.589+0000 7fe6e97c9640 1 Processor -- start 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.589+0000 7fe6e97c9640 1 -- start start 2023-09-30T13:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 0x7fe6e40b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 0x7fe6e40d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41f5600 con 0x7fe6e406c660 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b8200 con 0x7fe6e40d0d00 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e97c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b2110 con 0x7fe6e415cbe0 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51168/0 (socket says 172.21.15.62:51168) 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/4246979532 learned_addr learned my addr 172.21.15.62:0/4246979532 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6dbfff640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 0x7fe6e40b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e37fe640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 0x7fe6e40d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 msgr2=0x7fe6e40d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 0x7fe6e40d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 msgr2=0x7fe6e40b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 0x7fe6e40b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e2ffd640 1 -- 172.21.15.62:0/4246979532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40093a0 con 0x7fe6e406c660 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6e37fe640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 0x7fe6e40d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.590+0000 7fe6dbfff640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 0x7fe6e40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6e2ffd640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4034040 tx=0x7fe6d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4005e60 con 0x7fe6e406c660 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d403a920 con 0x7fe6e406c660 2023-09-30T13:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d403acd0 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e41596f0 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.591+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e4159cb0 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.592+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e404e0d0 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.592+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe6d4006030 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.593+0000 7fe6db7fe640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 0x7fe6c406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.593+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6d40abcd0 con 0x7fe6e406c660 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.593+0000 7fe6dbfff640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 0x7fe6c406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.593+0000 7fe6dbfff640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 0x7fe6c406cff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40d32f0 tx=0x7fe6cc007c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.597+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe6d4076dc0 con 0x7fe6e406c660 2023-09-30T13:57:04.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.774+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6e40b1a30 con 0x7fe6e406c660 2023-09-30T13:57:04.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.775+0000 7fe6db7fe640 1 -- 172.21.15.62:0/4246979532 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fe6d4035070 con 0x7fe6e406c660 2023-09-30T13:57:04.775 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:04.775 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:32.493691+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 msgr2=0x7fe6c406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 0x7fe6c406cff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40d32f0 tx=0x7fe6cc007c30 comp rx=0 tx=0).stop 2023-09-30T13:57:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 msgr2=0x7fe6e4158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4034040 tx=0x7fe6d40046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 shutdown_connections 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe6c406ab30 0x7fe6c406cff0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6e415cbe0 0x7fe6e40d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e40d0d00 0x7fe6e40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 --2- 172.21.15.62:0/4246979532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6e406c660 0x7fe6e4158750 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 >> 172.21.15.62:0/4246979532 conn(0x7fe6e4089fe0 msgr2=0x7fe6e40af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 shutdown_connections 2023-09-30T13:57:04.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.777+0000 7fe6e97c9640 1 -- 172.21.15.62:0/4246979532 wait complete. 2023-09-30T13:57:04.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:56:03.919978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:56:04.353687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:04.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:04.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.897+0000 7fd2da44b640 1 Processor -- start 2023-09-30T13:57:04.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.897+0000 7fd2da44b640 1 -- start start 2023-09-30T13:57:04.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.898+0000 7fd2da44b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd2d41599f0 0x7fd2d40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.898+0000 7fd2da44b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d40af960 con 0x7fd2d4159610 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.898+0000 7fd2da44b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d406c390 con 0x7fd2d40b0e60 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.898+0000 7fd2da44b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d406c670 con 0x7fd2d41599f0 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd2d41599f0 0x7fd2d40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d3fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd2d4159610 0x7fd2d40af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46404/0 (socket says 172.21.15.62:46404) 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d3fff640 1 -- 172.21.15.62:0/1023711477 learned_addr learned my addr 172.21.15.62:0/1023711477 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d37fe640 1 -- 172.21.15.62:0/1023711477 >> v1:172.21.15.135:6789/0 conn(0x7fd2d40b0e60 legacy=0x7fd2d40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d37fe640 1 -- 172.21.15.62:0/1023711477 >> v1:172.21.15.62:6789/0 conn(0x7fd2d4159610 legacy=0x7fd2d40af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d37fe640 1 -- 172.21.15.62:0/1023711477 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d406c950 con 0x7fd2d41599f0 2023-09-30T13:57:04.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.899+0000 7fd2d2ffd640 1 -- 172.21.15.62:0/1023711477 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888690692 0 0) 0x7fd2d40af960 con 0x7fd2d4159610 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2d37fe640 1 --2- 172.21.15.62:0/1023711477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d41599f0 0x7fd2d40b29a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b663f34fde82b24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2d2ffd640 1 -- 172.21.15.62:0/1023711477 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c802e070 con 0x7fd2d41599f0 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2d2ffd640 1 -- 172.21.15.62:0/1023711477 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80315a0 con 0x7fd2d41599f0 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2d2ffd640 1 -- 172.21.15.62:0/1023711477 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8031930 con 0x7fd2d41599f0 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 -- 172.21.15.62:0/1023711477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d41599f0 msgr2=0x7fd2d40b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 --2- 172.21.15.62:0/1023711477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d41599f0 0x7fd2d40b29a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802b840 comp rx=0 tx=0).stop 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 -- 172.21.15.62:0/1023711477 shutdown_connections 2023-09-30T13:57:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 --2- 172.21.15.62:0/1023711477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d41599f0 0x7fd2d40b29a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 -- 172.21.15.62:0/1023711477 >> 172.21.15.62:0/1023711477 conn(0x7fd2d40cb720 msgr2=0x7fd2d40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 -- 172.21.15.62:0/1023711477 shutdown_connections 2023-09-30T13:57:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.900+0000 7fd2da44b640 1 -- 172.21.15.62:0/1023711477 wait complete. 2023-09-30T13:57:04.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 Processor -- start 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 -- start start 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 0x7fd2d4151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 0x7fd2d41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4152db0 con 0x7fd2d4159610 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d415cc90 con 0x7fd2d41599f0 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2da44b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4149ee0 con 0x7fd2d40b0e60 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.902+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51192/0 (socket says 172.21.15.62:51192) 2023-09-30T13:57:04.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 -- 172.21.15.62:0/4084788147 learned_addr learned my addr 172.21.15.62:0/4084788147 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d3fff640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 0x7fd2d4151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d89e8640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 0x7fd2d41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 -- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 msgr2=0x7fd2d4151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 0x7fd2d4151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 -- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 msgr2=0x7fd2d41499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 0x7fd2d41499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 -- 172.21.15.62:0/4084788147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009400 con 0x7fd2d4159610 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d89e8640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 0x7fd2d41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d3fff640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 0x7fd2d4151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d37fe640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8034040 tx=0x7fd2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032900 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8032a60 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d414a410 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032e10 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.903+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d4152410 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.904+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d404e0d0 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.905+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd2c804d3f0 con 0x7fd2d4159610 2023-09-30T13:57:04.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.905+0000 7fd2d0ff9640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 0x7fd2c006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.905+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2c80aaf90 con 0x7fd2d4159610 2023-09-30T13:57:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.905+0000 7fd2d3fff640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 0x7fd2c006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.906+0000 7fd2d3fff640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 0x7fd2c006cff0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000f60 tx=0x7fd2c4007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:04.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:04.909+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd2c80ddad0 con 0x7fd2d4159610 2023-09-30T13:57:05.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.086+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2d40cf170 con 0x7fd2d4159610 2023-09-30T13:57:05.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.086+0000 7fd2d0ff9640 1 -- 172.21.15.62:0/4084788147 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2c8076110 con 0x7fd2d4159610 2023-09-30T13:57:05.086 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:05.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 msgr2=0x7fd2c006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 0x7fd2c006cff0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000f60 tx=0x7fd2c4007c10 comp rx=0 tx=0).stop 2023-09-30T13:57:05.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 msgr2=0x7fd2d415c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8034040 tx=0x7fd2c80046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 shutdown_connections 2023-09-30T13:57:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd2c006ab30 0x7fd2c006cff0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2d41599f0 0x7fd2d41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d4159610 0x7fd2d415c750 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 --2- 172.21.15.62:0/4084788147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2d40b0e60 0x7fd2d4151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 >> 172.21.15.62:0/4084788147 conn(0x7fd2d40cb720 msgr2=0x7fd2d40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 shutdown_connections 2023-09-30T13:57:05.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.088+0000 7fd2da44b640 1 -- 172.21.15.62:0/4084788147 wait complete. 2023-09-30T13:57:05.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:57:05.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.207+0000 7f855a40e640 1 Processor -- start 2023-09-30T13:57:05.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.207+0000 7f855a40e640 1 -- start start 2023-09-30T13:57:05.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f855a40e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b2160 0x7f85540b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f855a40e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85540b4400 0x7f8554070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f855a40e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855415b190 con 0x7f85540b0a70 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f855a40e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855415afa0 con 0x7f85540b4400 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f855a40e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540b0ef0 con 0x7f85540b2160 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85540b4400 0x7f8554070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f85540b4400 0x7f8554070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51194/0 (socket says 172.21.15.62:51194) 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 -- 172.21.15.62:0/3844451035 learned_addr learned my addr 172.21.15.62:0/3844451035 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:05.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f8553fff640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b2160 0x7f85540b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 -- 172.21.15.62:0/3844451035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b2160 msgr2=0x7f85540b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b2160 0x7f85540b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 -- 172.21.15.62:0/3844451035 >> v1:172.21.15.135:6789/0 conn(0x7f85540b0a70 legacy=0x7f85540b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.208+0000 7f85589ab640 1 -- 172.21.15.62:0/3844451035 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855415b470 con 0x7f85540b4400 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.209+0000 7f85589ab640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f8554070160 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e106080821de2344 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.209+0000 7f8552ffd640 1 -- 172.21.15.62:0/3844451035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c02cb00 con 0x7f85540b4400 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.209+0000 7f8552ffd640 1 -- 172.21.15.62:0/3844451035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c02cc60 con 0x7f85540b4400 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.209+0000 7f8552ffd640 1 -- 172.21.15.62:0/3844451035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0343f0 con 0x7f85540b4400 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 -- 172.21.15.62:0/3844451035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 msgr2=0x7f8554070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f8554070160 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c02bf60 comp rx=0 tx=0).stop 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 -- 172.21.15.62:0/3844451035 shutdown_connections 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f8554070160 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 --2- 172.21.15.62:0/3844451035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b2160 0x7f85540b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 -- 172.21.15.62:0/3844451035 >> 172.21.15.62:0/3844451035 conn(0x7f85540cb720 msgr2=0x7f85540ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 -- 172.21.15.62:0/3844451035 shutdown_connections 2023-09-30T13:57:05.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.210+0000 7f855a40e640 1 -- 172.21.15.62:0/3844451035 wait complete. 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.211+0000 7f855a40e640 1 Processor -- start 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.211+0000 7f855a40e640 1 -- start start 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b0a70 0x7f85540afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85540b2160 0x7f85541f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540af9a0 con 0x7f85540b4400 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540aed90 con 0x7f85540b2160 2023-09-30T13:57:05.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f855a40e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540af070 con 0x7f85540b0a70 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51196/0 (socket says 172.21.15.62:51196) 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 -- 172.21.15.62:0/4025498488 learned_addr learned my addr 172.21.15.62:0/4025498488 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f8553fff640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b0a70 0x7f85540afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85537fe640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85540b2160 0x7f85541f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 -- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b0a70 msgr2=0x7f85540afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b0a70 0x7f85540afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 -- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85540b2160 msgr2=0x7f85541f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85540b2160 0x7f85541f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 -- 172.21.15.62:0/4025498488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009b30 con 0x7f85540b4400 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.212+0000 7f85589ab640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.213+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c009510 con 0x7f85540b4400 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.213+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c03e450 con 0x7f85540b4400 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.213+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540af350 con 0x7f85540b4400 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.213+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c03e800 con 0x7f85540b4400 2023-09-30T13:57:05.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.213+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541f5110 con 0x7f85540b4400 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.214+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855404e0d0 con 0x7f85540b4400 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.214+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f854c03e960 con 0x7f85540b4400 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.214+0000 7f8550ff9640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 0x7f854006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.215+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f854c0ac090 con 0x7f85540b4400 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.215+0000 7f8553fff640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 0x7f854006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.215+0000 7f8553fff640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 0x7f854006cff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8544006fd0 tx=0x7f8544008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.219+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f854c077210 con 0x7f85540b4400 2023-09-30T13:57:05.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.393+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85540b3620 con 0x7f85540b4400 2023-09-30T13:57:05.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.393+0000 7f8550ff9640 1 -- 172.21.15.62:0/4025498488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f854c07a830 con 0x7f85540b4400 2023-09-30T13:57:05.393 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 msgr2=0x7f854006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 0x7f854006cff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8544006fd0 tx=0x7f8544008040 comp rx=0 tx=0).stop 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 msgr2=0x7f85541f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c004a40 comp rx=0 tx=0).stop 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 shutdown_connections 2023-09-30T13:57:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f854006ab30 0x7f854006cff0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85540b4400 0x7f85541f5be0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85540b2160 0x7f85541f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 --2- 172.21.15.62:0/4025498488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f85540b0a70 0x7f85540afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.395+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 >> 172.21.15.62:0/4025498488 conn(0x7f85540cb720 msgr2=0x7f85540ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.396+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 shutdown_connections 2023-09-30T13:57:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.396+0000 7f855a40e640 1 -- 172.21.15.62:0/4025498488 wait complete. 2023-09-30T13:57:05.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:57:05.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.515+0000 7f6eed59e640 1 Processor -- start 2023-09-30T13:57:05.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.515+0000 7f6eed59e640 1 -- start start 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6eed59e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6ee815cbc0 0x7f6ee80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6eed59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ee80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6eed59e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee80d1410 con 0x7f6ee80b8760 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6eed59e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee80ce290 con 0x7f6ee815cbc0 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6eed59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80d16f0 con 0x7f6ee80cd8c0 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6ee67fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6ee80b8760 0x7f6ee80d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46418/0 (socket says 172.21.15.62:46418) 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.516+0000 7f6ee67fc640 1 -- 172.21.15.62:0/2797500049 learned_addr learned my addr 172.21.15.62:0/2797500049 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee77fe640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ee80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee6ffd640 1 --2- 172.21.15.62:0/2797500049 >> v2:172.21.15.135:3300/0 conn(0x7f6ee815cbc0 0x7f6ee80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638982216 0 0) 0x7f6ee80d1410 con 0x7f6ee80b8760 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed4003520 con 0x7f6ee80b8760 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385661921 0 0) 0x7f6ed4003520 con 0x7f6ee80b8760 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 msgr2=0x7f6ee80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ee80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 >> v2:172.21.15.135:3300/0 conn(0x7f6ee815cbc0 msgr2=0x7f6ee80d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 --2- 172.21.15.62:0/2797500049 >> v2:172.21.15.135:3300/0 conn(0x7f6ee815cbc0 0x7f6ee80d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee80d19d0 con 0x7f6ee80b8760 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f6ed0001670 con 0x7f6ee80b8760 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 >> v1:172.21.15.62:6789/0 conn(0x7f6ee80b8760 legacy=0x7f6ee80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed4003970 0x7f6ed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40047c0 0x7f6ed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80ce290 con 0x7f6ed40047c0 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80d16f0 con 0x7f6ed4003970 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed400b980 con 0x7f6ee80cd8c0 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40047c0 0x7f6ed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee6ffd640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed4003970 0x7f6ed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee77fe640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 -- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 msgr2=0x7f6ed4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80cd8c0 0x7f6ed4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 -- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed4003970 msgr2=0x7f6ed4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed4003970 0x7f6ed4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.517+0000 7f6ee67fc640 1 -- 172.21.15.62:0/2797500049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4003520 con 0x7f6ed40047c0 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.518+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40047c0 0x7f6ed4004c40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c240 tx=0x7f6ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2fb14c2183c63b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.518+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed002cb00 con 0x7f6ed40047c0 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.518+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed002cc60 con 0x7f6ed40047c0 2023-09-30T13:57:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.518+0000 7f6ee5ffb640 1 -- 172.21.15.62:0/2797500049 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0005af0 con 0x7f6ed40047c0 2023-09-30T13:57:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 -- 172.21.15.62:0/2797500049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40047c0 msgr2=0x7f6ed4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 --2- 172.21.15.62:0/2797500049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ed40047c0 0x7f6ed4004c40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c240 tx=0x7f6ed40057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6ee77fe640 1 -- 172.21.15.62:0/2797500049 reap_dead start 2023-09-30T13:57:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 -- 172.21.15.62:0/2797500049 shutdown_connections 2023-09-30T13:57:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 -- 172.21.15.62:0/2797500049 >> 172.21.15.62:0/2797500049 conn(0x7f6ee80718a0 msgr2=0x7f6ee8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 -- 172.21.15.62:0/2797500049 shutdown_connections 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.519+0000 7f6eed59e640 1 -- 172.21.15.62:0/2797500049 wait complete. 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.520+0000 7f6eed59e640 1 Processor -- start 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.520+0000 7f6eed59e640 1 -- start start 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed40047c0 0x7f6ee80ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80b4b30 0x7f6ee80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80b3d70 con 0x7f6ee80cb540 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80b4050 con 0x7f6ed40047c0 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6eed59e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80b4330 con 0x7f6ee80b4b30 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51210/0 (socket says 172.21.15.62:51210) 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 -- 172.21.15.62:0/3810987771 learned_addr learned my addr 172.21.15.62:0/3810987771 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee6ffd640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed40047c0 0x7f6ee80ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee77fe640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80b4b30 0x7f6ee80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 -- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80b4b30 msgr2=0x7f6ee80b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80b4b30 0x7f6ee80b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 -- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed40047c0 msgr2=0x7f6ee80ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed40047c0 0x7f6ee80ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.521+0000 7f6ee67fc640 1 -- 172.21.15.62:0/3810987771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee80b4610 con 0x7f6ee80cb540 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6ee67fc640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c240 tx=0x7f6ed0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0039070 con 0x7f6ee80cb540 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0005c80 con 0x7f6ee80cb540 2023-09-30T13:57:05.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee80b3a20 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed003c040 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.522+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee81588d0 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.523+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee80b47a0 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.523+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6ed0032070 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.523+0000 7f6edf7fe640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 0x7f6ec806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.524+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ed00aa7d0 con 0x7f6ee80cb540 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.524+0000 7f6ee6ffd640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 0x7f6ec806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.524+0000 7f6ee6ffd640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 0x7f6ec806cff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8014450 tx=0x7f6ed800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.528+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6ed0075a30 con 0x7f6ee80cb540 2023-09-30T13:57:05.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.702+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ee80b3eb0 con 0x7f6ee80cb540 2023-09-30T13:57:05.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.703+0000 7f6edf7fe640 1 -- 172.21.15.62:0/3810987771 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ee80b3eb0 con 0x7f6ee80cb540 2023-09-30T13:57:05.703 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:57:05.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 msgr2=0x7f6ec806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 0x7f6ec806cff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8014450 tx=0x7f6ed800b040 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 msgr2=0x7f6ee8158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c240 tx=0x7f6ed0001a00 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 shutdown_connections 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6ec806ab30 0x7f6ec806cff0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ee80b4b30 0x7f6ee80b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ee80cb540 0x7f6ee8158390 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 --2- 172.21.15.62:0/3810987771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed40047c0 0x7f6ee80ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 >> 172.21.15.62:0/3810987771 conn(0x7f6ee80718a0 msgr2=0x7f6ee8156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 shutdown_connections 2023-09-30T13:57:05.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.705+0000 7f6eed59e640 1 -- 172.21.15.62:0/3810987771 wait complete. 2023-09-30T13:57:05.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:05.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.821+0000 7f945f8d7640 1 Processor -- start 2023-09-30T13:57:05.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.821+0000 7f945f8d7640 1 -- start start 2023-09-30T13:57:05.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945f8d7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94580d1410 0x7f94580d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945f8d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f945806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945f8d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580cf450 con 0x7f945815cbe0 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945f8d7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94580cfcf0 con 0x7f94580d1410 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945f8d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580cf730 con 0x7f945806b650 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945ce72640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94580d1410 0x7f94580d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945ce72640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94580d1410 0x7f94580d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51212/0 (socket says 172.21.15.62:51212) 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.822+0000 7f945ce72640 1 -- 172.21.15.62:0/1924892343 learned_addr learned my addr 172.21.15.62:0/1924892343 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945de74640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f945806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945ce72640 1 -- 172.21.15.62:0/1924892343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 msgr2=0x7f945806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945ce72640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f945806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945ce72640 1 -- 172.21.15.62:0/1924892343 >> v1:172.21.15.135:6789/0 conn(0x7f945815cbe0 legacy=0x7f94580d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945ce72640 1 -- 172.21.15.62:0/1924892343 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580cfa10 con 0x7f94580d1410 2023-09-30T13:57:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945de74640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f945806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.823+0000 7f945ce72640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580d06b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd34c85eb3cd57bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f9457fff640 1 -- 172.21.15.62:0/1924892343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c02f830 con 0x7f94580d1410 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f9457fff640 1 -- 172.21.15.62:0/1924892343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c02f990 con 0x7f94580d1410 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f9457fff640 1 -- 172.21.15.62:0/1924892343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c02fd20 con 0x7f94580d1410 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 -- 172.21.15.62:0/1924892343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 msgr2=0x7f94580d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580d06b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02ba10 comp rx=0 tx=0).stop 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 -- 172.21.15.62:0/1924892343 shutdown_connections 2023-09-30T13:57:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f945806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1924892343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580d06b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 -- 172.21.15.62:0/1924892343 >> 172.21.15.62:0/1924892343 conn(0x7f9458089fe0 msgr2=0x7f94580d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 -- 172.21.15.62:0/1924892343 shutdown_connections 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.824+0000 7f945f8d7640 1 -- 172.21.15.62:0/1924892343 wait complete. 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.825+0000 7f945f8d7640 1 Processor -- start 2023-09-30T13:57:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 -- start start 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f94580c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945815cbe0 0x7f94580ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580ca030 con 0x7f94580d1410 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580b4ec0 con 0x7f945815cbe0 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945f8d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580b3c00 con 0x7f945806b650 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945ce72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945ce72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51218/0 (socket says 172.21.15.62:51218) 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.826+0000 7f945ce72640 1 -- 172.21.15.62:0/1528168409 learned_addr learned my addr 172.21.15.62:0/1528168409 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:05.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 -- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 msgr2=0x7f94580c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f94580c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 -- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945815cbe0 msgr2=0x7f94580ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945815cbe0 0x7f94580ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 -- 172.21.15.62:0/1528168409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0094d0 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945ce72640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f944c000c00 tx=0x7f944c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c037c40 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c037da0 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945815a5f0 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c041640 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.827+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94580b4180 con 0x7f94580d1410 2023-09-30T13:57:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.828+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945804e0d0 con 0x7f94580d1410 2023-09-30T13:57:05.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.829+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f944c0417a0 con 0x7f94580d1410 2023-09-30T13:57:05.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.829+0000 7f9455ffb640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 0x7f944406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:05.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.829+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f944c03c070 con 0x7f94580d1410 2023-09-30T13:57:05.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.829+0000 7f945d673640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 0x7f944406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:05.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.830+0000 7f945d673640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 0x7f944406cff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9450007fd0 tx=0x7f94500079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:05.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:05.833+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f944c077200 con 0x7f94580d1410 2023-09-30T13:57:06.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.044+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94580b8620 con 0x7f94580d1410 2023-09-30T13:57:06.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.044+0000 7f9455ffb640 1 -- 172.21.15.62:0/1528168409 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f944c07a820 con 0x7f94580d1410 2023-09-30T13:57:06.044 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:06.044 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:57:06.045 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:57:06.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 msgr2=0x7f944406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 0x7f944406cff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9450007fd0 tx=0x7f94500079a0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 msgr2=0x7f94580b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f944c000c00 tx=0x7f944c004730 comp rx=0 tx=0).stop 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 shutdown_connections 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f944406ab30 0x7f944406cff0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f945815cbe0 0x7f94580ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94580d1410 0x7f94580b4980 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 --2- 172.21.15.62:0/1528168409 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f945806b650 0x7f94580c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.046+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 >> 172.21.15.62:0/1528168409 conn(0x7f9458089fe0 msgr2=0x7f945815d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.047+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 shutdown_connections 2023-09-30T13:57:06.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.047+0000 7f945f8d7640 1 -- 172.21.15.62:0/1528168409 wait complete. 2023-09-30T13:57:06.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.163+0000 7fb5030cf640 1 Processor -- start 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.163+0000 7fb5030cf640 1 -- start start 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb5030cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb5030cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc0d0d00 0x7fb4fc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb5030cf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0d16a0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb5030cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cfcf0 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb5030cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cf450 con 0x7fb4fc0d0d00 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb500e6b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb500e6b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51228/0 (socket says 172.21.15.62:51228) 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.164+0000 7fb500e6b640 1 -- 172.21.15.62:0/1405544412 learned_addr learned my addr 172.21.15.62:0/1405544412 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb4fbfff640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc0d0d00 0x7fb4fc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb500e6b640 1 -- 172.21.15.62:0/1405544412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc0d0d00 msgr2=0x7fb4fc0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb500e6b640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc0d0d00 0x7fb4fc0d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb500e6b640 1 -- 172.21.15.62:0/1405544412 >> v1:172.21.15.135:6789/0 conn(0x7fb4fc0cd4e0 legacy=0x7fb4fc0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb500e6b640 1 -- 172.21.15.62:0/1405544412 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0cf730 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.165+0000 7fb500e6b640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009ea0 tx=0x7fb4f402bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bca8b83edf2a761 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb4fb7fe640 1 -- 172.21.15.62:0/1405544412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f402cb40 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb4fb7fe640 1 -- 172.21.15.62:0/1405544412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f402cca0 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb4fb7fe640 1 -- 172.21.15.62:0/1405544412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4034610 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 -- 172.21.15.62:0/1405544412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc15cbe0 msgr2=0x7fb4fc0d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009ea0 tx=0x7fb4f402bfa0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 -- 172.21.15.62:0/1405544412 shutdown_connections 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc0d0d00 0x7fb4fc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 --2- 172.21.15.62:0/1405544412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc15cbe0 0x7fb4fc0d06b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 -- 172.21.15.62:0/1405544412 >> 172.21.15.62:0/1405544412 conn(0x7fb4fc089fe0 msgr2=0x7fb4fc0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 -- 172.21.15.62:0/1405544412 shutdown_connections 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.166+0000 7fb5030cf640 1 -- 172.21.15.62:0/1405544412 wait complete. 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.167+0000 7fb5030cf640 1 Processor -- start 2023-09-30T13:57:06.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.167+0000 7fb5030cf640 1 -- start start 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 0x7fb4fc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 0x7fb4fc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cb6c0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0c9f20 con 0x7fb4fc0d0d00 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb5030cf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0ca200 con 0x7fb4fc15cbe0 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb500e6b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb500e6b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51236/0 (socket says 172.21.15.62:51236) 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb500e6b640 1 -- 172.21.15.62:0/3768955345 learned_addr learned my addr 172.21.15.62:0/3768955345 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.168+0000 7fb4fbfff640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 0x7fb4fc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb50166c640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 0x7fb4fc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 -- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 msgr2=0x7fb4fc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 0x7fb4fc0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 -- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 msgr2=0x7fb4fc0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 0x7fb4fc0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 -- 172.21.15.62:0/3768955345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009b30 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb4fbfff640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 0x7fb4fc0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb50166c640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 0x7fb4fc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb500e6b640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4000f80 tx=0x7fb4f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f403e450 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f403e5f0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f403e9a0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc0cb960 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.169+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc0cbf20 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.170+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc04e0d0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.170+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb4f403eb00 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.171+0000 7fb4f97fa640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 0x7fb4e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.171+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb4f40ac380 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.171+0000 7fb4fbfff640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 0x7fb4e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.171+0000 7fb4fbfff640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 0x7fb4e806cff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0c5f90 tx=0x7fb4f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.175+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb4f4077640 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.353+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4fc0c9710 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.354+0000 7fb4f97fa640 1 -- 172.21.15.62:0/3768955345 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fb4f403edb0 con 0x7fb4fc0cd4e0 2023-09-30T13:57:06.354 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:06.354 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:32.493691+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 msgr2=0x7fb4e806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 0x7fb4e806cff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0c5f90 tx=0x7fb4f0008040 comp rx=0 tx=0).stop 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 msgr2=0x7fb4fc1494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4000f80 tx=0x7fb4f4004a40 comp rx=0 tx=0).stop 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 shutdown_connections 2023-09-30T13:57:06.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4e806ab30 0x7fb4e806cff0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4fc15cbe0 0x7fb4fc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4fc0d0d00 0x7fb4fc0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 --2- 172.21.15.62:0/3768955345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4fc0cd4e0 0x7fb4fc1494f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 >> 172.21.15.62:0/3768955345 conn(0x7fb4fc089fe0 msgr2=0x7fb4fc15f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 shutdown_connections 2023-09-30T13:57:06.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.356+0000 7fb5030cf640 1 -- 172.21.15.62:0/3768955345 wait complete. 2023-09-30T13:57:06.369 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T13:57:06.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:06.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.476+0000 7f4560e61640 1 Processor -- start 2023-09-30T13:57:06.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.476+0000 7f4560e61640 1 -- start start 2023-09-30T13:57:06.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f4560e61640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f455c15cbb0 0x7f455c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f4560e61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f4560e61640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455c0cb810 con 0x7f455c06b070 2023-09-30T13:57:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f4560e61640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455c06c230 con 0x7f455c15cbb0 2023-09-30T13:57:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f4560e61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c0cccb0 con 0x7f455c0d1410 2023-09-30T13:57:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f455c15cbb0 0x7f455c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f455c15cbb0 0x7f455c06b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51240/0 (socket says 172.21.15.62:51240) 2023-09-30T13:57:06.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 -- 172.21.15.62:0/996168395 learned_addr learned my addr 172.21.15.62:0/996168395 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:06.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455ad9d640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 -- 172.21.15.62:0/996168395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 msgr2=0x7f455c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:06.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 -- 172.21.15.62:0/996168395 >> v1:172.21.15.135:6789/0 conn(0x7f455c06b070 legacy=0x7f455c06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.477+0000 7f455a59c640 1 -- 172.21.15.62:0/996168395 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c0caee0 con 0x7f455c15cbb0 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.478+0000 7f455a59c640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c15cbb0 0x7f455c06b5e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4006381c3083d45d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.478+0000 7f4559d9b640 1 -- 172.21.15.62:0/996168395 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c030840 con 0x7f455c15cbb0 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.478+0000 7f4559d9b640 1 -- 172.21.15.62:0/996168395 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c0309a0 con 0x7f455c15cbb0 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.478+0000 7f4559d9b640 1 -- 172.21.15.62:0/996168395 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c030d30 con 0x7f455c15cbb0 2023-09-30T13:57:06.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 -- 172.21.15.62:0/996168395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c15cbb0 msgr2=0x7f455c06b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c15cbb0 0x7f455c06b5e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02b980 comp rx=0 tx=0).stop 2023-09-30T13:57:06.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 -- 172.21.15.62:0/996168395 shutdown_connections 2023-09-30T13:57:06.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 --2- 172.21.15.62:0/996168395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c15cbb0 0x7f455c06b5e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 -- 172.21.15.62:0/996168395 >> 172.21.15.62:0/996168395 conn(0x7f455c089fe0 msgr2=0x7f455c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 -- 172.21.15.62:0/996168395 shutdown_connections 2023-09-30T13:57:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.479+0000 7f4560e61640 1 -- 172.21.15.62:0/996168395 wait complete. 2023-09-30T13:57:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.480+0000 7f4560e61640 1 Processor -- start 2023-09-30T13:57:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.480+0000 7f4560e61640 1 -- start start 2023-09-30T13:57:06.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455c15cbb0 0x7f455c0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c15b390 con 0x7f455c06b070 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c15e280 con 0x7f455c15cbb0 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4560e61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c15cf90 con 0x7f455c0d1410 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51248/0 (socket says 172.21.15.62:51248) 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 -- 172.21.15.62:0/3716014927 learned_addr learned my addr 172.21.15.62:0/3716014927 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:06.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455ad9d640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455c15cbb0 0x7f455c0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4551d9b640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 -- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 msgr2=0x7f455c0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 -- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455c15cbb0 msgr2=0x7f455c0c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455c15cbb0 0x7f455c0c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f455a59c640 1 -- 172.21.15.62:0/3716014927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0094d0 con 0x7f455c06b070 2023-09-30T13:57:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.481+0000 7f4551d9b640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f455a59c640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f454c02b9c0 tx=0x7f454c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c039c90 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c039df0 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c0446c0 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c15ddf0 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.482+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c15d4c0 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.483+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c06e2a0 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.483+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f454c02f390 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.484+0000 7f45537fe640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 0x7f453c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.484+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f454c03e070 con 0x7f455c06b070 2023-09-30T13:57:06.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.484+0000 7f4551d9b640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 0x7f453c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.484+0000 7f4551d9b640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 0x7f453c06cff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4544007fd0 tx=0x7f4544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.488+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f454c076dc0 con 0x7f455c06b070 2023-09-30T13:57:06.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.701+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f455c04e0d0 con 0x7f455c06b070 2023-09-30T13:57:06.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.702+0000 7f45537fe640 1 -- 172.21.15.62:0/3716014927 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f454c07a3e0 con 0x7f455c06b070 2023-09-30T13:57:06.702 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:06.702 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:57:06.702 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:57:06.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.703+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 msgr2=0x7f453c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 0x7f453c06cff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4544007fd0 tx=0x7f4544009040 comp rx=0 tx=0).stop 2023-09-30T13:57:06.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 msgr2=0x7f455c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f454c02b9c0 tx=0x7f454c004730 comp rx=0 tx=0).stop 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 shutdown_connections 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f453c06ab30 0x7f453c06cff0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455c15cbb0 0x7f455c0c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0d1410 0x7f455c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 --2- 172.21.15.62:0/3716014927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f455c06b070 0x7f455c15ab00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 >> 172.21.15.62:0/3716014927 conn(0x7f455c089fe0 msgr2=0x7f455c0d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 shutdown_connections 2023-09-30T13:57:06.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.704+0000 7f4560e61640 1 -- 172.21.15.62:0/3716014927 wait complete. 2023-09-30T13:57:06.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:06.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.820+0000 7fe813c61640 1 Processor -- start 2023-09-30T13:57:06.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.820+0000 7fe813c61640 1 -- start start 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.821+0000 7fe813c61640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe80c15cd90 0x7fe80c0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.821+0000 7fe813c61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.821+0000 7fe813c61640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0cae70 con 0x7fe80c0d0080 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.821+0000 7fe813c61640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0cb110 con 0x7fe80c15cd90 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.821+0000 7fe813c61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0cb3f0 con 0x7fe80c0b0490 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8121fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe80c15cd90 0x7fe80c0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8111fc640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe80c0d0080 0x7fe80c15d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:46404/0 (socket says 172.21.15.62:46404) 2023-09-30T13:57:06.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8121fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:38566/0 (socket says 172.21.15.62:38566) 2023-09-30T13:57:06.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe80c15cd90 0x7fe80c0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:56774/0 (socket says 172.21.15.62:56774) 2023-09-30T13:57:06.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8111fc640 1 -- 172.21.15.62:0/3439037816 learned_addr learned my addr 172.21.15.62:0/3439037816 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:06.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 -- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 msgr2=0x7fe80c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:06.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 -- 172.21.15.62:0/3439037816 >> v1:172.21.15.135:6789/0 conn(0x7fe80c0d0080 legacy=0x7fe80c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8119fd640 1 -- 172.21.15.62:0/3439037816 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0d05f0 con 0x7fe80c15cd90 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.822+0000 7fe8121fe640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.823+0000 7fe8119fd640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c15cd90 0x7fe80c0cbf80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe804009de0 tx=0x7fe80402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd286a2b5c05c24b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.823+0000 7fe8109fb640 1 -- 172.21.15.62:0/3439037816 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80402cc00 con 0x7fe80c15cd90 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.823+0000 7fe8109fb640 1 -- 172.21.15.62:0/3439037816 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80402cd60 con 0x7fe80c15cd90 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.823+0000 7fe8109fb640 1 -- 172.21.15.62:0/3439037816 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804034660 con 0x7fe80c15cd90 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 -- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c15cd90 msgr2=0x7fe80c0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c15cd90 0x7fe80c0cbf80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe804009de0 tx=0x7fe80402be50 comp rx=0 tx=0).stop 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 -- 172.21.15.62:0/3439037816 shutdown_connections 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c0b0490 0x7fe80c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 --2- 172.21.15.62:0/3439037816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c15cd90 0x7fe80c0cbf80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 -- 172.21.15.62:0/3439037816 >> 172.21.15.62:0/3439037816 conn(0x7fe80c098a50 msgr2=0x7fe80c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:06.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 -- 172.21.15.62:0/3439037816 shutdown_connections 2023-09-30T13:57:06.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.824+0000 7fe813c61640 1 -- 172.21.15.62:0/3439037816 wait complete. 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.825+0000 7fe813c61640 1 Processor -- start 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.825+0000 7fe813c61640 1 -- start start 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c0b0490 0x7fe80c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c15cd90 0x7fe80c1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1530c0 con 0x7fe80c0d0080 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c154770 con 0x7fe80c0b0490 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe813c61640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c154a50 con 0x7fe80c15cd90 2023-09-30T13:57:06.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51264/0 (socket says 172.21.15.62:51264) 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 -- 172.21.15.62:0/2050290308 learned_addr learned my addr 172.21.15.62:0/2050290308 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8119fd640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c0b0490 0x7fe80c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8121fe640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c15cd90 0x7fe80c1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 -- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c15cd90 msgr2=0x7fe80c1f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c15cd90 0x7fe80c1f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 -- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c0b0490 msgr2=0x7fe80c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c0b0490 0x7fe80c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 -- 172.21.15.62:0/2050290308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009400 con 0x7fe80c0d0080 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe8111fc640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c4a0 tx=0x7fe80000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800005ce0 con 0x7fe80c0d0080 2023-09-30T13:57:06.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.826+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800005e40 con 0x7fe80c0d0080 2023-09-30T13:57:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.827+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe804009a70 con 0x7fe80c0d0080 2023-09-30T13:57:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.827+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000072d0 con 0x7fe80c0d0080 2023-09-30T13:57:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.827+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c155010 con 0x7fe80c0d0080 2023-09-30T13:57:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.828+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c04e0d0 con 0x7fe80c0d0080 2023-09-30T13:57:06.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.828+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe8000074f0 con 0x7fe80c0d0080 2023-09-30T13:57:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.829+0000 7fe80a7fc640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 0x7fe7f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.829+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe800088800 con 0x7fe80c0d0080 2023-09-30T13:57:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.829+0000 7fe8119fd640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 0x7fe7f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:06.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.830+0000 7fe8119fd640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 0x7fe7f806cff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe804036000 tx=0x7fe804030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:06.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:06.833+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe8000539a0 con 0x7fe80c0d0080 2023-09-30T13:57:07.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.042+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe80c0ccda0 con 0x7fe80c0d0080 2023-09-30T13:57:07.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.043+0000 7fe80a7fc640 1 -- 172.21.15.62:0/2050290308 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fe800017090 con 0x7fe80c0d0080 2023-09-30T13:57:07.043 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:07.043 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:56:05.379093+0000","modified":"2023-09-30T13:56:07.370369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5529":{"gid":5529,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/220613510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":220613510},{"type":"v1","addr":"172.21.15.62:6835","nonce":220613510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-30T13:57:07.043 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2023-09-30T13:57:07.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 msgr2=0x7fe7f806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 0x7fe7f806cff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe804036000 tx=0x7fe804030000 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 msgr2=0x7fe80c153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c4a0 tx=0x7fe80000c8a0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 shutdown_connections 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f806ab30 0x7fe7f806cff0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80c15cd90 0x7fe80c1f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80c0d0080 0x7fe80c153cb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 --2- 172.21.15.62:0/2050290308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80c0b0490 0x7fe80c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 >> 172.21.15.62:0/2050290308 conn(0x7fe80c098a50 msgr2=0x7fe80c0cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 shutdown_connections 2023-09-30T13:57:07.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.045+0000 7fe813c61640 1 -- 172.21.15.62:0/2050290308 wait complete. 2023-09-30T13:57:07.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:07.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.162+0000 7fb789f33640 1 Processor -- start 2023-09-30T13:57:07.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.162+0000 7fb789f33640 1 -- start start 2023-09-30T13:57:07.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb789f33640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7840cf140 0x7fb7840b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb789f33640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78415b9a0 con 0x7fb7840b31c0 2023-09-30T13:57:07.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb789f33640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7840cc950 con 0x7fb7840ace50 2023-09-30T13:57:07.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb789f33640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7840b2e50 con 0x7fb7840cf140 2023-09-30T13:57:07.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb782ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7840cf140 0x7fb7840b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb783fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb7840b31c0 0x7fb7840ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46432/0 (socket says 172.21.15.62:46432) 2023-09-30T13:57:07.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb783fff640 1 -- 172.21.15.62:0/2393189657 learned_addr learned my addr 172.21.15.62:0/2393189657 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:07.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb782ffd640 1 -- 172.21.15.62:0/2393189657 >> v1:172.21.15.135:6789/0 conn(0x7fb7840ace50 legacy=0x7fb7840cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:07.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb782ffd640 1 -- 172.21.15.62:0/2393189657 >> v1:172.21.15.62:6789/0 conn(0x7fb7840b31c0 legacy=0x7fb7840ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb782ffd640 1 -- 172.21.15.62:0/2393189657 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78415add0 con 0x7fb7840cf140 2023-09-30T13:57:07.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.163+0000 7fb7827fc640 1 -- 172.21.15.62:0/2393189657 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209126283 0 0) 0x7fb78415b9a0 con 0x7fb7840b31c0 2023-09-30T13:57:07.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.164+0000 7fb782ffd640 1 --2- 172.21.15.62:0/2393189657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840cf140 0x7fb7840b2910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb7780097a0 tx=0x7fb77802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1762ca52d0174ea2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.164+0000 7fb7827fc640 1 -- 172.21.15.62:0/2393189657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77802e070 con 0x7fb7840cf140 2023-09-30T13:57:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.164+0000 7fb7827fc640 1 -- 172.21.15.62:0/2393189657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7780315a0 con 0x7fb7840cf140 2023-09-30T13:57:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.164+0000 7fb7827fc640 1 -- 172.21.15.62:0/2393189657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778031930 con 0x7fb7840cf140 2023-09-30T13:57:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 -- 172.21.15.62:0/2393189657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840cf140 msgr2=0x7fb7840b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 --2- 172.21.15.62:0/2393189657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840cf140 0x7fb7840b2910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb7780097a0 tx=0x7fb77802b840 comp rx=0 tx=0).stop 2023-09-30T13:57:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 -- 172.21.15.62:0/2393189657 shutdown_connections 2023-09-30T13:57:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 --2- 172.21.15.62:0/2393189657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840cf140 0x7fb7840b2910 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 -- 172.21.15.62:0/2393189657 >> 172.21.15.62:0/2393189657 conn(0x7fb78406a170 msgr2=0x7fb78406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 -- 172.21.15.62:0/2393189657 shutdown_connections 2023-09-30T13:57:07.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.165+0000 7fb789f33640 1 -- 172.21.15.62:0/2393189657 wait complete. 2023-09-30T13:57:07.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.166+0000 7fb789f33640 1 Processor -- start 2023-09-30T13:57:07.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.166+0000 7fb789f33640 1 -- start start 2023-09-30T13:57:07.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7840b31c0 0x7fb7840c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7840cf140 0x7fb7840c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78415a680 con 0x7fb7840ace50 2023-09-30T13:57:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840c6190 con 0x7fb7840cf140 2023-09-30T13:57:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb789f33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840c6470 con 0x7fb7840b31c0 2023-09-30T13:57:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51274/0 (socket says 172.21.15.62:51274) 2023-09-30T13:57:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 -- 172.21.15.62:0/2733384939 learned_addr learned my addr 172.21.15.62:0/2733384939 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb782ffd640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7840b31c0 0x7fb7840c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb783fff640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7840cf140 0x7fb7840c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 -- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7840b31c0 msgr2=0x7fb7840c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7840b31c0 0x7fb7840c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 -- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7840cf140 msgr2=0x7fb7840c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7840cf140 0x7fb7840c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 -- 172.21.15.62:0/2733384939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778009400 con 0x7fb7840ace50 2023-09-30T13:57:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb7837fe640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb774004640 tx=0x7fb77400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.167+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011790 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.168+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7740118f0 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.168+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78406bff0 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.168+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011ce0 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.168+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7841f2fa0 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.169+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78406be20 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.169+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb774012420 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.169+0000 7fb76bfff640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 0x7fb77006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.169+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7740890b0 con 0x7fb7840ace50 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.170+0000 7fb782ffd640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 0x7fb77006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.170+0000 7fb782ffd640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 0x7fb77006cff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb778008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.174+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb774054120 con 0x7fb7840ace50 2023-09-30T13:57:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.351+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb78404e0d0 con 0x7fb7840ace50 2023-09-30T13:57:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.352+0000 7fb76bfff640 1 -- 172.21.15.62:0/2733384939 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fb774057740 con 0x7fb7840ace50 2023-09-30T13:57:07.352 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:07.352 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":40,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:56:32.493691+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:56:03.919978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-30T13:56:04.353687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 msgr2=0x7fb77006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 0x7fb77006cff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb778008030 comp rx=0 tx=0).stop 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 msgr2=0x7fb78415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb774004640 tx=0x7fb77400c8e0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 shutdown_connections 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb77006ab30 0x7fb77006cff0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7840cf140 0x7fb7840c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7840b31c0 0x7fb7840c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 --2- 172.21.15.62:0/2733384939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7840ace50 0x7fb78415a140 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 >> 172.21.15.62:0/2733384939 conn(0x7fb78406a170 msgr2=0x7fb7840adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 shutdown_connections 2023-09-30T13:57:07.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.354+0000 7fb789f33640 1 -- 172.21.15.62:0/2733384939 wait complete. 2023-09-30T13:57:07.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T13:57:07.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.471+0000 7f7a903ce640 1 Processor -- start 2023-09-30T13:57:07.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.472+0000 7f7a903ce640 1 -- start start 2023-09-30T13:57:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.472+0000 7f7a903ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815dd20 0x7f7a880ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.472+0000 7f7a903ce640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a880cb600 0x7f7a880b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.472+0000 7f7a903ce640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880b0000 con 0x7f7a8815e100 2023-09-30T13:57:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a903ce640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880b0c40 con 0x7f7a880cb600 2023-09-30T13:57:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a903ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880cad30 con 0x7f7a8815dd20 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a880cb600 0x7f7a880b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e16a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815dd20 0x7f7a880ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7a880cb600 0x7f7a880b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:56794/0 (socket says 172.21.15.62:56794) 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 -- 172.21.15.62:0/2643164640 learned_addr learned my addr 172.21.15.62:0/2643164640 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8d969640 1 --1- 172.21.15.62:0/2643164640 >> v1:172.21.15.135:6789/0 conn(0x7f7a8815e100 0x7f7a880caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:46420/0 (socket says 172.21.15.62:46420) 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 -- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815dd20 msgr2=0x7f7a880ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 --2- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815dd20 0x7f7a880ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 -- 172.21.15.62:0/2643164640 >> v1:172.21.15.135:6789/0 conn(0x7f7a8815e100 legacy=0x7f7a880caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.473+0000 7f7a8e96b640 1 -- 172.21.15.62:0/2643164640 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880b02a0 con 0x7f7a880cb600 2023-09-30T13:57:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.474+0000 7f7a8e96b640 1 --2- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880cb600 0x7f7a880b13c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009e50 tx=0x7f7a8002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35ca5ce81a4027c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.474+0000 7f7a8d168640 1 -- 172.21.15.62:0/2643164640 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8002cb00 con 0x7f7a880cb600 2023-09-30T13:57:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.474+0000 7f7a8d168640 1 -- 172.21.15.62:0/2643164640 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8002cc60 con 0x7f7a880cb600 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.474+0000 7f7a8d168640 1 -- 172.21.15.62:0/2643164640 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800343f0 con 0x7f7a880cb600 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 -- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880cb600 msgr2=0x7f7a880b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880cb600 0x7f7a880b13c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009e50 tx=0x7f7a8002bf60 comp rx=0 tx=0).stop 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 -- 172.21.15.62:0/2643164640 shutdown_connections 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a880cb600 0x7f7a880b13c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2643164640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815dd20 0x7f7a880ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 -- 172.21.15.62:0/2643164640 >> 172.21.15.62:0/2643164640 conn(0x7f7a8806a430 msgr2=0x7f7a8806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 -- 172.21.15.62:0/2643164640 shutdown_connections 2023-09-30T13:57:07.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.475+0000 7f7a903ce640 1 -- 172.21.15.62:0/2643164640 wait complete. 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.476+0000 7f7a903ce640 1 Processor -- start 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.476+0000 7f7a903ce640 1 -- start start 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 0x7f7a880cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815e100 0x7f7a880c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880ce010 con 0x7f7a880cb600 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880c4f30 con 0x7f7a8815dd20 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a903ce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880ae520 con 0x7f7a8815e100 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51282/0 (socket says 172.21.15.62:51282) 2023-09-30T13:57:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 -- 172.21.15.62:0/2383836699 learned_addr learned my addr 172.21.15.62:0/2383836699 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8d969640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 0x7f7a880cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e96b640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815e100 0x7f7a880c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 -- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815e100 msgr2=0x7f7a880c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815e100 0x7f7a880c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 -- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 msgr2=0x7f7a880cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 0x7f7a880cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 -- 172.21.15.62:0/2383836699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009b30 con 0x7f7a880cb600 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8d969640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 0x7f7a880cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.477+0000 7f7a8e16a640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9e0 tx=0x7f7a7c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.478+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c009670 con 0x7f7a880cb600 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.478+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00c970 con 0x7f7a880cb600 2023-09-30T13:57:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.478+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a880abb00 con 0x7f7a880cb600 2023-09-30T13:57:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.478+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00cd20 con 0x7f7a880cb600 2023-09-30T13:57:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.478+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a880aea50 con 0x7f7a880cb600 2023-09-30T13:57:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.479+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a880aec40 con 0x7f7a880cb600 2023-09-30T13:57:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.479+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7a7c013470 con 0x7f7a880cb600 2023-09-30T13:57:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.480+0000 7f7a7affd640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 0x7f7a6c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.480+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a7c0894e0 con 0x7f7a880cb600 2023-09-30T13:57:07.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.480+0000 7f7a8d969640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 0x7f7a6c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.480+0000 7f7a8d969640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 0x7f7a6c06d020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007fd0 tx=0x7f7a84007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.484+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7a7c054680 con 0x7f7a880cb600 2023-09-30T13:57:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.697+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a88070e80 con 0x7f7a880cb600 2023-09-30T13:57:07.697 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-09-30T13:57:07.697+0000 7f9b7f1be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T13:57:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.699+0000 7f7a7affd640 1 -- 172.21.15.62:0/2383836699 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a7c057ca0 con 0x7f7a880cb600 2023-09-30T13:57:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T13:57:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 msgr2=0x7f7a6c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 0x7f7a6c06d020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007fd0 tx=0x7f7a84007d40 comp rx=0 tx=0).stop 2023-09-30T13:57:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 msgr2=0x7f7a881f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9e0 tx=0x7f7a7c00eea0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 shutdown_connections 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7a6c06ab60 0x7f7a6c06d020 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007fd0 tx=0x7f7a84007d40 comp rx=0 tx=0).stop 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7a8815e100 0x7f7a880c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a8815dd20 0x7f7a880cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 --2- 172.21.15.62:0/2383836699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cb600 0x7f7a881f2e30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 >> 172.21.15.62:0/2383836699 conn(0x7f7a8806a430 msgr2=0x7f7a880caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.702+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 shutdown_connections 2023-09-30T13:57:07.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.703+0000 7f7a903ce640 1 -- 172.21.15.62:0/2383836699 wait complete. 2023-09-30T13:57:07.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T13:57:07.738 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-09-30T13:57:07.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 Processor -- start 2023-09-30T13:57:07.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 -- start start 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb97c15cb00 0x7fb97c071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c06d740 con 0x7fb97c0ae300 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c06da20 con 0x7fb97c15cee0 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.824+0000 7fb9814af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c06dd00 con 0x7fb97c15cb00 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb97c0ae300 0x7fb97c06ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57434/0 (socket says 172.21.15.62:57434) 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97b7fe640 1 -- 172.21.15.62:0/536718711 learned_addr learned my addr 172.21.15.62:0/536718711 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97affd640 1 --2- 172.21.15.62:0/536718711 >> v2:172.21.15.135:3300/0 conn(0x7fb97c15cb00 0x7fb97c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658270032 0 0) 0x7fb97c06d740 con 0x7fb97c0ae300 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb968003520 con 0x7fb97c0ae300 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3419713693 0 0) 0x7fb968003520 con 0x7fb97c0ae300 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 >> v2:172.21.15.135:3300/0 conn(0x7fb97c15cb00 msgr2=0x7fb97c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 --2- 172.21.15.62:0/536718711 >> v2:172.21.15.135:3300/0 conn(0x7fb97c15cb00 0x7fb97c071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 >> v1:172.21.15.135:6789/0 conn(0x7fb97c15cee0 legacy=0x7fb97c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c06dfe0 con 0x7fb97c0ae300 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb9740019f0 con 0x7fb97c0ae300 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97affd640 1 --2- 172.21.15.62:0/536718711 >> v2:172.21.15.135:3300/0 conn(0x7fb97c15cb00 0x7fb97c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 >> v1:172.21.15.62:6789/0 conn(0x7fb97c0ae300 legacy=0x7fb97c06ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb968003970 0x7fb968003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb968004370 0x7fb968004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb96800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c06dd00 con 0x7fb968005040 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96800bfa0 con 0x7fb968003970 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96800c160 con 0x7fb968004370 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97b7fe640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb96800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.825+0000 7fb97affd640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb968003970 0x7fb968003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb973fff640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb968004370 0x7fb968004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 -- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb968004370 msgr2=0x7fb968004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb968004370 0x7fb968004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 -- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb968003970 msgr2=0x7fb968003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb968003970 0x7fb968003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 -- 172.21.15.62:0/536718711 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb968003520 con 0x7fb968005040 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 -- 172.21.15.62:0/536718711 reap_dead start 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.826+0000 7fb97b7fe640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb96800b980 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0c2970 tx=0x7fb9680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f52ec5b3cecefcc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974034630 con 0x7fb968005040 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97402f070 con 0x7fb968005040 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb97a7fc640 1 -- 172.21.15.62:0/536718711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740349f0 con 0x7fb968005040 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 -- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 msgr2=0x7fb96800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb96800b980 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0c2970 tx=0x7fb9680057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 -- 172.21.15.62:0/536718711 shutdown_connections 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 --2- 172.21.15.62:0/536718711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb96800b980 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 -- 172.21.15.62:0/536718711 >> 172.21.15.62:0/536718711 conn(0x7fb97c070970 msgr2=0x7fb97c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:07.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 -- 172.21.15.62:0/536718711 shutdown_connections 2023-09-30T13:57:07.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.827+0000 7fb9814af640 1 -- 172.21.15.62:0/536718711 wait complete. 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.828+0000 7fb9814af640 1 Processor -- start 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.828+0000 7fb9814af640 1 -- start start 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb97c15a590 0x7fb97c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97c0b28a0 0x7fb97c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c15af50 con 0x7fb968005040 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c15d9b0 con 0x7fb97c0b28a0 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb9814af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c6da0 con 0x7fb97c15a590 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb97affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb97affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40136/0 (socket says 172.21.15.62:40136) 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.829+0000 7fb97affd640 1 -- 172.21.15.62:0/2294499210 learned_addr learned my addr 172.21.15.62:0/2294499210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97b7fe640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97c0b28a0 0x7fb97c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 -- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb97c15a590 msgr2=0x7fb97c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb97c15a590 0x7fb97c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 -- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97c0b28a0 msgr2=0x7fb97c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97c0b28a0 0x7fb97c0b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 -- 172.21.15.62:0/2294499210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0b38b0 con 0x7fb968005040 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb97affd640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb96c011a90 tx=0x7fb96c011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00fc10 con 0x7fb968005040 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00fd70 con 0x7fb968005040 2023-09-30T13:57:07.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c0b35d0 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00fee0 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.830+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c15d640 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.831+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c0666d0 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.831+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb96c004260 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.832+0000 7fb9737fe640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 0x7fb95c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.832+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb96c089ae0 con 0x7fb968005040 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.832+0000 7fb973fff640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 0x7fb95c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.832+0000 7fb973fff640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 0x7fb95c06cff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb97c1f5500 tx=0x7fb964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:07.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:07.836+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb96c054b80 con 0x7fb968005040 2023-09-30T13:57:08.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.052+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb97c0cd000 con 0x7fb968005040 2023-09-30T13:57:08.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.702+0000 7fb9737fe640 1 -- 172.21.15.62:0/2294499210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb96c0220a0 con 0x7fb968005040 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 msgr2=0x7fb95c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 0x7fb95c06cff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb97c1f5500 tx=0x7fb964009040 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 msgr2=0x7fb97c149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb96c011a90 tx=0x7fb96c011f50 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 shutdown_connections 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb95c06ab30 0x7fb95c06cff0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb97c0b28a0 0x7fb97c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb97c15a590 0x7fb97c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 --2- 172.21.15.62:0/2294499210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb968005040 0x7fb97c149180 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 >> 172.21.15.62:0/2294499210 conn(0x7fb97c070970 msgr2=0x7fb97c0ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:08.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 shutdown_connections 2023-09-30T13:57:08.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.705+0000 7fb9814af640 1 -- 172.21.15.62:0/2294499210 wait complete. 2023-09-30T13:57:08.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T13:57:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 Processor -- start 2023-09-30T13:57:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 -- start start 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efccc15dee0 0x7efccc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efccc15d2f0 con 0x7efccc0cc020 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efccc15a090 con 0x7efccc15dee0 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.874+0000 7efcd23a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0cdd40 con 0x7efccc159770 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efccc15dee0 0x7efccc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efccc15dee0 0x7efccc0ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40138/0 (socket says 172.21.15.62:40138) 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 -- 172.21.15.62:0/3663559458 learned_addr learned my addr 172.21.15.62:0/3663559458 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:08.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efccbfff640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 -- 172.21.15.62:0/3663559458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 msgr2=0x7efccc159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 -- 172.21.15.62:0/3663559458 >> v1:172.21.15.135:6789/0 conn(0x7efccc0cc020 legacy=0x7efccc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efcd0946640 1 -- 172.21.15.62:0/3663559458 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc15a270 con 0x7efccc15dee0 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.875+0000 7efccbfff640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:08.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd0946640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc15dee0 0x7efccc0ca6d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009e50 tx=0x7efcc402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d86095b9f892888 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:08.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efccaffd640 1 -- 172.21.15.62:0/3663559458 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc402caf0 con 0x7efccc15dee0 2023-09-30T13:57:08.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efccaffd640 1 -- 172.21.15.62:0/3663559458 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc402cc50 con 0x7efccc15dee0 2023-09-30T13:57:08.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efccaffd640 1 -- 172.21.15.62:0/3663559458 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40343f0 con 0x7efccc15dee0 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 -- 172.21.15.62:0/3663559458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc15dee0 msgr2=0x7efccc0ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc15dee0 0x7efccc0ca6d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009e50 tx=0x7efcc402bf50 comp rx=0 tx=0).stop 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 -- 172.21.15.62:0/3663559458 shutdown_connections 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc15dee0 0x7efccc0ca6d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 --2- 172.21.15.62:0/3663559458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 -- 172.21.15.62:0/3663559458 >> 172.21.15.62:0/3663559458 conn(0x7efccc06a3b0 msgr2=0x7efccc0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 -- 172.21.15.62:0/3663559458 shutdown_connections 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.876+0000 7efcd23a9640 1 -- 172.21.15.62:0/3663559458 wait complete. 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.878+0000 7efcd23a9640 1 Processor -- start 2023-09-30T13:57:08.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.878+0000 7efcd23a9640 1 -- start start 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.878+0000 7efcd23a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.878+0000 7efcd23a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc0c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efccc15dee0 0x7efccc15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c3480 con 0x7efccc0cc020 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c4fe0 con 0x7efccc15dee0 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0ac2e0 con 0x7efccc159770 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40146/0 (socket says 172.21.15.62:40146) 2023-09-30T13:57:08.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 -- 172.21.15.62:0/1727679231 learned_addr learned my addr 172.21.15.62:0/1727679231 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccb7fe640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc0c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 -- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 msgr2=0x7efccc0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd0946640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efccc15dee0 0x7efccc15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc0c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 -- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efccc15dee0 msgr2=0x7efccc15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efccc15dee0 0x7efccc15ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 -- 172.21.15.62:0/1727679231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009b30 con 0x7efccc0cc020 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccb7fe640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc0c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efccbfff640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e7e0 tx=0x7efcbc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004030 con 0x7efccc0cc020 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc004190 con 0x7efccc0cc020 2023-09-30T13:57:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc0ac5c0 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004520 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.879+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc0c2fa0 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.880+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc0c31f0 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.881+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efcbc00c6d0 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.881+0000 7efcc8ff9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 0x7efcb806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.881+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efcbc0890a0 con 0x7efccc0cc020 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.881+0000 7efccb7fe640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 0x7efcb806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:08.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.882+0000 7efccb7fe640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 0x7efcb806cff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcc0000f60 tx=0x7efcc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:08.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:08.885+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efcbc0541d0 con 0x7efccc0cc020 2023-09-30T13:57:09.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.063+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efccc0c36f0 con 0x7efccc0cc020 2023-09-30T13:57:09.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.708+0000 7efcc8ff9640 1 -- 172.21.15.62:0/1727679231 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7efcbc0577f0 con 0x7efccc0cc020 2023-09-30T13:57:09.707 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-09-30T13:57:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 msgr2=0x7efcb806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 0x7efcb806cff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcc0000f60 tx=0x7efcc0009040 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 msgr2=0x7efccc0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e7e0 tx=0x7efcbc00eca0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 shutdown_connections 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efcb806ab30 0x7efcb806cff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efccc15dee0 0x7efccc15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efccc159770 0x7efccc0c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 --2- 172.21.15.62:0/1727679231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efccc0cc020 0x7efccc0718a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.711+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 >> 172.21.15.62:0/1727679231 conn(0x7efccc06a3b0 msgr2=0x7efccc0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.713+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 shutdown_connections 2023-09-30T13:57:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.713+0000 7efcd23a9640 1 -- 172.21.15.62:0/1727679231 wait complete. 2023-09-30T13:57:09.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T13:57:09.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 Processor -- start 2023-09-30T13:57:09.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 -- start start 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb4a0159b50 0x7fb4a015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb4a00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a015a000 con 0x7fb4a0159770 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a015e140 con 0x7fb4a0159b50 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.844+0000 7fb4a5ea2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015d2f0 con 0x7fb4a015dd10 2023-09-30T13:57:09.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb4a0159770 0x7fb4a00cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57444/0 (socket says 172.21.15.62:57444) 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49f7fe640 1 -- 172.21.15.62:0/1825247981 learned_addr learned my addr 172.21.15.62:0/1825247981 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866871064 0 0) 0x7fb4a015a000 con 0x7fb4a0159770 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb48c003520 con 0x7fb4a0159770 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49ffff640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb4a00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49effd640 1 --2- 172.21.15.62:0/1825247981 >> v2:172.21.15.135:3300/0 conn(0x7fb4a0159b50 0x7fb4a015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4151178936 0 0) 0x7fb48c003520 con 0x7fb4a0159770 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 msgr2=0x7fb4a00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb4a00ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 >> v2:172.21.15.135:3300/0 conn(0x7fb4a0159b50 msgr2=0x7fb4a015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 --2- 172.21.15.62:0/1825247981 >> v2:172.21.15.135:3300/0 conn(0x7fb4a0159b50 0x7fb4a015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a00cc730 con 0x7fb4a0159770 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb488001670 con 0x7fb4a0159770 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49effd640 1 --2- 172.21.15.62:0/1825247981 >> v2:172.21.15.135:3300/0 conn(0x7fb4a0159b50 0x7fb4a015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 >> v1:172.21.15.62:6789/0 conn(0x7fb4a0159770 legacy=0x7fb4a00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb48c003970 0x7fb48c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb48c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c004d00 0x7fb48c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015e140 con 0x7fb48c003970 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015d2f0 con 0x7fb48c004d00 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c00b980 con 0x7fb4a015dd10 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb48c003970 0x7fb48c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.845+0000 7fb49effd640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb48c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49ffff640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c004d00 0x7fb48c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 -- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 msgr2=0x7fb48c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb48c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 -- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c004d00 msgr2=0x7fb48c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c004d00 0x7fb48c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 -- 172.21.15.62:0/1825247981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c003520 con 0x7fb48c003970 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49effd640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a015dd10 0x7fb48c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb48c003970 0x7fb48c003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c2c0 tx=0x7fb48c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec84be0acba21347 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.846+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488005ad0 con 0x7fb48c003970 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb488005c50 con 0x7fb48c003970 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb49e7fc640 1 -- 172.21.15.62:0/1825247981 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48802c8b0 con 0x7fb48c003970 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/1825247981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb48c003970 msgr2=0x7fb48c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/1825247981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb48c003970 0x7fb48c003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c2c0 tx=0x7fb48c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb49ffff640 1 -- 172.21.15.62:0/1825247981 reap_dead start 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/1825247981 shutdown_connections 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/1825247981 >> 172.21.15.62:0/1825247981 conn(0x7fb4a006a3b0 msgr2=0x7fb4a00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/1825247981 shutdown_connections 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.847+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/1825247981 wait complete. 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.848+0000 7fb4a5ea2640 1 Processor -- start 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.848+0000 7fb4a5ea2640 1 -- start start 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 0x7fb4a01f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 0x7fb4a00c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00aba00 con 0x7fb4a00c24a0 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a01f5be0 con 0x7fb48c003970 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb4a5ea2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a01f5ec0 con 0x7fb4a00ad2e0 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb49ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb49ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40156/0 (socket says 172.21.15.62:40156) 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb49ffff640 1 -- 172.21.15.62:0/934711701 learned_addr learned my addr 172.21.15.62:0/934711701 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 0x7fb4a01f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.849+0000 7fb49effd640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 0x7fb4a00c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 -- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 msgr2=0x7fb4a00c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 0x7fb4a00c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 -- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 msgr2=0x7fb4a01f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 0x7fb4a01f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 -- 172.21.15.62:0/934711701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a01f61a0 con 0x7fb4a00c24a0 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 0x7fb4a01f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49effd640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 0x7fb4a00c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb49ffff640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b0fe0 tx=0x7fb4980115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800e070 con 0x7fb4a00c24a0 2023-09-30T13:57:09.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498011e10 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a01f6480 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498003990 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.850+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a00ce990 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.851+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00abbb0 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.851+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb498003af0 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.852+0000 7fb497fff640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 0x7fb48006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.852+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fb4980897f0 con 0x7fb4a00c24a0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.852+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 0x7fb48006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:09.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.853+0000 7fb49f7fe640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 0x7fb48006cff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb488034000 tx=0x7fb488007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:09.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:09.856+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb4a00abbb0 con 0x7fb4a00c24a0 2023-09-30T13:57:10.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.036+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4a00cdd10 con 0x7fb4a00c24a0 2023-09-30T13:57:10.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.709+0000 7fb497fff640 1 -- 172.21.15.62:0/934711701 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb498058560 con 0x7fb4a00c24a0 2023-09-30T13:57:10.709 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-09-30T13:57:10.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.712+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 msgr2=0x7fb48006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.712+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 0x7fb48006cff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb488034000 tx=0x7fb488007000 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.712+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 msgr2=0x7fb4a00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.712+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b0fe0 tx=0x7fb4980115a0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 shutdown_connections 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb48006ab30 0x7fb48006cff0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4a00c24a0 0x7fb4a00ce450 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4a00ad2e0 0x7fb4a00c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 --2- 172.21.15.62:0/934711701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb48c003970 0x7fb4a01f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 >> 172.21.15.62:0/934711701 conn(0x7fb4a006a3b0 msgr2=0x7fb4a00af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 shutdown_connections 2023-09-30T13:57:10.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.713+0000 7fb4a5ea2640 1 -- 172.21.15.62:0/934711701 wait complete. 2023-09-30T13:57:10.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_cap_acquisition_throttle 2023-09-30T13:57:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.840+0000 7fb45f92c640 1 Processor -- start 2023-09-30T13:57:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.840+0000 7fb45f92c640 1 -- start start 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45f92c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4580d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45f92c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580d1410 con 0x7fb45815cbc0 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45f92c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580d16f0 con 0x7fb4580b8760 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45f92c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580d19d0 con 0x7fb4580cdfd0 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45d6c8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb45815cbc0 0x7fb4580d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57446/0 (socket says 172.21.15.62:57446) 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.841+0000 7fb45d6c8640 1 -- 172.21.15.62:0/3638702654 learned_addr learned my addr 172.21.15.62:0/3638702654 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45dec9640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4580d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204498606 0 0) 0x7fb4580d1410 con 0x7fb45815cbc0 2023-09-30T13:57:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003520 con 0x7fb45815cbc0 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509861954 0 0) 0x7fb440003520 con 0x7fb45815cbc0 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 msgr2=0x7fb4580d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4580d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 >> v1:172.21.15.135:6789/0 conn(0x7fb4580b8760 legacy=0x7fb4580cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580d1cb0 con 0x7fb45815cbc0 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb4480019f0 con 0x7fb45815cbc0 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 >> v1:172.21.15.62:6789/0 conn(0x7fb45815cbc0 legacy=0x7fb4580d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb440003ee0 0x7fb4400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440004d00 0x7fb440005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580d19d0 con 0x7fb440003ee0 2023-09-30T13:57:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000b9e0 con 0x7fb440004d00 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000bba0 con 0x7fb4580cdfd0 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb440003ee0 0x7fb4400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45d6c8640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45dec9640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440004d00 0x7fb440005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 -- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 msgr2=0x7fb4400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580cdfd0 0x7fb4400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 -- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440004d00 msgr2=0x7fb440005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440004d00 0x7fb440005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.842+0000 7fb45cec7640 1 -- 172.21.15.62:0/3638702654 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440003520 con 0x7fb440003ee0 2023-09-30T13:57:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.843+0000 7fb45cec7640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb440003ee0 0x7fb4400047c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001860 tx=0x7fb4400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c05bf298a7f326 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.843+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c032600 con 0x7fb440003ee0 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.843+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c02e050 con 0x7fb440003ee0 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.843+0000 7fb457fff640 1 -- 172.21.15.62:0/3638702654 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0329c0 con 0x7fb440003ee0 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 -- 172.21.15.62:0/3638702654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb440003ee0 msgr2=0x7fb4400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 --2- 172.21.15.62:0/3638702654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb440003ee0 0x7fb4400047c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001860 tx=0x7fb4400057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45dec9640 1 -- 172.21.15.62:0/3638702654 reap_dead start 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 -- 172.21.15.62:0/3638702654 shutdown_connections 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 -- 172.21.15.62:0/3638702654 >> 172.21.15.62:0/3638702654 conn(0x7fb4580718a0 msgr2=0x7fb458071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 -- 172.21.15.62:0/3638702654 shutdown_connections 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.844+0000 7fb45f92c640 1 -- 172.21.15.62:0/3638702654 wait complete. 2023-09-30T13:57:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.845+0000 7fb45f92c640 1 Processor -- start 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.845+0000 7fb45f92c640 1 -- start start 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440003ee0 0x7fb458155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580b5140 0x7fb4580b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581e7470 con 0x7fb4580b4ce0 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458156240 con 0x7fb440003ee0 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45f92c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581e6bd0 con 0x7fb4580b5140 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40174/0 (socket says 172.21.15.62:40174) 2023-09-30T13:57:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 -- 172.21.15.62:0/435402169 learned_addr learned my addr 172.21.15.62:0/435402169 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45d6c8640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440003ee0 0x7fb458155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45dec9640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580b5140 0x7fb4580b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 -- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580b5140 msgr2=0x7fb4580b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580b5140 0x7fb4580b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 -- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440003ee0 msgr2=0x7fb458155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440003ee0 0x7fb458155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 -- 172.21.15.62:0/435402169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4581e6eb0 con 0x7fb4580b4ce0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.846+0000 7fb45cec7640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb44c008fd0 tx=0x7fb44c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.847+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c007050 con 0x7fb4580b4ce0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.847+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0071b0 con 0x7fb4580b4ce0 2023-09-30T13:57:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.847+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c007540 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.847+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4581e7190 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.847+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4581e6760 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.848+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4581e5440 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.848+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb44c0067d0 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.849+0000 7fb455ffb640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 0x7fb44406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.849+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb44c0ab040 con 0x7fb4580b4ce0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.849+0000 7fb45d6c8640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 0x7fb44406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.850+0000 7fb45d6c8640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 0x7fb44406cff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb448002030 tx=0x7fb448006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:10.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:10.853+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb4581e5440 con 0x7fb4580b4ce0 2023-09-30T13:57:11.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.033+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"} v 0) v1 -- 0x7fb4581e5440 con 0x7fb4580b4ce0 2023-09-30T13:57:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.036+0000 7fb455ffb640 1 -- 172.21.15.62:0/435402169 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"}]=0 v13) v1 ==== 119+0+0 (secure 0 0 0) 0x7fb4581e5440 con 0x7fb4580b4ce0 2023-09-30T13:57:11.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 msgr2=0x7fb44406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 0x7fb44406cff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb448002030 tx=0x7fb448006040 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 msgr2=0x7fb4581e5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb44c008fd0 tx=0x7fb44c001230 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 shutdown_connections 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb44406ab30 0x7fb44406cff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb4580b5140 0x7fb4580b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4580b4ce0 0x7fb4581e5b00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 --2- 172.21.15.62:0/435402169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb440003ee0 0x7fb458155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 >> 172.21.15.62:0/435402169 conn(0x7fb4580718a0 msgr2=0x7fb45806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 shutdown_connections 2023-09-30T13:57:11.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.039+0000 7fb45f92c640 1 -- 172.21.15.62:0/435402169 wait complete. 2023-09-30T13:57:11.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2023-09-30T13:57:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.156+0000 7f137717c640 1 Processor -- start 2023-09-30T13:57:11.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.156+0000 7f137717c640 1 -- start start 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f137717c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13700d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f137717c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f13700b8760 0x7f13700d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f137717c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13700d1410 con 0x7f13700cd8c0 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f137717c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13700d16f0 con 0x7f13700b8760 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f137717c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13700d19d0 con 0x7f137015cbc0 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f1375719640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f13700cd8c0 0x7f13700b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57454/0 (socket says 172.21.15.62:57454) 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.157+0000 7f1375719640 1 -- 172.21.15.62:0/510376364 learned_addr learned my addr 172.21.15.62:0/510376364 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950467827 0 0) 0x7f13700d1410 con 0x7f13700cd8c0 2023-09-30T13:57:11.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358003520 con 0x7f13700cd8c0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13700d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136ffff640 1 --2- 172.21.15.62:0/510376364 >> v2:172.21.15.135:3300/0 conn(0x7f13700b8760 0x7f13700d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999633055 0 0) 0x7f1358003520 con 0x7f13700cd8c0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 msgr2=0x7f13700d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13700d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 >> v2:172.21.15.135:3300/0 conn(0x7f13700b8760 msgr2=0x7f13700d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 --2- 172.21.15.62:0/510376364 >> v2:172.21.15.135:3300/0 conn(0x7f13700b8760 0x7f13700d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700d1cb0 con 0x7f13700cd8c0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f1360001670 con 0x7f13700cd8c0 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136ffff640 1 --2- 172.21.15.62:0/510376364 >> v2:172.21.15.135:3300/0 conn(0x7f13700b8760 0x7f13700d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 >> v1:172.21.15.62:6789/0 conn(0x7f13700cd8c0 legacy=0x7f13700b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358004d00 0x7f1358005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700d16f0 con 0x7f1358003970 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700d19d0 con 0x7f1358004d00 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135800ba00 con 0x7f137015cbc0 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1375719640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358004d00 0x7f1358005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f136ffff640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 -- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 msgr2=0x7f13580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f137015cbc0 0x7f13580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 -- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358004d00 msgr2=0x7f1358005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.158+0000 7f1374f18640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358004d00 0x7f1358005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.159+0000 7f1374f18640 1 -- 172.21.15.62:0/510376364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358003520 con 0x7f1358003970 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.159+0000 7f1374f18640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1358003970 0x7f1358003d90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1368009fc0 tx=0x7f13580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fc333a0b5dee0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.159+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136802cc20 con 0x7f1358003970 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.159+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800f040 con 0x7f1358003970 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.159+0000 7f136f7fe640 1 -- 172.21.15.62:0/510376364 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368034440 con 0x7f1358003970 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 -- 172.21.15.62:0/510376364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1358003970 msgr2=0x7f1358003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 --2- 172.21.15.62:0/510376364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1358003970 0x7f1358003d90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1368009fc0 tx=0x7f13580057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f1375719640 1 -- 172.21.15.62:0/510376364 reap_dead start 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 -- 172.21.15.62:0/510376364 shutdown_connections 2023-09-30T13:57:11.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 -- 172.21.15.62:0/510376364 >> 172.21.15.62:0/510376364 conn(0x7f13700718a0 msgr2=0x7f1370071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 -- 172.21.15.62:0/510376364 shutdown_connections 2023-09-30T13:57:11.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.160+0000 7f137717c640 1 -- 172.21.15.62:0/510376364 wait complete. 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.161+0000 7f137717c640 1 Processor -- start 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.161+0000 7f137717c640 1 -- start start 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 0x7f13700c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370153e10 0x7f13700d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370154fa0 con 0x7f13701553c0 2023-09-30T13:57:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370154320 con 0x7f1370153e10 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f137717c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1370154600 con 0x7f1358003970 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40206/0 (socket says 172.21.15.62:40206) 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 -- 172.21.15.62:0/917657620 learned_addr learned my addr 172.21.15.62:0/917657620 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f1374f18640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 0x7f13700c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f1375719640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370153e10 0x7f13700d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 -- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 msgr2=0x7f13700c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 0x7f13700c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 -- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370153e10 msgr2=0x7f13700d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370153e10 0x7f13700d2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f136ffff640 1 -- 172.21.15.62:0/917657620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13701548e0 con 0x7f13701553c0 2023-09-30T13:57:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.162+0000 7f1374f18640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 0x7f13700c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f136ffff640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f13640116d0 tx=0x7f1364011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400c070 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364004220 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1370154bc0 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400f760 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.163+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13701533e0 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.164+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137004e0d0 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.164+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f136400f8c0 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.165+0000 7f136d7fa640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 0x7f135c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.165+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1364089040 con 0x7f13701553c0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.165+0000 7f1374f18640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 0x7f135c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.166+0000 7f1374f18640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 0x7f135c06cff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1368036000 tx=0x7f136802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.169+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f13640544e0 con 0x7f13701553c0 2023-09-30T13:57:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.344+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) v1 -- 0x7f13700d01a0 con 0x7f13701553c0 2023-09-30T13:57:11.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.349+0000 7f136d7fa640 1 -- 172.21.15.62:0/917657620 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v14) v1 ==== 106+0+0 (secure 0 0 0) 0x7f1364057b00 con 0x7f13701553c0 2023-09-30T13:57:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 msgr2=0x7f135c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 0x7f135c06cff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1368036000 tx=0x7f136802e000 comp rx=0 tx=0).stop 2023-09-30T13:57:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 msgr2=0x7f13701538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f13640116d0 tx=0x7f1364011b90 comp rx=0 tx=0).stop 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 shutdown_connections 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f135c06ab30 0x7f135c06cff0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370153e10 0x7f13700d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13701553c0 0x7f13701538d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.351+0000 7f137717c640 1 --2- 172.21.15.62:0/917657620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1358003970 0x7f13700c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.352+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 >> 172.21.15.62:0/917657620 conn(0x7f13700718a0 msgr2=0x7f1370158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.352+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 shutdown_connections 2023-09-30T13:57:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.352+0000 7f137717c640 1 -- 172.21.15.62:0/917657620 wait complete. 2023-09-30T13:57:11.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T13:57:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.474+0000 7f4f0851d640 1 Processor -- start 2023-09-30T13:57:11.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.474+0000 7f4f0851d640 1 -- start start 2023-09-30T13:57:11.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.475+0000 7f4f0851d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f00070770 0x7f4f0006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.475+0000 7f4f0851d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0015a3e0 con 0x7f4f00156b20 2023-09-30T13:57:11.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.475+0000 7f4f0851d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0015a100 con 0x7f4f00159480 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.475+0000 7f4f0851d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0006de80 con 0x7f4f00070770 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f05ab8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f00070770 0x7f4f0006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f062b9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f00156b20 0x7f4f00070060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57456/0 (socket says 172.21.15.62:57456) 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f062b9640 1 -- 172.21.15.62:0/1223333243 learned_addr learned my addr 172.21.15.62:0/1223333243 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f05ab8640 1 -- 172.21.15.62:0/1223333243 >> v1:172.21.15.135:6789/0 conn(0x7f4f00159480 legacy=0x7f4f001598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f05ab8640 1 -- 172.21.15.62:0/1223333243 >> v1:172.21.15.62:6789/0 conn(0x7f4f00156b20 legacy=0x7f4f00070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.476+0000 7f4f05ab8640 1 -- 172.21.15.62:0/1223333243 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0006c320 con 0x7f4f00070770 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f05ab8640 1 --2- 172.21.15.62:0/1223333243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00070770 0x7f4f0006ce00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40097a0 tx=0x7f4ef402c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7943d226c4c179 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f052b7640 1 -- 172.21.15.62:0/1223333243 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4031610 con 0x7f4f00070770 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f052b7640 1 -- 172.21.15.62:0/1223333243 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4031770 con 0x7f4f00070770 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f052b7640 1 -- 172.21.15.62:0/1223333243 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4031b00 con 0x7f4f00070770 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 -- 172.21.15.62:0/1223333243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00070770 msgr2=0x7f4f0006ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 --2- 172.21.15.62:0/1223333243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00070770 0x7f4f0006ce00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40097a0 tx=0x7f4ef402c950 comp rx=0 tx=0).stop 2023-09-30T13:57:11.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 -- 172.21.15.62:0/1223333243 shutdown_connections 2023-09-30T13:57:11.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 --2- 172.21.15.62:0/1223333243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00070770 0x7f4f0006ce00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 -- 172.21.15.62:0/1223333243 >> 172.21.15.62:0/1223333243 conn(0x7f4f000cb720 msgr2=0x7f4f000ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 -- 172.21.15.62:0/1223333243 shutdown_connections 2023-09-30T13:57:11.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.477+0000 7f4f0851d640 1 -- 172.21.15.62:0/1223333243 wait complete. 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 Processor -- start 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 -- start start 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f00070770 0x7f4f000acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 0x7f4f001e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001566f0 con 0x7f4f00156b20 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f00156410 con 0x7f4f00070770 2023-09-30T13:57:11.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f0851d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001e4b00 con 0x7f4f00159480 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f05ab8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f05ab8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40218/0 (socket says 172.21.15.62:40218) 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.479+0000 7f4f05ab8640 1 -- 172.21.15.62:0/3592432320 learned_addr learned my addr 172.21.15.62:0/3592432320 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f062b9640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f00070770 0x7f4f000acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f06aba640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 0x7f4f001e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 -- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 msgr2=0x7f4f001e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 0x7f4f001e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 -- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f00070770 msgr2=0x7f4f000acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f00070770 0x7f4f000acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 -- 172.21.15.62:0/3592432320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef4009400 con 0x7f4f00156b20 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f06aba640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 0x7f4f001e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f05ab8640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40098c0 tx=0x7f4ef4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4006e10 con 0x7f4f00156b20 2023-09-30T13:57:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef403ad10 con 0x7f4f00156b20 2023-09-30T13:57:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4044630 con 0x7f4f00156b20 2023-09-30T13:57:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f001e4de0 con 0x7f4f00156b20 2023-09-30T13:57:11.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.480+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f001e55e0 con 0x7f4f00156b20 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.481+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f001e5300 con 0x7f4f00156b20 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.481+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4ef404c360 con 0x7f4f00156b20 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.482+0000 7f4efeffd640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 0x7f4eec06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.482+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4ef40ab150 con 0x7f4f00156b20 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.482+0000 7f4f062b9640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 0x7f4eec06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.483+0000 7f4f062b9640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 0x7f4eec06cff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005880 tx=0x7f4ef8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.486+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4f001e5300 con 0x7f4f00156b20 2023-09-30T13:57:11.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.663+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4f001e5300 con 0x7f4f00156b20 2023-09-30T13:57:11.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.665+0000 7f4efeffd640 1 -- 172.21.15.62:0/3592432320 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f001e5300 con 0x7f4f00156b20 2023-09-30T13:57:11.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 msgr2=0x7f4eec06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 0x7f4eec06cff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8005880 tx=0x7f4ef8009040 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 msgr2=0x7f4f00155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40098c0 tx=0x7f4ef4004730 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 shutdown_connections 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4eec06ab30 0x7f4eec06cff0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f00159480 0x7f4f001e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00156b20 0x7f4f00155180 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 --2- 172.21.15.62:0/3592432320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f00070770 0x7f4f000acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 >> 172.21.15.62:0/3592432320 conn(0x7f4f000cb720 msgr2=0x7f4f000ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 shutdown_connections 2023-09-30T13:57:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.668+0000 7f4f0851d640 1 -- 172.21.15.62:0/3592432320 wait complete. 2023-09-30T13:57:11.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2023-09-30T13:57:11.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.785+0000 7f9a3661f640 1 Processor -- start 2023-09-30T13:57:11.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.785+0000 7f9a3661f640 1 -- start start 2023-09-30T13:57:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a3661f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a3661f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 0x7f9a300cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a3661f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3006ddf0 con 0x7f9a30158c20 2023-09-30T13:57:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a3661f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a300b1ea0 con 0x7f9a300caea0 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a3661f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300cb850 con 0x7f9a300cc210 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a2f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a34bbc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 0x7f9a300cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a2f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:52054/0 (socket says 172.21.15.62:52054) 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.786+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/3996601261 learned_addr learned my addr 172.21.15.62:0/3996601261 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/3996601261 >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 msgr2=0x7f9a300cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2f7fe640 1 --2- 172.21.15.62:0/3996601261 >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 0x7f9a300cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/3996601261 >> v1:172.21.15.135:6789/0 conn(0x7f9a30158c20 legacy=0x7f9a30159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/3996601261 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300cdf30 con 0x7f9a300cc210 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2effd640 1 -- 172.21.15.62:0/3996601261 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974570330 0 0) 0x7f9a3006ddf0 con 0x7f9a30158c20 2023-09-30T13:57:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a34bbc640 1 --2- 172.21.15.62:0/3996601261 >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 0x7f9a300cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.787+0000 7f9a2f7fe640 1 --2- 172.21.15.62:0/3996601261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009870 tx=0x7f9a2002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c22348ca2ffdf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a2effd640 1 -- 172.21.15.62:0/3996601261 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20030840 con 0x7f9a300cc210 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a2effd640 1 -- 172.21.15.62:0/3996601261 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200309a0 con 0x7f9a300cc210 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a2effd640 1 -- 172.21.15.62:0/3996601261 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20030d30 con 0x7f9a300cc210 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 -- 172.21.15.62:0/3996601261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 msgr2=0x7f9a300b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 --2- 172.21.15.62:0/3996601261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009870 tx=0x7f9a2002b980 comp rx=0 tx=0).stop 2023-09-30T13:57:11.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 -- 172.21.15.62:0/3996601261 shutdown_connections 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 --2- 172.21.15.62:0/3996601261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300cc210 0x7f9a300b22f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 --2- 172.21.15.62:0/3996601261 >> v2:172.21.15.135:3300/0 conn(0x7f9a300caea0 0x7f9a300cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 -- 172.21.15.62:0/3996601261 >> 172.21.15.62:0/3996601261 conn(0x7f9a3006a170 msgr2=0x7f9a3006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 -- 172.21.15.62:0/3996601261 shutdown_connections 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.788+0000 7f9a3661f640 1 -- 172.21.15.62:0/3996601261 wait complete. 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.789+0000 7f9a3661f640 1 Processor -- start 2023-09-30T13:57:11.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.789+0000 7f9a3661f640 1 -- start start 2023-09-30T13:57:11.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300caea0 0x7f9a300c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a30158c20 0x7f9a3006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300c6fe0 con 0x7f9a300cc210 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300afe80 con 0x7f9a30158c20 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a3661f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300c7e00 con 0x7f9a300caea0 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40226/0 (socket says 172.21.15.62:40226) 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.790+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/564058425 learned_addr learned my addr 172.21.15.62:0/564058425 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2ffff640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300caea0 0x7f9a300c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a34bbc640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a30158c20 0x7f9a3006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300caea0 msgr2=0x7f9a300c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300caea0 0x7f9a300c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a30158c20 msgr2=0x7f9a3006cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a30158c20 0x7f9a3006cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 -- 172.21.15.62:0/564058425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2800bc80 con 0x7f9a300cc210 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2f7fe640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9a20000c00 tx=0x7f9a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20039c90 con 0x7f9a300cc210 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20039e10 con 0x7f9a300cc210 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20043640 con 0x7f9a300cc210 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200094d0 con 0x7f9a300cc210 2023-09-30T13:57:11.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.791+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a300c74d0 con 0x7f9a300cc210 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.792+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300c7fb0 con 0x7f9a300cc210 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.793+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9a200437a0 con 0x7f9a300cc210 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.793+0000 7f9a2cff9640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 0x7f9a1c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.793+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9a2003e070 con 0x7f9a300cc210 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.793+0000 7f9a2ffff640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 0x7f9a1c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:11.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.794+0000 7f9a2ffff640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 0x7f9a1c06d020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9a24007fd0 tx=0x7f9a24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:11.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:11.797+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9a300c7fb0 con 0x7f9a300cc210 2023-09-30T13:57:12.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.040+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) v1 -- 0x7f9a300c7f70 con 0x7f9a300cc210 2023-09-30T13:57:12.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.723+0000 7f9a2cff9640 1 -- 172.21.15.62:0/564058425 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v142) v1 ==== 165+0+0 (secure 0 0 0) 0x7f9a200af030 con 0x7f9a300cc210 2023-09-30T13:57:12.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 msgr2=0x7f9a1c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 0x7f9a1c06d020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9a24007fd0 tx=0x7f9a24009040 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 msgr2=0x7f9a300af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9a20000c00 tx=0x7f9a20004730 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 shutdown_connections 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9a1c06ab60 0x7f9a1c06d020 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a30158c20 0x7f9a3006cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a300cc210 0x7f9a300af940 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 --2- 172.21.15.62:0/564058425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9a300caea0 0x7f9a300c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 >> 172.21.15.62:0/564058425 conn(0x7f9a3006a170 msgr2=0x7f9a3006be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 shutdown_connections 2023-09-30T13:57:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.726+0000 7f9a3661f640 1 -- 172.21.15.62:0/564058425 wait complete. 2023-09-30T13:57:12.739 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2023-09-30T13:57:12.739 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2023-09-30T13:57:12.739 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:57:12.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.852+0000 7f603d133640 1 Processor -- start 2023-09-30T13:57:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.852+0000 7f603d133640 1 -- start start 2023-09-30T13:57:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603d133640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f603815cbe0 0x7f60380d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603d133640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60380d0d00 0x7f60380d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603d133640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380d16a0 con 0x7f60380cd4e0 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603d133640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380cfcf0 con 0x7f60380d0d00 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603d133640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380cf450 con 0x7f603815cbe0 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60380d0d00 0x7f60380d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f60380d0d00 0x7f60380d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40236/0 (socket says 172.21.15.62:40236) 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.853+0000 7f603659c640 1 -- 172.21.15.62:0/1975193135 learned_addr learned my addr 172.21.15.62:0/1975193135 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f6036d9d640 1 --2- 172.21.15.62:0/1975193135 >> v2:172.21.15.135:3300/0 conn(0x7f603815cbe0 0x7f60380d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f603659c640 1 -- 172.21.15.62:0/1975193135 >> v2:172.21.15.135:3300/0 conn(0x7f603815cbe0 msgr2=0x7f60380d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f603659c640 1 --2- 172.21.15.62:0/1975193135 >> v2:172.21.15.135:3300/0 conn(0x7f603815cbe0 0x7f60380d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f603659c640 1 -- 172.21.15.62:0/1975193135 >> v1:172.21.15.135:6789/0 conn(0x7f60380cd4e0 legacy=0x7f60380cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f603659c640 1 -- 172.21.15.62:0/1975193135 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380cf730 con 0x7f60380d0d00 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.854+0000 7f603659c640 1 --2- 172.21.15.62:0/1975193135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60380d0d00 0x7f60380d1160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60380d2830 tx=0x7f602002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c9262dbaaeeb4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f6035d9b640 1 -- 172.21.15.62:0/1975193135 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020030860 con 0x7f60380d0d00 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f6035d9b640 1 -- 172.21.15.62:0/1975193135 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60200309c0 con 0x7f60380d0d00 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f6035d9b640 1 -- 172.21.15.62:0/1975193135 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020030d50 con 0x7f60380d0d00 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 -- 172.21.15.62:0/1975193135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60380d0d00 msgr2=0x7f60380d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 --2- 172.21.15.62:0/1975193135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60380d0d00 0x7f60380d1160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60380d2830 tx=0x7f602002b9a0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 -- 172.21.15.62:0/1975193135 shutdown_connections 2023-09-30T13:57:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 --2- 172.21.15.62:0/1975193135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f60380d0d00 0x7f60380d1160 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 --2- 172.21.15.62:0/1975193135 >> v2:172.21.15.135:3300/0 conn(0x7f603815cbe0 0x7f60380d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 -- 172.21.15.62:0/1975193135 >> 172.21.15.62:0/1975193135 conn(0x7f6038089fe0 msgr2=0x7f60380d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 -- 172.21.15.62:0/1975193135 shutdown_connections 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.855+0000 7f603d133640 1 -- 172.21.15.62:0/1975193135 wait complete. 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 Processor -- start 2023-09-30T13:57:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 -- start start 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60380cd4e0 0x7f603814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60380d0d00 0x7f60380cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380cc380 con 0x7f603815cbe0 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380cbae0 con 0x7f60380d0d00 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603d133640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380cbdc0 con 0x7f60380cd4e0 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.857+0000 7f603759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40242/0 (socket says 172.21.15.62:40242) 2023-09-30T13:57:12.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 -- 172.21.15.62:0/1364641752 learned_addr learned my addr 172.21.15.62:0/1364641752 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 -- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60380cd4e0 msgr2=0x7f603814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60380cd4e0 0x7f603814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 -- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60380d0d00 msgr2=0x7f60380cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60380d0d00 0x7f60380cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 -- 172.21.15.62:0/1364641752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200094d0 con 0x7f603815cbe0 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603759e640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f602800c780 tx=0x7f602800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028004b60 con 0x7f603815cbe0 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800ce90 con 0x7f603815cbe0 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60380cc0a0 con 0x7f603815cbe0 2023-09-30T13:57:12.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800a850 con 0x7f603815cbe0 2023-09-30T13:57:12.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.858+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60381f2210 con 0x7f603815cbe0 2023-09-30T13:57:12.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.859+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380b6360 con 0x7f603815cbe0 2023-09-30T13:57:12.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.859+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f602800a9b0 con 0x7f603815cbe0 2023-09-30T13:57:12.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.860+0000 7f602f7fe640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 0x7f601806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:12.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.860+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6028089290 con 0x7f603815cbe0 2023-09-30T13:57:12.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.860+0000 7f6036d9d640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 0x7f601806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:12.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.861+0000 7f6036d9d640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 0x7f601806cff0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6030006e20 tx=0x7f6030008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:12.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:12.864+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f60380b6360 con 0x7f603815cbe0 2023-09-30T13:57:13.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.040+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60380b6360 con 0x7f603815cbe0 2023-09-30T13:57:13.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.041+0000 7f602f7fe640 1 -- 172.21.15.62:0/1364641752 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13165 (secure 0 0 0) 0x7f60380b6360 con 0x7f603815cbe0 2023-09-30T13:57:13.041 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:13.041 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:10.708662+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6835/220613510":"2023-10-01T13:57:07.698283+0000","172.21.15.62:6833/220613510":"2023-10-01T13:57:07.698283+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 msgr2=0x7f601806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 0x7f601806cff0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6030006e20 tx=0x7f6030008040 comp rx=0 tx=0).stop 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 msgr2=0x7f60381f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f602800c780 tx=0x7f602800cc40 comp rx=0 tx=0).stop 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 shutdown_connections 2023-09-30T13:57:13.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f601806ab30 0x7f601806cff0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f603815cbe0 0x7f60381f1cd0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60380d0d00 0x7f60380cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 --2- 172.21.15.62:0/1364641752 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60380cd4e0 0x7f603814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 >> 172.21.15.62:0/1364641752 conn(0x7f6038089fe0 msgr2=0x7f60380b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 shutdown_connections 2023-09-30T13:57:13.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.043+0000 7f603d133640 1 -- 172.21.15.62:0/1364641752 wait complete. 2023-09-30T13:57:13.054 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:13.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:13.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.162+0000 7f6738b97640 1 Processor -- start 2023-09-30T13:57:13.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.162+0000 7f6738b97640 1 -- start start 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6738b97640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67340b0c40 0x7f67340b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6738b97640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673415b190 con 0x7f67340b4230 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6738b97640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673415b470 con 0x7f67340b2160 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6738b97640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673415afa0 con 0x7f67340b0c40 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6731d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67340b0c40 0x7f67340b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.163+0000 7f6732d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f67340b4230 0x7f6734070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57464/0 (socket says 172.21.15.62:57464) 2023-09-30T13:57:13.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.164+0000 7f6732d9d640 1 -- 172.21.15.62:0/2542758074 learned_addr learned my addr 172.21.15.62:0/2542758074 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.164+0000 7f6731d9b640 1 -- 172.21.15.62:0/2542758074 >> v1:172.21.15.135:6789/0 conn(0x7f67340b2160 legacy=0x7f67340b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.164+0000 7f6731d9b640 1 -- 172.21.15.62:0/2542758074 >> v1:172.21.15.62:6789/0 conn(0x7f67340b4230 legacy=0x7f6734070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.164+0000 7f6731d9b640 1 -- 172.21.15.62:0/2542758074 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673415b750 con 0x7f67340b0c40 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6731d9b640 1 --2- 172.21.15.62:0/2542758074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b0c40 0x7f67340b3cf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596cac5ff5a05613 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f673159a640 1 -- 172.21.15.62:0/2542758074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728030610 con 0x7f67340b0c40 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f673159a640 1 -- 172.21.15.62:0/2542758074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6728030770 con 0x7f67340b0c40 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f673159a640 1 -- 172.21.15.62:0/2542758074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728030b00 con 0x7f67340b0c40 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 -- 172.21.15.62:0/2542758074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b0c40 msgr2=0x7f67340b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 --2- 172.21.15.62:0/2542758074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b0c40 0x7f67340b3cf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802b960 comp rx=0 tx=0).stop 2023-09-30T13:57:13.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 -- 172.21.15.62:0/2542758074 shutdown_connections 2023-09-30T13:57:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 --2- 172.21.15.62:0/2542758074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b0c40 0x7f67340b3cf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 -- 172.21.15.62:0/2542758074 >> 172.21.15.62:0/2542758074 conn(0x7f67340cb720 msgr2=0x7f67340ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 -- 172.21.15.62:0/2542758074 shutdown_connections 2023-09-30T13:57:13.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.165+0000 7f6738b97640 1 -- 172.21.15.62:0/2542758074 wait complete. 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 Processor -- start 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 -- start start 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 0x7f67340a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 0x7f6734157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341578f0 con 0x7f67340b4230 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734157650 con 0x7f67340b2160 2023-09-30T13:57:13.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6738b97640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67341584e0 con 0x7f67340b0c40 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6732d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6732d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40262/0 (socket says 172.21.15.62:40262) 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.167+0000 7f6732d9d640 1 -- 172.21.15.62:0/553152057 learned_addr learned my addr 172.21.15.62:0/553152057 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6731d9b640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 0x7f6734157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f673259c640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 0x7f67340a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 -- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 msgr2=0x7f67340a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 0x7f67340a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 -- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 msgr2=0x7f6734157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 0x7f6734157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 -- 172.21.15.62:0/553152057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009400 con 0x7f67340b4230 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6731d9b640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 0x7f6734157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:13.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f673259c640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 0x7f67340a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6732d9d640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f672c00ca80 tx=0x7f672c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00ac30 con 0x7f67340b4230 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00ad90 con 0x7f67340b4230 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c012600 con 0x7f67340b4230 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67341587c0 con 0x7f67340b4230 2023-09-30T13:57:13.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.168+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734158d80 con 0x7f67340b4230 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.169+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6734158f70 con 0x7f67340b4230 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.170+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f672c007070 con 0x7f67340b4230 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.170+0000 7f6722ffd640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 0x7f671406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.170+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f672c088e90 con 0x7f67340b4230 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.170+0000 7f673259c640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 0x7f671406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.171+0000 7f673259c640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 0x7f671406cff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6724001680 tx=0x7f6724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.174+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f672c0542d0 con 0x7f67340b4230 2023-09-30T13:57:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.350+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f673404e0d0 con 0x7f67340b4230 2023-09-30T13:57:13.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.351+0000 7f6722ffd640 1 -- 172.21.15.62:0/553152057 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f672c0578f0 con 0x7f67340b4230 2023-09-30T13:57:13.351 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:13.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.352+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 msgr2=0x7f671406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.352+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 0x7f671406cff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6724001680 tx=0x7f6724009040 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.352+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 msgr2=0x7f673415ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.352+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f672c00ca80 tx=0x7f672c00cf40 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 shutdown_connections 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f671406ab30 0x7f671406cff0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67340b4230 0x7f673415ceb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67340b2160 0x7f6734157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 --2- 172.21.15.62:0/553152057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67340b0c40 0x7f67340a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 >> 172.21.15.62:0/553152057 conn(0x7f67340cb720 msgr2=0x7f67340ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:13.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 shutdown_connections 2023-09-30T13:57:13.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.353+0000 7f6738b97640 1 -- 172.21.15.62:0/553152057 wait complete. 2023-09-30T13:57:13.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2023-09-30T13:57:13.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.469+0000 7fc8222af640 1 Processor -- start 2023-09-30T13:57:13.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.469+0000 7fc8222af640 1 -- start start 2023-09-30T13:57:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc8222af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc81c0ce580 0x7fc81c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc8222af640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0ce0f0 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc8222af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0cd7c0 con 0x7fc81c160fa0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc8222af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0cdaa0 con 0x7fc81c0ce580 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc81bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc81c0d0eb0 0x7fc81c0d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57470/0 (socket says 172.21.15.62:57470) 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc81bfff640 1 -- 172.21.15.62:0/1421780712 learned_addr learned my addr 172.21.15.62:0/1421780712 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.470+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/1421780712 >> v2:172.21.15.135:3300/0 conn(0x7fc81c0ce580 0x7fc81c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101099251 0 0) 0x7fc81c0ce0f0 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc804003520 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991008221 0 0) 0x7fc804003520 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 >> v2:172.21.15.135:3300/0 conn(0x7fc81c0ce580 msgr2=0x7fc81c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 --2- 172.21.15.62:0/1421780712 >> v2:172.21.15.135:3300/0 conn(0x7fc81c0ce580 0x7fc81c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 >> v1:172.21.15.135:6789/0 conn(0x7fc81c160fa0 legacy=0x7fc81c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0cdd80 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fc810001670 con 0x7fc81c0d0eb0 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 >> v1:172.21.15.62:6789/0 conn(0x7fc81c0d0eb0 legacy=0x7fc81c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804003970 0x7fc804003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc804005180 0x7fc80400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cdaa0 con 0x7fc8040047c0 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80400c020 con 0x7fc804003970 2023-09-30T13:57:13.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80400c1e0 con 0x7fc804005180 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81bfff640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804003970 0x7fc804003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc82084c640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc804005180 0x7fc80400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 -- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc804005180 msgr2=0x7fc80400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc804005180 0x7fc80400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 -- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804003970 msgr2=0x7fc804003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804003970 0x7fc804003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc81b7fe640 1 -- 172.21.15.62:0/1421780712 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804003520 con 0x7fc8040047c0 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc82084c640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc804005180 0x7fc80400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.471+0000 7fc82084c640 1 -- 172.21.15.62:0/1421780712 reap_dead start 2023-09-30T13:57:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.472+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009a90 tx=0x7fc8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd6ec61f11938cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.472+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c02c680 con 0x7fc8040047c0 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.472+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c02c7e0 con 0x7fc8040047c0 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.472+0000 7fc81affd640 1 -- 172.21.15.62:0/1421780712 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c02cb90 con 0x7fc8040047c0 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 -- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 msgr2=0x7fc804004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009a90 tx=0x7fc8040057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 -- 172.21.15.62:0/1421780712 shutdown_connections 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 --2- 172.21.15.62:0/1421780712 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 -- 172.21.15.62:0/1421780712 >> 172.21.15.62:0/1421780712 conn(0x7fc81c089fe0 msgr2=0x7fc81c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 -- 172.21.15.62:0/1421780712 shutdown_connections 2023-09-30T13:57:13.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.473+0000 7fc8222af640 1 -- 172.21.15.62:0/1421780712 wait complete. 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.474+0000 7fc8222af640 1 Processor -- start 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.474+0000 7fc8222af640 1 -- start start 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8040047c0 0x7fc81c0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc81c0c63a0 0x7fc81c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b6880 con 0x7fc81c15acc0 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b5c00 con 0x7fc81c0c63a0 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc8222af640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b5ee0 con 0x7fc8040047c0 2023-09-30T13:57:13.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40278/0 (socket says 172.21.15.62:40278) 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 -- 172.21.15.62:0/3109152205 learned_addr learned my addr 172.21.15.62:0/3109152205 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc81b7fe640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc81c0c63a0 0x7fc81c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc81bfff640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8040047c0 0x7fc81c0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 -- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8040047c0 msgr2=0x7fc81c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8040047c0 0x7fc81c0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 -- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc81c0c63a0 msgr2=0x7fc81c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc81c0c63a0 0x7fc81c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.475+0000 7fc82084c640 1 -- 172.21.15.62:0/3109152205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0b61c0 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc82084c640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc81c161380 tx=0x7fc81400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400eed0 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814003970 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0b64a0 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814003d20 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.476+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c0b48c0 con 0x7fc81c15acc0 2023-09-30T13:57:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.477+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c04e0d0 con 0x7fc81c15acc0 2023-09-30T13:57:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.477+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc8140050d0 con 0x7fc81c15acc0 2023-09-30T13:57:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.478+0000 7fc818ff9640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 0x7fc80806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.478+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc814088bd0 con 0x7fc81c15acc0 2023-09-30T13:57:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.478+0000 7fc81bfff640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 0x7fc80806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.478+0000 7fc81bfff640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 0x7fc80806cff0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc810007c40 tx=0x7fc810009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:13.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.482+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc814053f50 con 0x7fc81c15acc0 2023-09-30T13:57:13.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:13.725+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) v1 -- 0x7fc81c0d0c90 con 0x7fc81c15acc0 2023-09-30T13:57:14.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.731+0000 7fc818ff9640 1 -- 172.21.15.62:0/3109152205 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v144) v1 ==== 165+0+0 (secure 0 0 0) 0x7fc814057570 con 0x7fc81c15acc0 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 msgr2=0x7fc80806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 0x7fc80806cff0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc810007c40 tx=0x7fc810009040 comp rx=0 tx=0).stop 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 msgr2=0x7fc81c0b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc81c161380 tx=0x7fc81400eb90 comp rx=0 tx=0).stop 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 shutdown_connections 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc80806ab30 0x7fc80806cff0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc81c15acc0 0x7fc81c0b4380 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc81c0c63a0 0x7fc81c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 --2- 172.21.15.62:0/3109152205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8040047c0 0x7fc81c0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 >> 172.21.15.62:0/3109152205 conn(0x7fc81c089fe0 msgr2=0x7fc81c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 shutdown_connections 2023-09-30T13:57:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.734+0000 7fc8222af640 1 -- 172.21.15.62:0/3109152205 wait complete. 2023-09-30T13:57:14.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-30T13:57:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.863+0000 7f35efd68640 1 Processor -- start 2023-09-30T13:57:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.863+0000 7f35efd68640 1 -- start start 2023-09-30T13:57:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35efd68640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35efd68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35efd68640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806ce00 con 0x7f35e815ab50 2023-09-30T13:57:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35efd68640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80c9850 con 0x7f35e80c9070 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35efd68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806d680 con 0x7f35e80c3de0 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35ed303640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35ee305640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35ed303640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:40500/0 (socket says 172.21.15.62:40500) 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35ed303640 1 -- 172.21.15.62:0/1971387165 learned_addr learned my addr 172.21.15.62:0/1971387165 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.864+0000 7f35edb04640 1 --1- 172.21.15.62:0/1971387165 >> v1:172.21.15.135:6789/0 conn(0x7f35e815ab50 0x7f35e8070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:46802/0 (socket says 172.21.15.62:46802) 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ee305640 1 -- 172.21.15.62:0/1971387165 >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 msgr2=0x7f35e80c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ee305640 1 --2- 172.21.15.62:0/1971387165 >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ee305640 1 -- 172.21.15.62:0/1971387165 >> v1:172.21.15.135:6789/0 conn(0x7f35e815ab50 legacy=0x7f35e8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ee305640 1 -- 172.21.15.62:0/1971387165 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80c9570 con 0x7f35e80c3de0 2023-09-30T13:57:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ed303640 1 --2- 172.21.15.62:0/1971387165 >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.865+0000 7f35ee305640 1 --2- 172.21.15.62:0/1971387165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e806db10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75e0cbba1b77092 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35ecb02640 1 -- 172.21.15.62:0/1971387165 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e002cc50 con 0x7f35e80c3de0 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35ecb02640 1 -- 172.21.15.62:0/1971387165 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e002cdb0 con 0x7f35e80c3de0 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35ecb02640 1 -- 172.21.15.62:0/1971387165 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0034660 con 0x7f35e80c3de0 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 -- 172.21.15.62:0/1971387165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 msgr2=0x7f35e806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 --2- 172.21.15.62:0/1971387165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e806db10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e002bea0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 -- 172.21.15.62:0/1971387165 shutdown_connections 2023-09-30T13:57:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 --2- 172.21.15.62:0/1971387165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e806db10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 --2- 172.21.15.62:0/1971387165 >> v2:172.21.15.135:3300/0 conn(0x7f35e80c9070 0x7f35e80c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 -- 172.21.15.62:0/1971387165 >> 172.21.15.62:0/1971387165 conn(0x7f35e80cb4a0 msgr2=0x7f35e80cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 -- 172.21.15.62:0/1971387165 shutdown_connections 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.866+0000 7f35efd68640 1 -- 172.21.15.62:0/1971387165 wait complete. 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.867+0000 7f35efd68640 1 Processor -- start 2023-09-30T13:57:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 -- start start 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e815ab50 0x7f35e80c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c67a0 con 0x7f35e80c9070 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c75d0 con 0x7f35e815ab50 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35efd68640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c6a50 con 0x7f35e80c3de0 2023-09-30T13:57:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35ed303640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35ed303640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40282/0 (socket says 172.21.15.62:40282) 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.868+0000 7f35ed303640 1 -- 172.21.15.62:0/3681135220 learned_addr learned my addr 172.21.15.62:0/3681135220 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ee305640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e815ab50 0x7f35e80c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35edb04640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 -- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 msgr2=0x7f35e814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 -- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e815ab50 msgr2=0x7f35e80c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e815ab50 0x7f35e80c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 -- 172.21.15.62:0/3681135220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80094d0 con 0x7f35e80c9070 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35ed303640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e9d0 tx=0x7f35d800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d800ca60 con 0x7f35e80c9070 2023-09-30T13:57:14.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d800cbc0 con 0x7f35e80c9070 2023-09-30T13:57:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8013470 con 0x7f35e80c9070 2023-09-30T13:57:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e0009a70 con 0x7f35e80c9070 2023-09-30T13:57:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.869+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e80c7010 con 0x7f35e80c9070 2023-09-30T13:57:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.870+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e804e0d0 con 0x7f35e80c9070 2023-09-30T13:57:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.871+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f35d80135d0 con 0x7f35e80c9070 2023-09-30T13:57:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.871+0000 7f35de7fc640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 0x7f35cc06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.871+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f35d80893a0 con 0x7f35e80c9070 2023-09-30T13:57:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.871+0000 7f35edb04640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 0x7f35cc06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.872+0000 7f35edb04640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 0x7f35cc06d020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:14.875+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f35d8054730 con 0x7f35e80c9070 2023-09-30T13:57:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.051+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35e806d000 con 0x7f35e80c9070 2023-09-30T13:57:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.057+0000 7f35de7fc640 1 -- 172.21.15.62:0/3681135220 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35d8057d50 con 0x7f35e80c9070 2023-09-30T13:57:15.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 msgr2=0x7f35cc06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 0x7f35cc06d020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4009040 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 msgr2=0x7f35e80c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e9d0 tx=0x7f35d800ee90 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 shutdown_connections 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f35cc06ab60 0x7f35cc06d020 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e815ab50 0x7f35e80c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e80c9070 0x7f35e80c5d20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 --2- 172.21.15.62:0/3681135220 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35e80c3de0 0x7f35e814b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 >> 172.21.15.62:0/3681135220 conn(0x7f35e80cb4a0 msgr2=0x7f35e80c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 shutdown_connections 2023-09-30T13:57:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.059+0000 7f35efd68640 1 -- 172.21.15.62:0/3681135220 wait complete. 2023-09-30T13:57:15.069 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T13:57:15.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:57:15.116 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:57:15.160 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T13:57:15.161 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:15.161 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:15.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:57:15.179 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:57:15.179 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:15.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:57:15.218 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:15.218 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:15.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:57:15.234 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:57:15.234 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:15.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:57:15.274 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-30T13:57:15.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.381+0000 7f9156290640 1 Processor -- start 2023-09-30T13:57:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.381+0000 7f9156290640 1 -- start start 2023-09-30T13:57:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f9156290640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91501598c0 0x7f91500ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f9156290640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91500cea30 0x7f91500ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f9156290640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91500b1e20 con 0x7f915015d520 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f9156290640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91500cf3e0 con 0x7f91500cea30 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f9156290640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91500b1530 con 0x7f91501598c0 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91500cea30 0x7f91500ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91500cea30 0x7f91500ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40294/0 (socket says 172.21.15.62:40294) 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 -- 172.21.15.62:0/2699675525 learned_addr learned my addr 172.21.15.62:0/2699675525 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914ffff640 1 --2- 172.21.15.62:0/2699675525 >> v2:172.21.15.135:3300/0 conn(0x7f91501598c0 0x7f91500ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 -- 172.21.15.62:0/2699675525 >> v2:172.21.15.135:3300/0 conn(0x7f91501598c0 msgr2=0x7f91500ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 --2- 172.21.15.62:0/2699675525 >> v2:172.21.15.135:3300/0 conn(0x7f91501598c0 0x7f91500ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 -- 172.21.15.62:0/2699675525 >> v1:172.21.15.135:6789/0 conn(0x7f915015d520 legacy=0x7f915015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.382+0000 7f914f7fe640 1 -- 172.21.15.62:0/2699675525 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500b17d0 con 0x7f91500cea30 2023-09-30T13:57:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f914f7fe640 1 --2- 172.21.15.62:0/2699675525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91500cea30 0x7f91500ceea0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f914400bb10 tx=0x7f914402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f68e537c1a84c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f914effd640 1 -- 172.21.15.62:0/2699675525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144036440 con 0x7f91500cea30 2023-09-30T13:57:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f914effd640 1 -- 172.21.15.62:0/2699675525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91440365a0 con 0x7f91500cea30 2023-09-30T13:57:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f914effd640 1 -- 172.21.15.62:0/2699675525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144036930 con 0x7f91500cea30 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f9156290640 1 -- 172.21.15.62:0/2699675525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91500cea30 msgr2=0x7f91500ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.383+0000 7f9156290640 1 --2- 172.21.15.62:0/2699675525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91500cea30 0x7f91500ceea0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f914400bb10 tx=0x7f914402e170 comp rx=0 tx=0).stop 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 -- 172.21.15.62:0/2699675525 shutdown_connections 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 --2- 172.21.15.62:0/2699675525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91500cea30 0x7f91500ceea0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 --2- 172.21.15.62:0/2699675525 >> v2:172.21.15.135:3300/0 conn(0x7f91501598c0 0x7f91500ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 -- 172.21.15.62:0/2699675525 >> 172.21.15.62:0/2699675525 conn(0x7f915006a170 msgr2=0x7f915006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 -- 172.21.15.62:0/2699675525 shutdown_connections 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.384+0000 7f9156290640 1 -- 172.21.15.62:0/2699675525 wait complete. 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.385+0000 7f9156290640 1 Processor -- start 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.385+0000 7f9156290640 1 -- start start 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91500cea30 0x7f9150154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 0x7f91500c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500adfa0 con 0x7f91501598c0 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500ae840 con 0x7f91500cea30 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9150157f30 con 0x7f915015d520 2023-09-30T13:57:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40296/0 (socket says 172.21.15.62:40296) 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 -- 172.21.15.62:0/668288270 learned_addr learned my addr 172.21.15.62:0/668288270 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914ffff640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91500cea30 0x7f9150154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f915482d640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 0x7f91500c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 -- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 msgr2=0x7f91500c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 0x7f91500c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 -- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91500cea30 msgr2=0x7f9150154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91500cea30 0x7f9150154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 -- 172.21.15.62:0/668288270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914400b770 con 0x7f91501598c0 2023-09-30T13:57:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f915482d640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 0x7f91500c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914f7fe640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f914402e1b0 tx=0x7f91440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144036440 con 0x7f91501598c0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9144034ba0 con 0x7f91501598c0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500ae1f0 con 0x7f91501598c0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144041440 con 0x7f91501598c0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.386+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9150157c20 con 0x7f91501598c0 2023-09-30T13:57:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.388+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9150158210 con 0x7f91501598c0 2023-09-30T13:57:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.388+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f914403d040 con 0x7f91501598c0 2023-09-30T13:57:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.388+0000 7f914cff9640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 0x7f913c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.388+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f91440add80 con 0x7f91501598c0 2023-09-30T13:57:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.389+0000 7f914ffff640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 0x7f913c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.389+0000 7f914ffff640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 0x7f913c06cff0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f91500c5050 tx=0x7f9140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.393+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9144079190 con 0x7f91501598c0 2023-09-30T13:57:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.605+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f915004e0d0 con 0x7f91501598c0 2023-09-30T13:57:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.605+0000 7f914cff9640 1 -- 172.21.15.62:0/668288270 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f9144045e90 con 0x7f91501598c0 2023-09-30T13:57:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:15.605 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1711497472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1711497472},{"type":"v1","addr":"172.21.15.135:6837","nonce":1711497472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/2575099445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2575099445},{"type":"v1","addr":"172.21.15.135:6836","nonce":2575099445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5526,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3628627345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3628627345},{"type":"v1","addr":"172.21.15.62:6834","nonce":3628627345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3038876610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3038876610},{"type":"v1","addr":"172.21.15.62:6835","nonce":3038876610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-09-30T13:57:15.606 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 18 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 msgr2=0x7f913c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 0x7f913c06cff0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f91500c5050 tx=0x7f9140008040 comp rx=0 tx=0).stop 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 msgr2=0x7f91501576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f914402e1b0 tx=0x7f91440046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 shutdown_connections 2023-09-30T13:57:15.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f913c06ab30 0x7f913c06cff0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f915015d520 0x7f91500c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91501598c0 0x7f91501576e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 --2- 172.21.15.62:0/668288270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91500cea30 0x7f9150154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 >> 172.21.15.62:0/668288270 conn(0x7f915006a170 msgr2=0x7f91500abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 shutdown_connections 2023-09-30T13:57:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.607+0000 7f9156290640 1 -- 172.21.15.62:0/668288270 wait complete. 2023-09-30T13:57:15.618 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T13:57:15.618 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-30T13:57:15.618 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T13:57:15.618 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:57:15.619 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T13:57:15.619 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-30T13:57:15.619 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T13:57:15.619 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:57:15.619 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T13:57:15.619 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-30T13:57:15.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T13:57:15.620 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:57:15.620 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-30T13:57:15.620 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-30T13:57:15.620 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T13:57:15.620 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:57:15.628 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T13:57:15.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T13:57:15.629 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T13:57:15.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T13:57:15.632 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T13:57:15.632 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T13:57:15.632 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T13:57:15.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-30T13:57:15.671 INFO:tasks.ceph.mds.a:Started 2023-09-30T13:57:15.671 DEBUG:teuthology.parallel:result is None 2023-09-30T13:57:15.671 INFO:tasks.ceph.mds.c:Started 2023-09-30T13:57:15.672 DEBUG:teuthology.parallel:result is None 2023-09-30T13:57:15.674 INFO:tasks.ceph.mds.b:Started 2023-09-30T13:57:15.674 DEBUG:teuthology.parallel:result is None 2023-09-30T13:57:15.675 INFO:tasks.ceph.mds.d:Started 2023-09-30T13:57:15.675 DEBUG:teuthology.parallel:result is None 2023-09-30T13:57:15.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-30T13:57:15.753 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-09-30T13:57:15.753 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-09-30T13:57:15.757 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-09-30T13:57:15.758 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-09-30T13:57:15.758 INFO:tasks.ceph.mds.d.smithi135.stderr:2023-09-30T13:57:15.759+0000 7f2ace9c6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-09-30T13:57:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.787+0000 7fa83610f640 1 Processor -- start 2023-09-30T13:57:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.787+0000 7fa83610f640 1 -- start start 2023-09-30T13:57:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa83610f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa830160160 0x7fa8300d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa83610f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8300d3600 0x7fa8300b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa83610f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300cda60 con 0x7fa8300b5cd0 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa83610f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300d18a0 con 0x7fa8300d3600 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa83610f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa830160540 con 0x7fa830160160 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.788+0000 7fa82effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8300d3600 0x7fa8300b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8300d3600 0x7fa8300b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40348/0 (socket says 172.21.15.62:40348) 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 -- 172.21.15.62:0/3758406511 learned_addr learned my addr 172.21.15.62:0/3758406511 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82f7fe640 1 --2- 172.21.15.62:0/3758406511 >> v2:172.21.15.135:3300/0 conn(0x7fa830160160 0x7fa8300d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 -- 172.21.15.62:0/3758406511 >> v2:172.21.15.135:3300/0 conn(0x7fa830160160 msgr2=0x7fa8300d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 --2- 172.21.15.62:0/3758406511 >> v2:172.21.15.135:3300/0 conn(0x7fa830160160 0x7fa8300d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 -- 172.21.15.62:0/3758406511 >> v1:172.21.15.135:6789/0 conn(0x7fa8300b5cd0 legacy=0x7fa8300cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.789+0000 7fa82effd640 1 -- 172.21.15.62:0/3758406511 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300cd450 con 0x7fa8300d3600 2023-09-30T13:57:15.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa82effd640 1 --2- 172.21.15.62:0/3758406511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300d3600 0x7fa8300b5790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa8300668a0 tx=0x7fa82402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93017f6842a3b00b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa82e7fc640 1 -- 172.21.15.62:0/3758406511 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402f850 con 0x7fa8300d3600 2023-09-30T13:57:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa82e7fc640 1 -- 172.21.15.62:0/3758406511 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82402f9b0 con 0x7fa8300d3600 2023-09-30T13:57:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa82e7fc640 1 -- 172.21.15.62:0/3758406511 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82402fd40 con 0x7fa8300d3600 2023-09-30T13:57:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 -- 172.21.15.62:0/3758406511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300d3600 msgr2=0x7fa8300b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 --2- 172.21.15.62:0/3758406511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300d3600 0x7fa8300b5790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa8300668a0 tx=0x7fa82402ba30 comp rx=0 tx=0).stop 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 -- 172.21.15.62:0/3758406511 shutdown_connections 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 --2- 172.21.15.62:0/3758406511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300d3600 0x7fa8300b5790 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 --2- 172.21.15.62:0/3758406511 >> v2:172.21.15.135:3300/0 conn(0x7fa830160160 0x7fa8300d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 -- 172.21.15.62:0/3758406511 >> 172.21.15.62:0/3758406511 conn(0x7fa830089fe0 msgr2=0x7fa8300d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 -- 172.21.15.62:0/3758406511 shutdown_connections 2023-09-30T13:57:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.790+0000 7fa83610f640 1 -- 172.21.15.62:0/3758406511 wait complete. 2023-09-30T13:57:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.791+0000 7fa83610f640 1 Processor -- start 2023-09-30T13:57:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 -- start start 2023-09-30T13:57:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8300d3600 0x7fa83009ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa830160160 0x7fa8300c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300ca4d0 con 0x7fa8300b5cd0 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300ca7b0 con 0x7fa8300d3600 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.792+0000 7fa83610f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300caa90 con 0x7fa830160160 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40352/0 (socket says 172.21.15.62:40352) 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 -- 172.21.15.62:0/2899072574 learned_addr learned my addr 172.21.15.62:0/2899072574 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82effd640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8300d3600 0x7fa83009ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82ffff640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa830160160 0x7fa8300c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 -- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa830160160 msgr2=0x7fa8300c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa830160160 0x7fa8300c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 -- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8300d3600 msgr2=0x7fa83009ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8300d3600 0x7fa83009ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 -- 172.21.15.62:0/2899072574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240094d0 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa82f7fe640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e9b0 tx=0x7fa82000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820009670 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000c9a0 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83015c150 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8301574d0 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.793+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000cd50 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.795+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830073e70 con 0x7fa8300b5cd0 2023-09-30T13:57:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.795+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa820013470 con 0x7fa8300b5cd0 2023-09-30T13:57:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.796+0000 7fa817fff640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 0x7fa81c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.796+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa820089220 con 0x7fa8300b5cd0 2023-09-30T13:57:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.796+0000 7fa82effd640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 0x7fa81c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.796+0000 7fa82effd640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 0x7fa81c06cff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa824036000 tx=0x7fa824008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.800+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa8200546f0 con 0x7fa8300b5cd0 2023-09-30T13:57:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:15.988+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa8300cfef0 con 0x7fa8300b5cd0 2023-09-30T13:57:17.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.431+0000 7fa817fff640 1 -- 172.21.15.62:0/2899072574 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa820057d10 con 0x7fa8300b5cd0 2023-09-30T13:57:17.431 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blocklist entries 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 msgr2=0x7fa81c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 0x7fa81c06cff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa824036000 tx=0x7fa824008030 comp rx=0 tx=0).stop 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 msgr2=0x7fa830156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e9b0 tx=0x7fa82000ee70 comp rx=0 tx=0).stop 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 shutdown_connections 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa81c06ab30 0x7fa81c06cff0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa830160160 0x7fa8300c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8300d3600 0x7fa83009ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 --2- 172.21.15.62:0/2899072574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8300b5cd0 0x7fa830156f90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 >> 172.21.15.62:0/2899072574 conn(0x7fa830089fe0 msgr2=0x7fa8300b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 shutdown_connections 2023-09-30T13:57:17.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.434+0000 7fa83610f640 1 -- 172.21.15.62:0/2899072574 wait complete. 2023-09-30T13:57:17.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-30T13:57:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.559+0000 7f4bfba44640 1 Processor -- start 2023-09-30T13:57:17.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.559+0000 7f4bfba44640 1 -- start start 2023-09-30T13:57:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bfba44640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bf41598c0 0x7f4bf40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bfba44640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4bf40ceea0 0x7f4bf415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bfba44640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf40b1e20 con 0x7f4bf40cea30 2023-09-30T13:57:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bfba44640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf40b1530 con 0x7f4bf41598c0 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bfba44640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf40b17d0 con 0x7f4bf40ceea0 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bf41598c0 0x7f4bf40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf8fdf640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4bf40cea30 0x7f4bf415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53522/0 (socket says 172.21.15.62:53522) 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bf41598c0 0x7f4bf40ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33170/0 (socket says 172.21.15.62:33170) 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf8fdf640 1 -- 172.21.15.62:0/970743044 learned_addr learned my addr 172.21.15.62:0/970743044 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf9fe1640 1 --2- 172.21.15.62:0/970743044 >> v2:172.21.15.135:3300/0 conn(0x7f4bf40ceea0 0x7f4bf415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 -- 172.21.15.62:0/970743044 >> v2:172.21.15.135:3300/0 conn(0x7f4bf40ceea0 msgr2=0x7f4bf415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 --2- 172.21.15.62:0/970743044 >> v2:172.21.15.135:3300/0 conn(0x7f4bf40ceea0 0x7f4bf415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 -- 172.21.15.62:0/970743044 >> v1:172.21.15.62:6789/0 conn(0x7f4bf40cea30 legacy=0x7f4bf415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bf97e0640 1 -- 172.21.15.62:0/970743044 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf40b1ab0 con 0x7f4bf41598c0 2023-09-30T13:57:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.560+0000 7f4bebfff640 1 -- 172.21.15.62:0/970743044 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459943342 0 0) 0x7f4bf40b1e20 con 0x7f4bf40cea30 2023-09-30T13:57:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.561+0000 7f4bf97e0640 1 --2- 172.21.15.62:0/970743044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf41598c0 0x7f4bf40ccc20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009790 tx=0x7f4bf002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f950595a2f12a79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.561+0000 7f4bebfff640 1 -- 172.21.15.62:0/970743044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0031830 con 0x7f4bf41598c0 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.561+0000 7f4bebfff640 1 -- 172.21.15.62:0/970743044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0031990 con 0x7f4bf41598c0 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.561+0000 7f4bebfff640 1 -- 172.21.15.62:0/970743044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0031d20 con 0x7f4bf41598c0 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 -- 172.21.15.62:0/970743044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf41598c0 msgr2=0x7f4bf40ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 --2- 172.21.15.62:0/970743044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf41598c0 0x7f4bf40ccc20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009790 tx=0x7f4bf002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 -- 172.21.15.62:0/970743044 shutdown_connections 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 --2- 172.21.15.62:0/970743044 >> v2:172.21.15.135:3300/0 conn(0x7f4bf40ceea0 0x7f4bf415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 --2- 172.21.15.62:0/970743044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf41598c0 0x7f4bf40ccc20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 -- 172.21.15.62:0/970743044 >> 172.21.15.62:0/970743044 conn(0x7f4bf406a170 msgr2=0x7f4bf406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 -- 172.21.15.62:0/970743044 shutdown_connections 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.562+0000 7f4bfba44640 1 -- 172.21.15.62:0/970743044 wait complete. 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.563+0000 7f4bfba44640 1 Processor -- start 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.563+0000 7f4bfba44640 1 -- start start 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bf40cea30 0x7f4bf4156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf41598c0 0x7f4bf40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4157280 con 0x7f4bf40ceea0 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4158a70 con 0x7f4bf41598c0 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bfba44640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41580a0 con 0x7f4bf40cea30 2023-09-30T13:57:17.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33174/0 (socket says 172.21.15.62:33174) 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 -- 172.21.15.62:0/3810928765 learned_addr learned my addr 172.21.15.62:0/3810928765 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf9fe1640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf41598c0 0x7f4bf40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf97e0640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bf40cea30 0x7f4bf4156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 -- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bf40cea30 msgr2=0x7f4bf4156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bf40cea30 0x7f4bf4156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 -- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf41598c0 msgr2=0x7f4bf40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf41598c0 0x7f4bf40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.564+0000 7f4bf8fdf640 1 -- 172.21.15.62:0/3810928765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00093a0 con 0x7f4bf40ceea0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4bf8fdf640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c500 tx=0x7f4be400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4007560 con 0x7f4bf40ceea0 2023-09-30T13:57:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40047e0 con 0x7f4bf40ceea0 2023-09-30T13:57:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf4157490 con 0x7f4bf40ceea0 2023-09-30T13:57:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4004b90 con 0x7f4bf40ceea0 2023-09-30T13:57:17.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.565+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf4157a50 con 0x7f4bf40ceea0 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.566+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf40b2290 con 0x7f4bf40ceea0 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.566+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4be4004cf0 con 0x7f4bf40ceea0 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.567+0000 7f4be9ffb640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 0x7f4bd806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.567+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4be4088380 con 0x7f4bf40ceea0 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.567+0000 7f4bf97e0640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 0x7f4bd806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.567+0000 7f4bf97e0640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 0x7f4bd806cff0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0036000 tx=0x7f4bf003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.571+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4bf40b2290 con 0x7f4bf40ceea0 2023-09-30T13:57:17.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.814+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4bf40b2290 con 0x7f4bf40ceea0 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.814+0000 7f4be9ffb640 1 -- 172.21.15.62:0/3810928765 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4bf40b2290 con 0x7f4bf40ceea0 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.814 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlxpAwJhAA9S96yMqtQkbHvOBPtH7FDQ==", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2023-09-30T13:57:17.815 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlwt1mMxAAofjPTwT8sJ6h6ZLq7/TL+Q==", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.c", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlnvIqLhAA9wCFwL4CWvsyndpi2EmT0g==", 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.816 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.d", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhleb65OhAAfneFfCzo7tFsfl5yQGo51A==", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:57:17.817 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBzKBhly/ZyJhAARwfNM6QjXO7wBi9+nBIkCQ==", 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB2KBhl96G/JRAAxiscRxTjKnlMCxKQPlgUKQ==", 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2023-09-30T13:57:17.819 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB5KBhl8vUpJRAACE+BodmpiCvUUCab7G/9CQ==", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQB8KBhlup4BJBAAa/xRihBaMU0E3jbIequ7+w==", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.820 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCCKBhldMiBKBAA4DVzsMmj+BvYOXB2Ru6nKg==", 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCFKBhl1KPEJhAArDc6YiyFATnvUAmfT6/+pQ==", 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.822 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCIKBhlAn3MJRAA0zhhsqrXFNWJOguc/5FKHQ==", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQCLKBhlA731IxAAOkK1g+EUEGh4FhLGqxqRbA==", 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.823 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ==", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow r", 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-09-30T13:57:17.824 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhlQ5EMCxAAzPZ3IeIR0UJAwlX3mZtKXA==", 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.825 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl4m9uBxAAGa9B6FqGeq+Wa8UIms5SSQ==", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.3", 2023-09-30T13:57:17.826 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBwKBhl7G7dEBAAlufHYOxr3XBzPYX1Z7L03w==", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlwZfiBxAAncD4peTWhuN5pf+B3LQP2A==", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:57:17.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhlS3lWIhAAiURVPGSV0bvLZYk/SlHvvg==", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.828 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBvKBhltKb8HRAATthRYp02RhUU2XOjqOo0Ug==", 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-09-30T13:57:17.829 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:57:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 msgr2=0x7f4bd806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 0x7f4bd806cff0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0036000 tx=0x7f4bf003c040 comp rx=0 tx=0).stop 2023-09-30T13:57:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 msgr2=0x7f4bf4158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c500 tx=0x7f4be400c9c0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 shutdown_connections 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4bd806ab30 0x7f4bd806cff0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bf41598c0 0x7f4bf40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bf40ceea0 0x7f4bf4158530 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 --2- 172.21.15.62:0/3810928765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4bf40cea30 0x7f4bf4156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 >> 172.21.15.62:0/3810928765 conn(0x7f4bf406a170 msgr2=0x7f4bf40cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 shutdown_connections 2023-09-30T13:57:17.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.816+0000 7f4bfba44640 1 -- 172.21.15.62:0/3810928765 wait complete. 2023-09-30T13:57:17.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:17.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.939+0000 7fc85d2a9640 1 Processor -- start 2023-09-30T13:57:17.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.939+0000 7fc85d2a9640 1 -- start start 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc85d2a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc85806bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc85d2a9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580d0b40 con 0x7fc8580d1410 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc85d2a9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580cf450 con 0x7fc85815cbe0 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc85d2a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580cfcf0 con 0x7fc8580d06b0 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc8567fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc8580d1410 0x7fc85806b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53526/0 (socket says 172.21.15.62:53526) 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc8567fc640 1 -- 172.21.15.62:0/243291880 learned_addr learned my addr 172.21.15.62:0/243291880 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.940+0000 7fc8577fe640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc85806bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916596362 0 0) 0x7fc840001110 con 0x7fc8580d1410 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc844003520 con 0x7fc8580d1410 2023-09-30T13:57:17.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539620739 0 0) 0x7fc844003520 con 0x7fc8580d1410 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 msgr2=0x7fc85806bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc85806bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 >> v1:172.21.15.135:6789/0 conn(0x7fc85815cbe0 legacy=0x7fc8580d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580cf730 con 0x7fc8580d1410 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fc840001800 con 0x7fc8580d1410 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 >> v1:172.21.15.62:6789/0 conn(0x7fc8580d1410 legacy=0x7fc85806b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440039a0 0x7fc844003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8440047c0 0x7fc844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc844005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580cfcf0 con 0x7fc8440047c0 2023-09-30T13:57:17.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84400bac0 con 0x7fc8440039a0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84400bc80 con 0x7fc8580d06b0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8440047c0 0x7fc844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc856ffd640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440039a0 0x7fc844003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8577fe640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc844005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 -- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 msgr2=0x7fc844005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580d06b0 0x7fc844005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 -- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440039a0 msgr2=0x7fc844003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440039a0 0x7fc844003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc8567fc640 1 -- 172.21.15.62:0/243291880 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844003520 con 0x7fc8440047c0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.941+0000 7fc856ffd640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440039a0 0x7fc844003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.942+0000 7fc8567fc640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8440047c0 0x7fc844004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c210 tx=0x7fc8440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9788321881a34b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.942+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840005ad0 con 0x7fc8440047c0 2023-09-30T13:57:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.942+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840005c50 con 0x7fc8440047c0 2023-09-30T13:57:17.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.942+0000 7fc855ffb640 1 -- 172.21.15.62:0/243291880 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84002c870 con 0x7fc8440047c0 2023-09-30T13:57:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 -- 172.21.15.62:0/243291880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8440047c0 msgr2=0x7fc844004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/243291880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8440047c0 0x7fc844004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c210 tx=0x7fc8440057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc8577fe640 1 -- 172.21.15.62:0/243291880 reap_dead start 2023-09-30T13:57:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 -- 172.21.15.62:0/243291880 shutdown_connections 2023-09-30T13:57:17.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 -- 172.21.15.62:0/243291880 >> 172.21.15.62:0/243291880 conn(0x7fc858089fe0 msgr2=0x7fc8580d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 -- 172.21.15.62:0/243291880 shutdown_connections 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.943+0000 7fc85d2a9640 1 -- 172.21.15.62:0/243291880 wait complete. 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.944+0000 7fc85d2a9640 1 Processor -- start 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.944+0000 7fc85d2a9640 1 -- start start 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440047c0 0x7fc858157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 0x7fc8580cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580ce450 con 0x7fc8580cc6a0 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8581f67f0 con 0x7fc8440047c0 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc85d2a9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580cbe30 con 0x7fc8580cda80 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33190/0 (socket says 172.21.15.62:33190) 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 -- 172.21.15.62:0/3429120692 learned_addr learned my addr 172.21.15.62:0/3429120692 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc856ffd640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440047c0 0x7fc858157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8577fe640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 0x7fc8580cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 -- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 msgr2=0x7fc8580cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 0x7fc8580cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 -- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440047c0 msgr2=0x7fc858157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440047c0 0x7fc858157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8567fc640 1 -- 172.21.15.62:0/3429120692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580cc0d0 con 0x7fc8580cc6a0 2023-09-30T13:57:17.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.945+0000 7fc8577fe640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 0x7fc8580cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc8567fc640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c330 tx=0x7fc840001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84003c040 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84002ca70 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8580cc3b0 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84002ce00 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.946+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580ccb30 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.947+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85804e0d0 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.947+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc840032070 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.948+0000 7fc84f7fe640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 0x7fc83806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.948+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc8400aa2b0 con 0x7fc8580cc6a0 2023-09-30T13:57:17.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.948+0000 7fc856ffd640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 0x7fc83806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.948+0000 7fc856ffd640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 0x7fc83806d020 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc850005490 tx=0x7fc850009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:17.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:17.952+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc840075710 con 0x7fc8580cc6a0 2023-09-30T13:57:18.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.127+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8580d0b40 con 0x7fc8580cc6a0 2023-09-30T13:57:18.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.128+0000 7fc84f7fe640 1 -- 172.21.15.62:0/3429120692 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fc8580d0b40 con 0x7fc8580cc6a0 2023-09-30T13:57:18.128 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:18.128 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":48,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:17.430260+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 msgr2=0x7fc83806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 0x7fc83806d020 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc850005490 tx=0x7fc850009040 comp rx=0 tx=0).stop 2023-09-30T13:57:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 msgr2=0x7fc8581f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c330 tx=0x7fc840001b90 comp rx=0 tx=0).stop 2023-09-30T13:57:18.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 shutdown_connections 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc83806ab60 0x7fc83806d020 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8580cda80 0x7fc8580cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8580cc6a0 0x7fc8581f62b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 --2- 172.21.15.62:0/3429120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440047c0 0x7fc858157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 >> 172.21.15.62:0/3429120692 conn(0x7fc858089fe0 msgr2=0x7fc8580b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 shutdown_connections 2023-09-30T13:57:18.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.130+0000 7fc85d2a9640 1 -- 172.21.15.62:0/3429120692 wait complete. 2023-09-30T13:57:18.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:18.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.250+0000 7f67d6e90640 1 Processor -- start 2023-09-30T13:57:18.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.250+0000 7f67d6e90640 1 -- start start 2023-09-30T13:57:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d6e90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 0x7f67d00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d6e90640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67d00b0a70 0x7f67d00b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d6e90640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d0071170 con 0x7f67d00b4230 2023-09-30T13:57:18.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d6e90640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d015afa0 con 0x7f67d00b0a70 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d6e90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00b0ef0 con 0x7f67d00b2160 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67cffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67d00b0a70 0x7f67d00b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67cffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67d00b0a70 0x7f67d00b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33202/0 (socket says 172.21.15.62:33202) 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67cffff640 1 -- 172.21.15.62:0/293047843 learned_addr learned my addr 172.21.15.62:0/293047843 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.251+0000 7f67d4c2c640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 0x7f67d00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cffff640 1 -- 172.21.15.62:0/293047843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 msgr2=0x7f67d00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cffff640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 0x7f67d00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cffff640 1 -- 172.21.15.62:0/293047843 >> v1:172.21.15.135:6789/0 conn(0x7f67d00b4230 legacy=0x7f67d015e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cffff640 1 -- 172.21.15.62:0/293047843 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d015b190 con 0x7f67d00b0a70 2023-09-30T13:57:18.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67d4c2c640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 0x7f67d00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cffff640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b0a70 0x7f67d00b3cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009870 tx=0x7f67c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9f891cd34b3f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.252+0000 7f67cf7fe640 1 -- 172.21.15.62:0/293047843 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4030840 con 0x7f67d00b0a70 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67cf7fe640 1 -- 172.21.15.62:0/293047843 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c40309a0 con 0x7f67d00b0a70 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67cf7fe640 1 -- 172.21.15.62:0/293047843 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4030d30 con 0x7f67d00b0a70 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 -- 172.21.15.62:0/293047843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b0a70 msgr2=0x7f67d00b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b0a70 0x7f67d00b3cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009870 tx=0x7f67c402b980 comp rx=0 tx=0).stop 2023-09-30T13:57:18.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 -- 172.21.15.62:0/293047843 shutdown_connections 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b0a70 0x7f67d00b3cf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 --2- 172.21.15.62:0/293047843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b2160 0x7f67d00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 -- 172.21.15.62:0/293047843 >> 172.21.15.62:0/293047843 conn(0x7f67d00cb720 msgr2=0x7f67d00ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 -- 172.21.15.62:0/293047843 shutdown_connections 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.253+0000 7f67d6e90640 1 -- 172.21.15.62:0/293047843 wait complete. 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.254+0000 7f67d6e90640 1 Processor -- start 2023-09-30T13:57:18.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.254+0000 7f67d6e90640 1 -- start start 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b0a70 0x7f67d00aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d00b4230 0x7f67d01f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00b0240 con 0x7f67d00b2160 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00af630 con 0x7f67d00b4230 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67d6e90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00af910 con 0x7f67d00b0a70 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67cffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33212/0 (socket says 172.21.15.62:33212) 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.255+0000 7f67cffff640 1 -- 172.21.15.62:0/455133091 learned_addr learned my addr 172.21.15.62:0/455133091 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 -- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b0a70 msgr2=0x7f67d00aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b0a70 0x7f67d00aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 -- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d00b4230 msgr2=0x7f67d01f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67d542d640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d00b4230 0x7f67d01f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d00b4230 0x7f67d01f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 -- 172.21.15.62:0/455133091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c40094d0 con 0x7f67d00b2160 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cffff640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000c00 tx=0x7f67c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4039a90 con 0x7f67d00b2160 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c4039bf0 con 0x7f67d00b2160 2023-09-30T13:57:18.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4043410 con 0x7f67d00b2160 2023-09-30T13:57:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d00afbf0 con 0x7f67d00b2160 2023-09-30T13:57:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.256+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d00af270 con 0x7f67d00b2160 2023-09-30T13:57:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.257+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d004e0d0 con 0x7f67d00b2160 2023-09-30T13:57:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.257+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f67c402f390 con 0x7f67d00b2160 2023-09-30T13:57:18.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.258+0000 7f67cd7fa640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 0x7f67bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.258+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f67c40ab240 con 0x7f67d00b2160 2023-09-30T13:57:18.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.258+0000 7f67d4c2c640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 0x7f67bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.258+0000 7f67d4c2c640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 0x7f67bc06cff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009f50 tx=0x7f67c80094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.262+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f67c4076610 con 0x7f67d00b2160 2023-09-30T13:57:18.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.436+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67d00cf110 con 0x7f67d00b2160 2023-09-30T13:57:18.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.436+0000 7f67cd7fa640 1 -- 172.21.15.62:0/455133091 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67c4079c30 con 0x7f67d00b2160 2023-09-30T13:57:18.437 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.438+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 msgr2=0x7f67bc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.438+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 0x7f67bc06cff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009f50 tx=0x7f67c80094a0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.438+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 msgr2=0x7f67d00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.438+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000c00 tx=0x7f67c4004730 comp rx=0 tx=0).stop 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 shutdown_connections 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f67bc06ab30 0x7f67bc06cff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d00b4230 0x7f67d01f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67d00b2160 0x7f67d00cd3f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 --2- 172.21.15.62:0/455133091 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d00b0a70 0x7f67d00aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 >> 172.21.15.62:0/455133091 conn(0x7f67d00cb720 msgr2=0x7f67d006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 shutdown_connections 2023-09-30T13:57:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.439+0000 7f67d6e90640 1 -- 172.21.15.62:0/455133091 wait complete. 2023-09-30T13:57:18.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T13:57:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.555+0000 7fb205c15640 1 Processor -- start 2023-09-30T13:57:18.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.555+0000 7fb205c15640 1 -- start start 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb205c15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb200165710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb205c15640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20006e3b0 con 0x7fb2000ce640 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb205c15640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000cbd00 con 0x7fb20015acc0 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb205c15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000cbfe0 con 0x7fb2000cf4e0 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb1feffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb2000ce640 0x7fb2000cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53534/0 (socket says 172.21.15.62:53534) 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb1feffd640 1 -- 172.21.15.62:0/2330546128 learned_addr learned my addr 172.21.15.62:0/2330546128 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:18.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.556+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430196486 0 0) 0x7fb20006e3b0 con 0x7fb2000ce640 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb200165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e8003520 con 0x7fb2000ce640 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292051627 0 0) 0x7fb1e8003520 con 0x7fb2000ce640 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 msgr2=0x7fb200165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb200165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 >> v1:172.21.15.135:6789/0 conn(0x7fb20015acc0 legacy=0x7fb2000cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000cc2c0 con 0x7fb2000ce640 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb1f4001670 con 0x7fb2000ce640 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 >> v1:172.21.15.62:6789/0 conn(0x7fb2000ce640 legacy=0x7fb2000cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb1e80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1e8003ee0 0x7fb1e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb1e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000cbfe0 con 0x7fb1e8004d00 2023-09-30T13:57:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800b9e0 con 0x7fb1e8003ee0 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e800bba0 con 0x7fb2000cf4e0 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb1e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1ff7fe640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb1e80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1feffd640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1e8003ee0 0x7fb1e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 -- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 msgr2=0x7fb1e80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000cf4e0 0x7fb1e80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 -- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1e8003ee0 msgr2=0x7fb1e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1e8003ee0 0x7fb1e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.557+0000 7fb1fffff640 1 -- 172.21.15.62:0/2330546128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8003520 con 0x7fb1e8004d00 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.558+0000 7fb1fffff640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb1e8005180 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2000cca80 tx=0x7fb1e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501059c902ad27d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.558+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f802cb90 con 0x7fb1e8004d00 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.558+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800f040 con 0x7fb1e8004d00 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.558+0000 7fb1fe7fc640 1 -- 172.21.15.62:0/2330546128 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8034440 con 0x7fb1e8004d00 2023-09-30T13:57:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 -- 172.21.15.62:0/2330546128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 msgr2=0x7fb1e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 --2- 172.21.15.62:0/2330546128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb1e8005180 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2000cca80 tx=0x7fb1e80057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb1fffff640 1 -- 172.21.15.62:0/2330546128 reap_dead start 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 -- 172.21.15.62:0/2330546128 shutdown_connections 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 -- 172.21.15.62:0/2330546128 >> 172.21.15.62:0/2330546128 conn(0x7fb200089fe0 msgr2=0x7fb2000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 -- 172.21.15.62:0/2330546128 shutdown_connections 2023-09-30T13:57:18.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.559+0000 7fb205c15640 1 -- 172.21.15.62:0/2330546128 wait complete. 2023-09-30T13:57:18.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.560+0000 7fb205c15640 1 Processor -- start 2023-09-30T13:57:18.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.560+0000 7fb205c15640 1 -- start start 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2000c64a0 0x7fb200152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000c4320 0x7fb200156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c6c10 con 0x7fb1e8004d00 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c6ef0 con 0x7fb2000c64a0 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb205c15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb200154ef0 con 0x7fb2000c4320 2023-09-30T13:57:18.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33222/0 (socket says 172.21.15.62:33222) 2023-09-30T13:57:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 -- 172.21.15.62:0/3588469203 learned_addr learned my addr 172.21.15.62:0/3588469203 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1fffff640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000c4320 0x7fb200156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1feffd640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2000c64a0 0x7fb200152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 -- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000c4320 msgr2=0x7fb200156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000c4320 0x7fb200156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 -- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2000c64a0 msgr2=0x7fb200152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2000c64a0 0x7fb200152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.561+0000 7fb1ff7fe640 1 -- 172.21.15.62:0/3588469203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2001551d0 con 0x7fb1e8004d00 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb1ff7fe640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000f7c0 tx=0x7fb1f000fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00050d0 con 0x7fb1e8004d00 2023-09-30T13:57:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0005250 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000c6920 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000d730 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.562+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb200154b10 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.563+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000cec40 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.563+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb1f000d890 con 0x7fb1e8004d00 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.564+0000 7fb1e7fff640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 0x7fb1ec06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.564+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb1f0088f70 con 0x7fb1e8004d00 2023-09-30T13:57:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.564+0000 7fb1feffd640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 0x7fb1ec06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.564+0000 7fb1feffd640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 0x7fb1ec06cff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb2000c7500 tx=0x7fb1f4001c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.568+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb1f00bbad0 con 0x7fb1e8004d00 2023-09-30T13:57:18.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.748+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb200154d00 con 0x7fb1e8004d00 2023-09-30T13:57:18.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.749+0000 7fb1e7fff640 1 -- 172.21.15.62:0/3588469203 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb1f0057e60 con 0x7fb1e8004d00 2023-09-30T13:57:18.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:18.749 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-09-30T13:57:18.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 msgr2=0x7fb1ec06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 0x7fb1ec06cff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb2000c7500 tx=0x7fb1f4001c20 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 msgr2=0x7fb2001e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000f7c0 tx=0x7fb1f000fbc0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 shutdown_connections 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb1ec06ab30 0x7fb1ec06cff0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2000c4320 0x7fb200156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2000c64a0 0x7fb200152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 --2- 172.21.15.62:0/3588469203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1e8004d00 0x7fb2001e4cf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 >> 172.21.15.62:0/3588469203 conn(0x7fb200089fe0 msgr2=0x7fb2001e1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 shutdown_connections 2023-09-30T13:57:18.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.751+0000 7fb205c15640 1 -- 172.21.15.62:0/3588469203 wait complete. 2023-09-30T13:57:18.761 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T13:57:18.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T13:57:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.872+0000 7f14b26e0640 1 Processor -- start 2023-09-30T13:57:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.872+0000 7f14b26e0640 1 -- start start 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.872+0000 7f14b26e0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 0x7f14ac159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b26e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 0x7f14ac15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b26e0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac15d2f0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b26e0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac15a090 con 0x7f14ac159770 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b26e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0cdd40 con 0x7f14ac0cc020 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14ab7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 0x7f14ac15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14abfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 0x7f14ac159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b0c7d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f14ac0cc4a0 0x7f14ac0c8aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35580/0 (socket says 172.21.15.62:35580) 2023-09-30T13:57:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14b0c7d640 1 -- 172.21.15.62:0/2753961521 learned_addr learned my addr 172.21.15.62:0/2753961521 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14ab7fe640 1 -- 172.21.15.62:0/2753961521 >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 msgr2=0x7f14ac159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14ab7fe640 1 --2- 172.21.15.62:0/2753961521 >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 0x7f14ac159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14ab7fe640 1 -- 172.21.15.62:0/2753961521 >> v1:172.21.15.135:6789/0 conn(0x7f14ac0cc4a0 legacy=0x7f14ac0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14ab7fe640 1 -- 172.21.15.62:0/2753961521 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac15a270 con 0x7f14ac0cc020 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14abfff640 1 --2- 172.21.15.62:0/2753961521 >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 0x7f14ac159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.873+0000 7f14aaffd640 1 -- 172.21.15.62:0/2753961521 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009217869 0 0) 0x7f14ac15d2f0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.874+0000 7f14ab7fe640 1 --2- 172.21.15.62:0/2753961521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 0x7f14ac15d7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f14a00097a0 tx=0x7f14a002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc04825a2804cbb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.874+0000 7f14aaffd640 1 -- 172.21.15.62:0/2753961521 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0031830 con 0x7f14ac0cc020 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.874+0000 7f14aaffd640 1 -- 172.21.15.62:0/2753961521 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0031990 con 0x7f14ac0cc020 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.874+0000 7f14aaffd640 1 -- 172.21.15.62:0/2753961521 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0031d20 con 0x7f14ac0cc020 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 -- 172.21.15.62:0/2753961521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 msgr2=0x7f14ac15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 --2- 172.21.15.62:0/2753961521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 0x7f14ac15d7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f14a00097a0 tx=0x7f14a002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 -- 172.21.15.62:0/2753961521 shutdown_connections 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 --2- 172.21.15.62:0/2753961521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac0cc020 0x7f14ac15d7d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 --2- 172.21.15.62:0/2753961521 >> v2:172.21.15.135:3300/0 conn(0x7f14ac159770 0x7f14ac159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 -- 172.21.15.62:0/2753961521 >> 172.21.15.62:0/2753961521 conn(0x7f14ac06a3b0 msgr2=0x7f14ac0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 -- 172.21.15.62:0/2753961521 shutdown_connections 2023-09-30T13:57:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.875+0000 7f14b26e0640 1 -- 172.21.15.62:0/2753961521 wait complete. 2023-09-30T13:57:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.876+0000 7f14b26e0640 1 Processor -- start 2023-09-30T13:57:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.876+0000 7f14b26e0640 1 -- start start 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ac0cc020 0x7f14ac1f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac159770 0x7f14ac0c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0b23b0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0ac550 con 0x7f14ac0cc020 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b26e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0ac830 con 0x7f14ac159770 2023-09-30T13:57:18.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33238/0 (socket says 172.21.15.62:33238) 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 -- 172.21.15.62:0/3765000520 learned_addr learned my addr 172.21.15.62:0/3765000520 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14b0c7d640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac159770 0x7f14ac0c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14abfff640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ac0cc020 0x7f14ac1f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 -- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac159770 msgr2=0x7f14ac0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac159770 0x7f14ac0c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 -- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ac0cc020 msgr2=0x7f14ac1f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ac0cc020 0x7f14ac1f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 -- 172.21.15.62:0/3765000520 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009400 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.877+0000 7f14ab7fe640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f14a00097a0 tx=0x7f14a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.878+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0004230 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.878+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0004390 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.878+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a0009400 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.878+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a003a870 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.878+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac0acdf0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.879+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac15a7e0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.879+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f14a003a9d0 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.880+0000 7f14a8ff9640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 0x7f149806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:18.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.880+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f14a00ab080 con 0x7f14ac0cc4a0 2023-09-30T13:57:18.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.880+0000 7f14abfff640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 0x7f149806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:18.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.881+0000 7f14abfff640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 0x7f149806cff0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f149c009cd0 tx=0x7f149c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:18.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:18.884+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f14a0076590 con 0x7f14ac0cc4a0 2023-09-30T13:57:19.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.058+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f14ac073e70 con 0x7f14ac0cc4a0 2023-09-30T13:57:19.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:57:19.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:57:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.745+0000 7f14a8ff9640 1 -- 172.21.15.62:0/3765000520 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f14a0079bb0 con 0x7f14ac0cc4a0 2023-09-30T13:57:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.748+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 msgr2=0x7f149806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.748+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 0x7f149806cff0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f149c009cd0 tx=0x7f149c009190 comp rx=0 tx=0).stop 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.748+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 msgr2=0x7f14ac0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.748+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f14a00097a0 tx=0x7f14a00046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.748+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 shutdown_connections 2023-09-30T13:57:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f149806ab30 0x7f149806cff0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14ac159770 0x7f14ac0c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14ac0cc4a0 0x7f14ac0c3f70 secure :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f14a00097a0 tx=0x7f14a00046c0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 --2- 172.21.15.62:0/3765000520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ac0cc020 0x7f14ac1f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 >> 172.21.15.62:0/3765000520 conn(0x7f14ac06a3b0 msgr2=0x7f14ac0af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 shutdown_connections 2023-09-30T13:57:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.749+0000 7f14b26e0640 1 -- 172.21.15.62:0/3765000520 wait complete. 2023-09-30T13:57:19.765 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T13:57:19.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.883+0000 7fdf22501640 1 Processor -- start 2023-09-30T13:57:19.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.883+0000 7fdf22501640 1 -- start start 2023-09-30T13:57:19.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf22501640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 0x7fdf1c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf22501640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf1c0c9570 0x7fdf1c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf22501640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c069df0 con 0x7fdf1c065dc0 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf22501640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0ce990 con 0x7fdf1c0c9570 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf22501640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c06a060 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf20a9e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf1c0c9570 0x7fdf1c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf1b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdf1c065dc0 0x7fdf1c06c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53538/0 (socket says 172.21.15.62:53538) 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.884+0000 7fdf1b7fe640 1 -- 172.21.15.62:0/1263527841 learned_addr learned my addr 172.21.15.62:0/1263527841 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/1263527841 >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 0x7fdf1c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf20a9e640 1 -- 172.21.15.62:0/1263527841 >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 msgr2=0x7fdf1c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf20a9e640 1 --2- 172.21.15.62:0/1263527841 >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 0x7fdf1c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf20a9e640 1 -- 172.21.15.62:0/1263527841 >> v1:172.21.15.62:6789/0 conn(0x7fdf1c065dc0 legacy=0x7fdf1c06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf1affd640 1 -- 172.21.15.62:0/1263527841 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207885015 0 0) 0x7fdf1c069df0 con 0x7fdf1c065dc0 2023-09-30T13:57:19.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf20a9e640 1 -- 172.21.15.62:0/1263527841 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c06a340 con 0x7fdf1c0c9570 2023-09-30T13:57:19.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/1263527841 >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 0x7fdf1c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:19.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.885+0000 7fdf20a9e640 1 --2- 172.21.15.62:0/1263527841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c06e000 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c073ee0 tx=0x7fdf1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b4e846d128e458 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf1affd640 1 -- 172.21.15.62:0/1263527841 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1402cc80 con 0x7fdf1c0c9570 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf1affd640 1 -- 172.21.15.62:0/1263527841 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1402cde0 con 0x7fdf1c0c9570 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf1affd640 1 -- 172.21.15.62:0/1263527841 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14034660 con 0x7fdf1c0c9570 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 -- 172.21.15.62:0/1263527841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c0c9570 msgr2=0x7fdf1c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 --2- 172.21.15.62:0/1263527841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c06e000 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c073ee0 tx=0x7fdf1402bed0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 -- 172.21.15.62:0/1263527841 shutdown_connections 2023-09-30T13:57:19.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 --2- 172.21.15.62:0/1263527841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c06e000 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 --2- 172.21.15.62:0/1263527841 >> v2:172.21.15.135:3300/0 conn(0x7fdf1c15ccf0 0x7fdf1c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 -- 172.21.15.62:0/1263527841 >> 172.21.15.62:0/1263527841 conn(0x7fdf1c0cb9a0 msgr2=0x7fdf1c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 -- 172.21.15.62:0/1263527841 shutdown_connections 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.886+0000 7fdf22501640 1 -- 172.21.15.62:0/1263527841 wait complete. 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.887+0000 7fdf22501640 1 Processor -- start 2023-09-30T13:57:19.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 -- start start 2023-09-30T13:57:19.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 0x7fdf1c09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c09fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c09ef90 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c09f3b0 con 0x7fdf1c0c9570 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf22501640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0a0230 con 0x7fdf1c065dc0 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf20a9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf20a9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33264/0 (socket says 172.21.15.62:33264) 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf20a9e640 1 -- 172.21.15.62:0/144138858 learned_addr learned my addr 172.21.15.62:0/144138858 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf1b7fe640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c09fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.888+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 0x7fdf1c09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 -- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 msgr2=0x7fdf1c09dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 0x7fdf1c09dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 -- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0c9570 msgr2=0x7fdf1c09fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c09fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 -- 172.21.15.62:0/144138858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009a70 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 0x7fdf1c09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf20a9e640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402c4e0 tx=0x7fdf14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1403e610 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1403e770 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c09e310 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1403eb20 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.889+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c09e8d0 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.890+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c09f0d0 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.891+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdf1403b050 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.891+0000 7fdf18ff9640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 0x7fdefc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.891+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fdf140ab880 con 0x7fdf1c15ccf0 2023-09-30T13:57:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.891+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 0x7fdefc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:19.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.892+0000 7fdf1bfff640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 0x7fdefc06cff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400aa30 tx=0x7fdf04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:19.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:19.896+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fdf1c09f0d0 con 0x7fdf1c15ccf0 2023-09-30T13:57:20.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.072+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf1c09f0d0 con 0x7fdf1c15ccf0 2023-09-30T13:57:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.747+0000 7fdf18ff9640 1 -- 172.21.15.62:0/144138858 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf1c09f0d0 con 0x7fdf1c15ccf0 2023-09-30T13:57:20.747 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-09-30T13:57:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.751+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 msgr2=0x7fdefc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.751+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 0x7fdefc06cff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400aa30 tx=0x7fdf04008040 comp rx=0 tx=0).stop 2023-09-30T13:57:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.751+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 msgr2=0x7fdf1c15e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.751+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdf1402c4e0 tx=0x7fdf14004a40 comp rx=0 tx=0).stop 2023-09-30T13:57:20.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 shutdown_connections 2023-09-30T13:57:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdefc06ab30 0x7fdefc06cff0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf1c15ccf0 0x7fdf1c15e880 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf1c0c9570 0x7fdf1c09fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 --2- 172.21.15.62:0/144138858 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf1c065dc0 0x7fdf1c09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.755+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 >> 172.21.15.62:0/144138858 conn(0x7fdf1c0cb9a0 msgr2=0x7fdf1c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:20.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.762+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 shutdown_connections 2023-09-30T13:57:20.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.762+0000 7fdf22501640 1 -- 172.21.15.62:0/144138858 wait complete. 2023-09-30T13:57:20.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T13:57:20.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.895+0000 7f33f9d5a640 1 Processor -- start 2023-09-30T13:57:20.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f9d5a640 1 -- start start 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f9d5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33f40b4400 0x7f33f4165970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f9d5a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f4071170 con 0x7f33f40b0c40 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f9d5a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f415b190 con 0x7f33f40b2160 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f9d5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f415afa0 con 0x7f33f40b4400 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.896+0000 7f33f2ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f33f40b0c40 0x7f33f40b3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53552/0 (socket says 172.21.15.62:53552) 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f2ffd640 1 -- 172.21.15.62:0/694320258 learned_addr learned my addr 172.21.15.62:0/694320258 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:20.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f3fff640 1 --2- 172.21.15.62:0/694320258 >> v2:172.21.15.135:3300/0 conn(0x7f33f40b4400 0x7f33f4165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352441250 0 0) 0x7f33e4001110 con 0x7f33f40b0c40 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e0003520 con 0x7f33f40b0c40 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411884065 0 0) 0x7f33e0003520 con 0x7f33f40b0c40 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 >> v2:172.21.15.135:3300/0 conn(0x7f33f40b4400 msgr2=0x7f33f4165970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 --2- 172.21.15.62:0/694320258 >> v2:172.21.15.135:3300/0 conn(0x7f33f40b4400 0x7f33f4165970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 >> v1:172.21.15.135:6789/0 conn(0x7f33f40b2160 legacy=0x7f33f40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f415b470 con 0x7f33f40b0c40 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f33e4001800 con 0x7f33f40b0c40 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 >> v1:172.21.15.62:6789/0 conn(0x7f33f40b0c40 legacy=0x7f33f40b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 0x7f33e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e00047c0 0x7f33e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0005180 0x7f33e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000bff0 con 0x7f33e0003970 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000c160 con 0x7f33e0005180 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000c320 con 0x7f33e00047c0 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f37fe640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 0x7f33e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f3fff640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0005180 0x7f33e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.897+0000 7f33f2ffd640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e00047c0 0x7f33e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 -- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e00047c0 msgr2=0x7f33e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33e00047c0 0x7f33e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 -- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0005180 msgr2=0x7f33e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0005180 0x7f33e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 -- 172.21.15.62:0/694320258 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0003520 con 0x7f33e0003970 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f3fff640 1 -- 172.21.15.62:0/694320258 reap_dead start 2023-09-30T13:57:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f37fe640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 0x7f33e0003d90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f33dc001750 tx=0x7f33e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211f386e8d0db66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0052d0 con 0x7f33e0003970 2023-09-30T13:57:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc02e050 con 0x7f33e0003970 2023-09-30T13:57:20.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.898+0000 7f33f27fc640 1 -- 172.21.15.62:0/694320258 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc003830 con 0x7f33e0003970 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 -- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 msgr2=0x7f33e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 0x7f33e0003d90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f33dc001750 tx=0x7f33e00057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 -- 172.21.15.62:0/694320258 shutdown_connections 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/694320258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33e0003970 0x7f33e0003d90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 -- 172.21.15.62:0/694320258 >> 172.21.15.62:0/694320258 conn(0x7f33f40cb720 msgr2=0x7f33f40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 -- 172.21.15.62:0/694320258 shutdown_connections 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.899+0000 7f33f9d5a640 1 -- 172.21.15.62:0/694320258 wait complete. 2023-09-30T13:57:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.900+0000 7f33f9d5a640 1 Processor -- start 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.900+0000 7f33f9d5a640 1 -- start start 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0003970 0x7f33f4142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 0x7f33f40aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40ad2a0 con 0x7f33f41f21e0 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41591e0 con 0x7f33e0003970 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f9d5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4143400 con 0x7f33f40acd20 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33288/0 (socket says 172.21.15.62:33288) 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f2ffd640 1 -- 172.21.15.62:0/2016614813 learned_addr learned my addr 172.21.15.62:0/2016614813 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f3fff640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 0x7f33f40aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.901+0000 7f33f37fe640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0003970 0x7f33f4142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 -- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 msgr2=0x7f33f40aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 0x7f33f40aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 -- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0003970 msgr2=0x7f33f4142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0003970 0x7f33f4142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 -- 172.21.15.62:0/2016614813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f41588b0 con 0x7f33f41f21e0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f3fff640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 0x7f33f40aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f2ffd640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33e400e760 tx=0x7f33e400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400c5e0 con 0x7f33f41f21e0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400c740 con 0x7f33f41f21e0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f4158b90 con 0x7f33f41f21e0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400caf0 con 0x7f33f41f21e0 2023-09-30T13:57:20.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.902+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40abaf0 con 0x7f33f41f21e0 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.903+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f404e0d0 con 0x7f33f41f21e0 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.903+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f33e400cc50 con 0x7f33f41f21e0 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.904+0000 7f33ebfff640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 0x7f33d406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.904+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f33e4088c00 con 0x7f33f41f21e0 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.904+0000 7f33f37fe640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 0x7f33d406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.905+0000 7f33f37fe640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 0x7f33d406d020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f33dc033000 tx=0x7f33dc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:20.908+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f33e408f080 con 0x7f33f41f21e0 2023-09-30T13:57:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.121+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f33f4071170 con 0x7f33f41f21e0 2023-09-30T13:57:21.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.771+0000 7f33ebfff640 1 -- 172.21.15.62:0/2016614813 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f33f4071170 con 0x7f33f41f21e0 2023-09-30T13:57:21.771 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 7 and data pool 8 2023-09-30T13:57:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.779+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 msgr2=0x7f33d406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.779+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 0x7f33d406d020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f33dc033000 tx=0x7f33dc009030 comp rx=0 tx=0).stop 2023-09-30T13:57:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.779+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 msgr2=0x7f33f40ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.779+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33e400e760 tx=0x7f33e400ec20 comp rx=0 tx=0).stop 2023-09-30T13:57:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.780+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 shutdown_connections 2023-09-30T13:57:21.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.780+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f33d406ab60 0x7f33d406d020 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.780+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33f40acd20 0x7f33f40aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.780+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33f41f21e0 0x7f33f40ac7e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.780+0000 7f33f9d5a640 1 --2- 172.21.15.62:0/2016614813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e0003970 0x7f33f4142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.781+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 >> 172.21.15.62:0/2016614813 conn(0x7f33f40cb720 msgr2=0x7f33f4070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.781+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 shutdown_connections 2023-09-30T13:57:21.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.781+0000 7f33f9d5a640 1 -- 172.21.15.62:0/2016614813 wait complete. 2023-09-30T13:57:21.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.912+0000 7fd965a90640 1 Processor -- start 2023-09-30T13:57:21.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.912+0000 7fd965a90640 1 -- start start 2023-09-30T13:57:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd965a90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd9600b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd965a90640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd9600b2940 0x7fd9600cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd965a90640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600b2e50 con 0x7fd9600cef70 2023-09-30T13:57:21.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd965a90640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600cf400 con 0x7fd9600b2940 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd965a90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600ac2d0 con 0x7fd9600cdc20 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9600cef70 0x7fd9600ab250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53556/0 (socket says 172.21.15.62:53556) 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95ffff640 1 -- 172.21.15.62:0/554608001 learned_addr learned my addr 172.21.15.62:0/554608001 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd9600b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95effd640 1 --2- 172.21.15.62:0/554608001 >> v2:172.21.15.135:3300/0 conn(0x7fd9600b2940 0x7fd9600cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929545252 0 0) 0x7fd9600b2e50 con 0x7fd9600cef70 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd948003520 con 0x7fd9600cef70 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197516684 0 0) 0x7fd948003520 con 0x7fd9600cef70 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 msgr2=0x7fd9600b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd9600b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 >> v2:172.21.15.135:3300/0 conn(0x7fd9600b2940 msgr2=0x7fd9600cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:21.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 --2- 172.21.15.62:0/554608001 >> v2:172.21.15.135:3300/0 conn(0x7fd9600b2940 0x7fd9600cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600cc340 con 0x7fd9600cef70 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd9580019f0 con 0x7fd9600cef70 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.913+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 >> v1:172.21.15.62:6789/0 conn(0x7fd9600cef70 legacy=0x7fd9600ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd948003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9480047c0 0x7fd948004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd948005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600cf400 con 0x7fd948003970 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600ac2d0 con 0x7fd9480047c0 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800b980 con 0x7fd9600cdc20 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd948003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95ffff640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd948005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95effd640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9480047c0 0x7fd948004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 -- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 msgr2=0x7fd948005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9600cdc20 0x7fd948005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 -- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9480047c0 msgr2=0x7fd948004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9480047c0 0x7fd948004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.914+0000 7fd95f7fe640 1 -- 172.21.15.62:0/554608001 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd948003520 con 0x7fd948003970 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd948003d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd950009ae0 tx=0x7fd9480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89966253b9f2fd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950005990 con 0x7fd948003970 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950005af0 con 0x7fd948003970 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd95e7fc640 1 -- 172.21.15.62:0/554608001 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950005ea0 con 0x7fd948003970 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 -- 172.21.15.62:0/554608001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 msgr2=0x7fd948003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 --2- 172.21.15.62:0/554608001 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd948003d90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd950009ae0 tx=0x7fd9480057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd95ffff640 1 -- 172.21.15.62:0/554608001 reap_dead start 2023-09-30T13:57:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 -- 172.21.15.62:0/554608001 shutdown_connections 2023-09-30T13:57:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 -- 172.21.15.62:0/554608001 >> 172.21.15.62:0/554608001 conn(0x7fd96006a170 msgr2=0x7fd96006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 -- 172.21.15.62:0/554608001 shutdown_connections 2023-09-30T13:57:21.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.915+0000 7fd965a90640 1 -- 172.21.15.62:0/554608001 wait complete. 2023-09-30T13:57:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.917+0000 7fd965a90640 1 Processor -- start 2023-09-30T13:57:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.917+0000 7fd965a90640 1 -- start start 2023-09-30T13:57:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.917+0000 7fd965a90640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.917+0000 7fd965a90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 0x7fd9600c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 0x7fd9600af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960154e50 con 0x7fd948003970 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960155130 con 0x7fd9600af020 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd960155410 con 0x7fd960155c10 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33312/0 (socket says 172.21.15.62:33312) 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 -- 172.21.15.62:0/3766506753 learned_addr learned my addr 172.21.15.62:0/3766506753 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95effd640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 0x7fd9600c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95ffff640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 0x7fd9600af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 -- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 msgr2=0x7fd9600c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 0x7fd9600c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 -- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 msgr2=0x7fd9600af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 0x7fd9600af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 -- 172.21.15.62:0/3766506753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9601556f0 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95effd640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 0x7fd9600c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95ffff640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 0x7fd9600af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd95f7fe640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd95002c250 tx=0x7fd950004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950005e70 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950004020 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd960154b40 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500043d0 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.918+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9600c8a90 con 0x7fd948003970 2023-09-30T13:57:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.919+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960155880 con 0x7fd948003970 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.920+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd950003610 con 0x7fd948003970 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.920+0000 7fd947fff640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 0x7fd94c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.920+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd9500ab510 con 0x7fd948003970 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.920+0000 7fd95effd640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 0x7fd94c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.921+0000 7fd95effd640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 0x7fd94c06d020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd960156010 tx=0x7fd954008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:21.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:21.925+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd9500766b0 con 0x7fd948003970 2023-09-30T13:57:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.104+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd960067f40 con 0x7fd948003970 2023-09-30T13:57:22.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.105+0000 7fd947fff640 1 -- 172.21.15.62:0/3766506753 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16763 (secure 0 0 0) 0x7fd950079cd0 con 0x7fd948003970 2023-09-30T13:57:22.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:22.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":51,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:21.122138+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 msgr2=0x7fd94c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 0x7fd94c06d020 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd960156010 tx=0x7fd954008040 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 msgr2=0x7fd9601f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd95002c250 tx=0x7fd950004730 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 shutdown_connections 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd94c06ab60 0x7fd94c06d020 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9600af020 0x7fd9600af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd960155c10 0x7fd9600c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 --2- 172.21.15.62:0/3766506753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd948003970 0x7fd9601f37f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 >> 172.21.15.62:0/3766506753 conn(0x7fd96006a170 msgr2=0x7fd96015a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 shutdown_connections 2023-09-30T13:57:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.107+0000 7fd965a90640 1 -- 172.21.15.62:0/3766506753 wait complete. 2023-09-30T13:57:22.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:22.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.223+0000 7f281eff5640 1 Processor -- start 2023-09-30T13:57:22.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.223+0000 7f281eff5640 1 -- start start 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281eff5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28180ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281eff5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28180cee70 0x7f281815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281eff5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180b1e20 con 0x7f28180cea30 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281eff5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180b1530 con 0x7f28180cee70 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281eff5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180b17d0 con 0x7f28181598c0 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281cd91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28180ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281d592640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28180cee70 0x7f281815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.224+0000 7f281cd91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28180ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:36784/0 (socket says 172.21.15.62:36784) 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f281cd91640 1 -- 172.21.15.62:0/4043129463 learned_addr learned my addr 172.21.15.62:0/4043129463 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f2817fff640 1 --1- 172.21.15.62:0/4043129463 >> v1:172.21.15.135:6789/0 conn(0x7f28180cea30 0x7f281815d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35600/0 (socket says 172.21.15.62:35600) 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f281d592640 1 -- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 msgr2=0x7f28180ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f281d592640 1 --2- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28180ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f281d592640 1 -- 172.21.15.62:0/4043129463 >> v1:172.21.15.135:6789/0 conn(0x7f28180cea30 legacy=0x7f281815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.225+0000 7f281d592640 1 -- 172.21.15.62:0/4043129463 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180b1ab0 con 0x7f28180cee70 2023-09-30T13:57:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281d592640 1 --2- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f281815dc30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2810009d90 tx=0x7f281002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35720991cddd3453 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f28177fe640 1 -- 172.21.15.62:0/4043129463 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281002cc50 con 0x7f28180cee70 2023-09-30T13:57:22.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f28177fe640 1 -- 172.21.15.62:0/4043129463 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281002cdb0 con 0x7f28180cee70 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f28177fe640 1 -- 172.21.15.62:0/4043129463 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810034660 con 0x7f28180cee70 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 -- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 msgr2=0x7f281815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 --2- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f281815dc30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2810009d90 tx=0x7f281002bea0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 -- 172.21.15.62:0/4043129463 shutdown_connections 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 --2- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f281815dc30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 --2- 172.21.15.62:0/4043129463 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28180ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 -- 172.21.15.62:0/4043129463 >> 172.21.15.62:0/4043129463 conn(0x7f281806a170 msgr2=0x7f281806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.226+0000 7f281eff5640 1 -- 172.21.15.62:0/4043129463 shutdown_connections 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.227+0000 7f281eff5640 1 -- 172.21.15.62:0/4043129463 wait complete. 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.228+0000 7f281eff5640 1 Processor -- start 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.228+0000 7f281eff5640 1 -- start start 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f28180c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28181f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180c3d50 con 0x7f28180cea30 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28181f26a0 con 0x7f28180cee70 2023-09-30T13:57:22.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281eff5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180c4b50 con 0x7f28181598c0 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33316/0 (socket says 172.21.15.62:33316) 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 -- 172.21.15.62:0/2742571592 learned_addr learned my addr 172.21.15.62:0/2742571592 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281d592640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28181f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f2817fff640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f28180c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 -- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 msgr2=0x7f28181f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28181f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 -- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 msgr2=0x7f28180c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f28180c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 -- 172.21.15.62:0/2742571592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810009a70 con 0x7f28180cea30 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f2817fff640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f28180c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.229+0000 7f281cd91640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e7d0 tx=0x7f280c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.230+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c009560 con 0x7f28180cea30 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.230+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2818155690 con 0x7f28180cea30 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.230+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c00c940 con 0x7f28180cea30 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.230+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c00eee0 con 0x7f28180cea30 2023-09-30T13:57:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.230+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28180c4220 con 0x7f28180cea30 2023-09-30T13:57:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.231+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281804e0d0 con 0x7f28180cea30 2023-09-30T13:57:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.231+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f280c00ccf0 con 0x7f28180cea30 2023-09-30T13:57:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.231+0000 7f28157fa640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 0x7f27fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.232+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f280c0897a0 con 0x7f28180cea30 2023-09-30T13:57:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.232+0000 7f2817fff640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 0x7f27fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.232+0000 7f2817fff640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 0x7f27fc06cff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2804007fd0 tx=0x7f2804007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.236+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f280c0548e0 con 0x7f28180cea30 2023-09-30T13:57:22.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.413+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28180b3410 con 0x7f28180cea30 2023-09-30T13:57:22.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.414+0000 7f28157fa640 1 -- 172.21.15.62:0/2742571592 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f280c057f00 con 0x7f28180cea30 2023-09-30T13:57:22.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:22.414 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":51,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:21.122138+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 msgr2=0x7f27fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 0x7f27fc06cff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2804007fd0 tx=0x7f2804007d40 comp rx=0 tx=0).stop 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 msgr2=0x7f28180c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e7d0 tx=0x7f280c00ec90 comp rx=0 tx=0).stop 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 shutdown_connections 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f27fc06ab30 0x7f27fc06cff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28181598c0 0x7f28181f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28180cee70 0x7f28180c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 --2- 172.21.15.62:0/2742571592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180cea30 0x7f28180c4fe0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 >> 172.21.15.62:0/2742571592 conn(0x7f281806a170 msgr2=0x7f28180ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 shutdown_connections 2023-09-30T13:57:22.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.416+0000 7f281eff5640 1 -- 172.21.15.62:0/2742571592 wait complete. 2023-09-30T13:57:22.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T13:57:22.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.536+0000 7f2f7fd41640 1 Processor -- start 2023-09-30T13:57:22.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.536+0000 7f2f7fd41640 1 -- start start 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f7815cb00 0x7f2f78071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 0x7f2f780c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f780ae300 0x7f2f7806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780c9a00 con 0x7f2f780ae300 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7806d740 con 0x7f2f7815cb00 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7fd41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806da20 con 0x7f2f7815cee0 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f780ae300 0x7f2f7806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f780ae300 0x7f2f7806ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33324/0 (socket says 172.21.15.62:33324) 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 -- 172.21.15.62:0/3981824521 learned_addr learned my addr 172.21.15.62:0/3981824521 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:22.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7dadd640 1 --2- 172.21.15.62:0/3981824521 >> v2:172.21.15.135:3300/0 conn(0x7f2f7815cb00 0x7f2f78071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7d2dc640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 0x7f2f780c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 -- 172.21.15.62:0/3981824521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 msgr2=0x7f2f780c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 0x7f2f780c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 -- 172.21.15.62:0/3981824521 >> v2:172.21.15.135:3300/0 conn(0x7f2f7815cb00 msgr2=0x7f2f78071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 --2- 172.21.15.62:0/3981824521 >> v2:172.21.15.135:3300/0 conn(0x7f2f7815cb00 0x7f2f78071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7e2de640 1 -- 172.21.15.62:0/3981824521 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7806dd00 con 0x7f2f780ae300 2023-09-30T13:57:22.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.537+0000 7f2f7d2dc640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 0x7f2f780c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7e2de640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f780ae300 0x7f2f7806ad60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f78066910 tx=0x7f2f7002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa93ac45dfda5a65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7cadb640 1 -- 172.21.15.62:0/3981824521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7002ca70 con 0x7f2f780ae300 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7cadb640 1 -- 172.21.15.62:0/3981824521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7002cbd0 con 0x7f2f780ae300 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7cadb640 1 -- 172.21.15.62:0/3981824521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700343f0 con 0x7f2f780ae300 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7fd41640 1 -- 172.21.15.62:0/3981824521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f780ae300 msgr2=0x7f2f7806ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.538+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f780ae300 0x7f2f7806ad60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f78066910 tx=0x7f2f7002bed0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 -- 172.21.15.62:0/3981824521 shutdown_connections 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f780ae300 0x7f2f7806ad60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/3981824521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f7815cee0 0x7f2f780c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/3981824521 >> v2:172.21.15.135:3300/0 conn(0x7f2f7815cb00 0x7f2f78071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 -- 172.21.15.62:0/3981824521 >> 172.21.15.62:0/3981824521 conn(0x7f2f78070970 msgr2=0x7f2f78070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 -- 172.21.15.62:0/3981824521 shutdown_connections 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.539+0000 7f2f7fd41640 1 -- 172.21.15.62:0/3981824521 wait complete. 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.540+0000 7f2f7fd41640 1 Processor -- start 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.540+0000 7f2f7fd41640 1 -- start start 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f780ae300 0x7f2f780c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7815cee0 0x7f2f78158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78158790 con 0x7f2f7815cb00 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c42e0 con 0x7f2f7815cee0 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780c45c0 con 0x7f2f780ae300 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33326/0 (socket says 172.21.15.62:33326) 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 -- 172.21.15.62:0/2200319686 learned_addr learned my addr 172.21.15.62:0/2200319686 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7dadd640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f780ae300 0x7f2f780c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 -- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f780ae300 msgr2=0x7f2f780c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f780ae300 0x7f2f780c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 -- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7815cee0 msgr2=0x7f2f78158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7815cee0 0x7f2f78158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 -- 172.21.15.62:0/2200319686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009b30 con 0x7f2f7815cb00 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7d2dc640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c7f0 tx=0x7f2f6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c007a30 con 0x7f2f7815cb00 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c007b90 con 0x7f2f7815cb00 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f780c48a0 con 0x7f2f7815cb00 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00ce40 con 0x7f2f7815cb00 2023-09-30T13:57:22.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.541+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f780c4e60 con 0x7f2f7815cb00 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.542+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f780666d0 con 0x7f2f7815cb00 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.543+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2f6c0113f0 con 0x7f2f7815cb00 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.543+0000 7f2f6a7fc640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 0x7f2f5c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.543+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f6c089470 con 0x7f2f7815cb00 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.543+0000 7f2f7dadd640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 0x7f2f5c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.544+0000 7f2f7dadd640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 0x7f2f5c06cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.547+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2f6c054580 con 0x7f2f7815cb00 2023-09-30T13:57:22.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.762+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2f780c5080 con 0x7f2f7815cb00 2023-09-30T13:57:22.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.770+0000 7f2f6a7fc640 1 -- 172.21.15.62:0/2200319686 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2f6c057ba0 con 0x7f2f7815cb00 2023-09-30T13:57:22.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 msgr2=0x7f2f5c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 0x7f2f5c06cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 msgr2=0x7f2f7815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c7f0 tx=0x7f2f6c00cbf0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 shutdown_connections 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2f5c06ab30 0x7f2f5c06cff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7815cee0 0x7f2f78158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f7815cb00 0x7f2f7815e780 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 --2- 172.21.15.62:0/2200319686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2f780ae300 0x7f2f780c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 >> 172.21.15.62:0/2200319686 conn(0x7f2f78070970 msgr2=0x7f2f780afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.772+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 shutdown_connections 2023-09-30T13:57:22.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.773+0000 7f2f7fd41640 1 -- 172.21.15.62:0/2200319686 wait complete. 2023-09-30T13:57:22.783 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T13:57:22.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T13:57:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.892+0000 7fdc6c44b640 1 Processor -- start 2023-09-30T13:57:22.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.892+0000 7fdc6c44b640 1 -- start start 2023-09-30T13:57:22.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6c44b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 0x7fdc640b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6c44b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 0x7fdc640b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6c44b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640af960 con 0x7fdc641599f0 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6c44b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6406c390 con 0x7fdc64159610 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6c44b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6406c670 con 0x7fdc640b0e60 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a1e7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 0x7fdc640b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a9e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 0x7fdc640b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc699e6640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fdc641599f0 0x7fdc640af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35612/0 (socket says 172.21.15.62:35612) 2023-09-30T13:57:22.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc699e6640 1 -- 172.21.15.62:0/709529676 learned_addr learned my addr 172.21.15.62:0/709529676 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a9e8640 1 -- 172.21.15.62:0/709529676 >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 msgr2=0x7fdc640b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a9e8640 1 --2- 172.21.15.62:0/709529676 >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 0x7fdc640b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a9e8640 1 -- 172.21.15.62:0/709529676 >> v1:172.21.15.135:6789/0 conn(0x7fdc641599f0 legacy=0x7fdc640af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a9e8640 1 -- 172.21.15.62:0/709529676 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6406c950 con 0x7fdc640b0e60 2023-09-30T13:57:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.893+0000 7fdc6a1e7640 1 --2- 172.21.15.62:0/709529676 >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 0x7fdc640b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.894+0000 7fdc6a9e8640 1 --2- 172.21.15.62:0/709529676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 0x7fdc640b02c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009d90 tx=0x7fdc5c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d026f5521ae5538 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.894+0000 7fdc691e5640 1 -- 172.21.15.62:0/709529676 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c02cbc0 con 0x7fdc640b0e60 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc691e5640 1 -- 172.21.15.62:0/709529676 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c02cd20 con 0x7fdc640b0e60 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc691e5640 1 -- 172.21.15.62:0/709529676 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c034660 con 0x7fdc640b0e60 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 -- 172.21.15.62:0/709529676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 msgr2=0x7fdc640b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/709529676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 0x7fdc640b02c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009d90 tx=0x7fdc5c02be10 comp rx=0 tx=0).stop 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 -- 172.21.15.62:0/709529676 shutdown_connections 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/709529676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc640b0e60 0x7fdc640b02c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/709529676 >> v2:172.21.15.135:3300/0 conn(0x7fdc64159610 0x7fdc640b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 -- 172.21.15.62:0/709529676 >> 172.21.15.62:0/709529676 conn(0x7fdc640cb720 msgr2=0x7fdc640ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 -- 172.21.15.62:0/709529676 shutdown_connections 2023-09-30T13:57:22.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.895+0000 7fdc6c44b640 1 -- 172.21.15.62:0/709529676 wait complete. 2023-09-30T13:57:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.896+0000 7fdc6c44b640 1 Processor -- start 2023-09-30T13:57:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.896+0000 7fdc6c44b640 1 -- start start 2023-09-30T13:57:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 0x7fdc64152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 0x7fdc64153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6414f9d0 con 0x7fdc640b0e60 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6414f6f0 con 0x7fdc641599f0 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6c44b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc641505a0 con 0x7fdc64159610 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6a1e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6a1e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33328/0 (socket says 172.21.15.62:33328) 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.897+0000 7fdc6a1e7640 1 -- 172.21.15.62:0/1478818825 learned_addr learned my addr 172.21.15.62:0/1478818825 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a9e8640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 0x7fdc64153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc699e6640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 0x7fdc64152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 -- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 msgr2=0x7fdc64152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 0x7fdc64152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 -- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 msgr2=0x7fdc64153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 0x7fdc64153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 -- 172.21.15.62:0/1478818825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60009400 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a9e8640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 0x7fdc64153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc699e6640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 0x7fdc64152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6a1e7640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000ebe0 tx=0x7fdc6000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60009760 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6000cc30 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c009a70 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6000eee0 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.898+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc64150b60 con 0x7fdc640b0e60 2023-09-30T13:57:22.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.899+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6404e0d0 con 0x7fdc640b0e60 2023-09-30T13:57:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.900+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdc60013470 con 0x7fdc640b0e60 2023-09-30T13:57:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.900+0000 7fdc5affd640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 0x7fdc4806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.900+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc600896e0 con 0x7fdc640b0e60 2023-09-30T13:57:22.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.901+0000 7fdc699e6640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 0x7fdc4806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.901+0000 7fdc699e6640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 0x7fdc4806cff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b4480 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:22.904+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fdc600547f0 con 0x7fdc640b0e60 2023-09-30T13:57:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.117+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc640cf170 con 0x7fdc640b0e60 2023-09-30T13:57:23.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.781+0000 7fdc5affd640 1 -- 172.21.15.62:0/1478818825 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc60057e10 con 0x7fdc640b0e60 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 msgr2=0x7fdc4806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 0x7fdc4806cff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b4480 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 msgr2=0x7fdc6414c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000ebe0 tx=0x7fdc6000c520 comp rx=0 tx=0).stop 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 shutdown_connections 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdc4806ab30 0x7fdc4806cff0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc641599f0 0x7fdc64153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc64159610 0x7fdc64152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 --2- 172.21.15.62:0/1478818825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc640b0e60 0x7fdc6414c060 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 >> 172.21.15.62:0/1478818825 conn(0x7fdc640cb720 msgr2=0x7fdc6406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 shutdown_connections 2023-09-30T13:57:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.783+0000 7fdc6c44b640 1 -- 172.21.15.62:0/1478818825 wait complete. 2023-09-30T13:57:23.796 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T13:57:23.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:23.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.909+0000 7f3edc141640 1 Processor -- start 2023-09-30T13:57:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.909+0000 7f3edc141640 1 -- start start 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3edc141640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3edc141640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ed40b2940 0x7f3ed40cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3edc141640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed40b2e50 con 0x7f3ed40cef70 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3edc141640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed40cf400 con 0x7f3ed40b2940 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3edc141640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40ac2d0 con 0x7f3ed40cdc20 2023-09-30T13:57:23.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ed40b2940 0x7f3ed40cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ed40b2940 0x7f3ed40cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33332/0 (socket says 172.21.15.62:33332) 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 -- 172.21.15.62:0/2838549064 learned_addr learned my addr 172.21.15.62:0/2838549064 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed9edd640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 -- 172.21.15.62:0/2838549064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 msgr2=0x7f3ed40b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 -- 172.21.15.62:0/2838549064 >> v1:172.21.15.135:6789/0 conn(0x7f3ed40cef70 legacy=0x7f3ed40ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.910+0000 7f3ed96dc640 1 -- 172.21.15.62:0/2838549064 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40cc340 con 0x7f3ed40b2940 2023-09-30T13:57:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.911+0000 7f3ed96dc640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40b2940 0x7f3ed40cea30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009870 tx=0x7f3ec402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd40ad434d6413a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.911+0000 7f3ed8edb640 1 -- 172.21.15.62:0/2838549064 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4031640 con 0x7f3ed40b2940 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.911+0000 7f3ed8edb640 1 -- 172.21.15.62:0/2838549064 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40317a0 con 0x7f3ed40b2940 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.911+0000 7f3ed8edb640 1 -- 172.21.15.62:0/2838549064 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4031b30 con 0x7f3ed40b2940 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 -- 172.21.15.62:0/2838549064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40b2940 msgr2=0x7f3ed40cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40b2940 0x7f3ed40cea30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009870 tx=0x7f3ec402b8f0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 -- 172.21.15.62:0/2838549064 shutdown_connections 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40b2940 0x7f3ed40cea30 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 --2- 172.21.15.62:0/2838549064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 -- 172.21.15.62:0/2838549064 >> 172.21.15.62:0/2838549064 conn(0x7f3ed406a170 msgr2=0x7f3ed406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 -- 172.21.15.62:0/2838549064 shutdown_connections 2023-09-30T13:57:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.912+0000 7f3edc141640 1 -- 172.21.15.62:0/2838549064 wait complete. 2023-09-30T13:57:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.913+0000 7f3edc141640 1 Processor -- start 2023-09-30T13:57:23.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.913+0000 7f3edc141640 1 -- start start 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ed40b2940 0x7f3ed40983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40c8cc0 con 0x7f3ed40cef70 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4098a20 con 0x7f3ed40b2940 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3edc141640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4098d00 con 0x7f3ed40cdc20 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33334/0 (socket says 172.21.15.62:33334) 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 -- 172.21.15.62:0/1676954393 learned_addr learned my addr 172.21.15.62:0/1676954393 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3ed96dc640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3ed9edd640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ed40b2940 0x7f3ed40983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 -- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 msgr2=0x7f3ed40c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 -- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ed40b2940 msgr2=0x7f3ed40983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ed40b2940 0x7f3ed40983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.914+0000 7f3eda6de640 1 -- 172.21.15.62:0/1676954393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40094d0 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3eda6de640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c7a0 tx=0x7f3ecc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc003b70 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc003cf0 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4098fe0 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc003ea0 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.915+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed40995a0 con 0x7f3ed40cef70 2023-09-30T13:57:23.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.916+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed404e0d0 con 0x7f3ed40cef70 2023-09-30T13:57:23.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.916+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3ecc00aa90 con 0x7f3ed40cef70 2023-09-30T13:57:23.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.917+0000 7f3eca7fc640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 0x7f3eb806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:23.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.917+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ecc089090 con 0x7f3ed40cef70 2023-09-30T13:57:23.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.917+0000 7f3ed9edd640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 0x7f3eb806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:23.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.917+0000 7f3ed9edd640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 0x7f3eb806cff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009b30 tx=0x7f3ed0009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:23.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:23.921+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3ecc054250 con 0x7f3ed40cef70 2023-09-30T13:57:24.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.136+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ed4099790 con 0x7f3ed40cef70 2023-09-30T13:57:24.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.136+0000 7f3eca7fc640 1 -- 172.21.15.62:0/1676954393 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3ecc057870 con 0x7f3ed40cef70 2023-09-30T13:57:24.136 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:24.136 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:57:23.118346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:57:24.137 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 22 2023-09-30T13:57:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 msgr2=0x7f3eb806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 0x7f3eb806cff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009b30 tx=0x7f3ed0009110 comp rx=0 tx=0).stop 2023-09-30T13:57:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 msgr2=0x7f3ed40c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c7a0 tx=0x7f3ecc00cc60 comp rx=0 tx=0).stop 2023-09-30T13:57:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 shutdown_connections 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3eb806ab30 0x7f3eb806cff0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed40cef70 0x7f3ed40c4250 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ed40cdc20 0x7f3ed40c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 --2- 172.21.15.62:0/1676954393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ed40b2940 0x7f3ed40983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 >> 172.21.15.62:0/1676954393 conn(0x7f3ed406a170 msgr2=0x7f3ed40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 shutdown_connections 2023-09-30T13:57:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.138+0000 7f3edc141640 1 -- 172.21.15.62:0/1676954393 wait complete. 2023-09-30T13:57:24.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:24.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.256+0000 7f6d54426640 1 Processor -- start 2023-09-30T13:57:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.256+0000 7f6d54426640 1 -- start start 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d54426640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 0x7f6d4c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d54426640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6d4c0b31c0 0x7f6d4c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d54426640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c15b9a0 con 0x7f6d4c0ace50 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d54426640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b2e50 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d54426640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0cc950 con 0x7f6d4c0cf140 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d519c1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 0x7f6d4c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d529c3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6d4c0b31c0 0x7f6d4c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d519c1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 0x7f6d4c0b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:36840/0 (socket says 172.21.15.62:36840) 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d521c2640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6d4c0ace50 0x7f6d4c0cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35632/0 (socket says 172.21.15.62:35632) 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.257+0000 7f6d519c1640 1 -- 172.21.15.62:0/1698346955 learned_addr learned my addr 172.21.15.62:0/1698346955 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d529c3640 1 -- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 msgr2=0x7f6d4c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d529c3640 1 --2- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 0x7f6d4c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d529c3640 1 -- 172.21.15.62:0/1698346955 >> v1:172.21.15.135:6789/0 conn(0x7f6d4c0ace50 legacy=0x7f6d4c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d529c3640 1 -- 172.21.15.62:0/1698346955 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c15add0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d511c0640 1 -- 172.21.15.62:0/1698346955 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466760903 0 0) 0x7f6d4c15b9a0 con 0x7f6d4c0ace50 2023-09-30T13:57:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.258+0000 7f6d529c3640 1 --2- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c0ccde0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009d90 tx=0x7f6d3c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd21eedc890cb06e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d511c0640 1 -- 172.21.15.62:0/1698346955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c02cbc0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d511c0640 1 -- 172.21.15.62:0/1698346955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c02cd20 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d511c0640 1 -- 172.21.15.62:0/1698346955 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c034660 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 -- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0b31c0 msgr2=0x7f6d4c0ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 --2- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c0ccde0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009d90 tx=0x7f6d3c02be10 comp rx=0 tx=0).stop 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 -- 172.21.15.62:0/1698346955 shutdown_connections 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 --2- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0cf140 0x7f6d4c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 --2- 172.21.15.62:0/1698346955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c0ccde0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 -- 172.21.15.62:0/1698346955 >> 172.21.15.62:0/1698346955 conn(0x7f6d4c06a170 msgr2=0x7f6d4c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 -- 172.21.15.62:0/1698346955 shutdown_connections 2023-09-30T13:57:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.259+0000 7f6d54426640 1 -- 172.21.15.62:0/1698346955 wait complete. 2023-09-30T13:57:24.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.260+0000 7f6d54426640 1 Processor -- start 2023-09-30T13:57:24.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.260+0000 7f6d54426640 1 -- start start 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0ace50 0x7f6d4c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0cf140 0x7f6d4c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c06dee0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c155e00 con 0x7f6d4c0cf140 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d54426640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c15f100 con 0x7f6d4c0ace50 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d519c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d519c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33350/0 (socket says 172.21.15.62:33350) 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.261+0000 7f6d519c1640 1 -- 172.21.15.62:0/1294775686 learned_addr learned my addr 172.21.15.62:0/1294775686 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d521c2640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0ace50 0x7f6d4c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d529c3640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0cf140 0x7f6d4c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 -- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0ace50 msgr2=0x7f6d4c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0ace50 0x7f6d4c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 -- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0cf140 msgr2=0x7f6d4c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0cf140 0x7f6d4c0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 -- 172.21.15.62:0/1294775686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009a70 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d519c1640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000e870 tx=0x7f6d4000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000c8e0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000ca40 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000cdf0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c14f6b0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.262+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c1557b0 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.263+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c155610 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.264+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6d40013470 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.264+0000 7f6d4affd640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 0x7f6d3806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.264+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6d40089470 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.264+0000 7f6d521c2640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 0x7f6d3806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.265+0000 7f6d521c2640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 0x7f6d3806cff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000fb0 tx=0x7f6d44007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.269+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6d4c155610 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.444+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4c155610 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.445+0000 7f6d4affd640 1 -- 172.21.15.62:0/1294775686 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f6d4c155610 con 0x7f6d4c0b31c0 2023-09-30T13:57:24.445 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:24.445 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":52,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:22.758333+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 msgr2=0x7f6d3806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 0x7f6d3806cff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000fb0 tx=0x7f6d44007b40 comp rx=0 tx=0).stop 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 msgr2=0x7f6d4c15e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000e870 tx=0x7f6d4000ed30 comp rx=0 tx=0).stop 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 shutdown_connections 2023-09-30T13:57:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f6d3806ab30 0x7f6d3806cff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d4c0cf140 0x7f6d4c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c0b31c0 0x7f6d4c15e560 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 --2- 172.21.15.62:0/1294775686 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d4c0ace50 0x7f6d4c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 >> 172.21.15.62:0/1294775686 conn(0x7f6d4c06a170 msgr2=0x7f6d4c0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 shutdown_connections 2023-09-30T13:57:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.447+0000 7f6d54426640 1 -- 172.21.15.62:0/1294775686 wait complete. 2023-09-30T13:57:24.457 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T13:57:24.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:57:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.564+0000 7f1881eec640 1 Processor -- start 2023-09-30T13:57:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.564+0000 7f1881eec640 1 -- start start 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f1881eec640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f187c0cf140 0x7f187c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f1881eec640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c0b1e20 con 0x7f187c1598c0 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f1881eec640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c0b1530 con 0x7f187c0c8c90 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f1881eec640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0b17d0 con 0x7f187c0cf140 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f187c0cf140 0x7f187c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f187c1598c0 0x7f187c0cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53564/0 (socket says 172.21.15.62:53564) 2023-09-30T13:57:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187b7fe640 1 -- 172.21.15.62:0/4034707440 learned_addr learned my addr 172.21.15.62:0/4034707440 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187affd640 1 -- 172.21.15.62:0/4034707440 >> v1:172.21.15.135:6789/0 conn(0x7f187c0c8c90 legacy=0x7f187c0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187affd640 1 -- 172.21.15.62:0/4034707440 >> v1:172.21.15.62:6789/0 conn(0x7f187c1598c0 legacy=0x7f187c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.565+0000 7f187affd640 1 -- 172.21.15.62:0/4034707440 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0b1ab0 con 0x7f187c0cf140 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.566+0000 7f187affd640 1 --2- 172.21.15.62:0/4034707440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0cf140 0x7f187c0ccc20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f18700097d0 tx=0x7f187002db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd270ad8480cda6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.566+0000 7f187a7fc640 1 -- 172.21.15.62:0/4034707440 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187002e920 con 0x7f187c0cf140 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.566+0000 7f187a7fc640 1 -- 172.21.15.62:0/4034707440 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187002ea80 con 0x7f187c0cf140 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.566+0000 7f187a7fc640 1 -- 172.21.15.62:0/4034707440 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187002ee10 con 0x7f187c0cf140 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 -- 172.21.15.62:0/4034707440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0cf140 msgr2=0x7f187c0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 --2- 172.21.15.62:0/4034707440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0cf140 0x7f187c0ccc20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f18700097d0 tx=0x7f187002db70 comp rx=0 tx=0).stop 2023-09-30T13:57:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 -- 172.21.15.62:0/4034707440 shutdown_connections 2023-09-30T13:57:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 --2- 172.21.15.62:0/4034707440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0cf140 0x7f187c0ccc20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 -- 172.21.15.62:0/4034707440 >> 172.21.15.62:0/4034707440 conn(0x7f187c06a170 msgr2=0x7f187c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 -- 172.21.15.62:0/4034707440 shutdown_connections 2023-09-30T13:57:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.567+0000 7f1881eec640 1 -- 172.21.15.62:0/4034707440 wait complete. 2023-09-30T13:57:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.568+0000 7f1881eec640 1 Processor -- start 2023-09-30T13:57:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.568+0000 7f1881eec640 1 -- start start 2023-09-30T13:57:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187c0cf140 0x7f187c1f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187c1598c0 0x7f187c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0aeb90 con 0x7f187c0c8c90 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0adfa0 con 0x7f187c1598c0 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f1881eec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0c7a30 con 0x7f187c0cf140 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33366/0 (socket says 172.21.15.62:33366) 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 -- 172.21.15.62:0/207519567 learned_addr learned my addr 172.21.15.62:0/207519567 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187affd640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187c0cf140 0x7f187c1f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187bfff640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187c1598c0 0x7f187c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 -- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187c0cf140 msgr2=0x7f187c1f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187c0cf140 0x7f187c1f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 -- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187c1598c0 msgr2=0x7f187c0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187c1598c0 0x7f187c0c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 -- 172.21.15.62:0/207519567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009400 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.569+0000 7f187b7fe640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c430 tx=0x7f186c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.570+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0074e0 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.570+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c007640 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.570+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c0ae1f0 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.570+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0059a0 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.570+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c0ae7b0 con 0x7f187c0c8c90 2023-09-30T13:57:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.571+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c06dfd0 con 0x7f187c0c8c90 2023-09-30T13:57:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.571+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f186c005bc0 con 0x7f187c0c8c90 2023-09-30T13:57:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.572+0000 7f1863fff640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 0x7f186806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.572+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f186c088890 con 0x7f187c0c8c90 2023-09-30T13:57:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.572+0000 7f187affd640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 0x7f186806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.572+0000 7f187affd640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 0x7f186806cff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1870038000 tx=0x7f1870032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.576+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f186c053b10 con 0x7f187c0c8c90 2023-09-30T13:57:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.747+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f187c0b22b0 con 0x7f186806ab30 2023-09-30T13:57:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.756+0000 7f1863fff640 1 -- 172.21.15.62:0/207519567 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289837 (secure 0 0 0) 0x7f18700364c0 con 0x7f186806ab30 2023-09-30T13:57:24.758 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:57:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 msgr2=0x7f186806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 0x7f186806cff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1870038000 tx=0x7f1870032000 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 msgr2=0x7f187c1f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c430 tx=0x7f186c00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 shutdown_connections 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f186806ab30 0x7f186806cff0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f187c1598c0 0x7f187c0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187c0cf140 0x7f187c1f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 --2- 172.21.15.62:0/207519567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f187c0c8c90 0x7f187c1f6380 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 >> 172.21.15.62:0/207519567 conn(0x7f187c06a170 msgr2=0x7f187c0c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 shutdown_connections 2023-09-30T13:57:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.759+0000 7f1881eec640 1 -- 172.21.15.62:0/207519567 wait complete. 2023-09-30T13:57:24.769 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-09-30T13:57:23.711091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226292,"kb_used_data":5944,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748428,"statfs":{"total":773094113280,"available":772862390272,"internally_reserved":0,"allocated":6086656,"data_stored":3318823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001052"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778331+0000","last_change":"2023-09-30T13:57:21.776787+0000","last_active":"2023-09-30T13:57:21.778331+0000","last_peered":"2023-09-30T13:57:21.778331+0000","last_clean":"2023-09-30T13:57:21.778331+0000","last_became_active":"2023-09-30T13:57:21.776487+0000","last_became_peered":"2023-09-30T13:57:21.776487+0000","last_unstale":"2023-09-30T13:57:21.778331+0000","last_undegraded":"2023-09-30T13:57:21.778331+0000","last_fullsized":"2023-09-30T13:57:21.778331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787347+0000","last_change":"2023-09-30T13:57:21.782406+0000","last_active":"2023-09-30T13:57:21.787347+0000","last_peered":"2023-09-30T13:57:21.787347+0000","last_clean":"2023-09-30T13:57:21.787347+0000","last_became_active":"2023-09-30T13:57:21.782087+0000","last_became_peered":"2023-09-30T13:57:21.782087+0000","last_unstale":"2023-09-30T13:57:21.787347+0000","last_undegraded":"2023-09-30T13:57:21.787347+0000","last_fullsized":"2023-09-30T13:57:21.787347+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782829+0000","last_change":"2023-09-30T13:57:21.776113+0000","last_active":"2023-09-30T13:57:21.782829+0000","last_peered":"2023-09-30T13:57:21.782829+0000","last_clean":"2023-09-30T13:57:21.782829+0000","last_became_active":"2023-09-30T13:57:21.774710+0000","last_became_peered":"2023-09-30T13:57:21.774710+0000","last_unstale":"2023-09-30T13:57:21.782829+0000","last_undegraded":"2023-09-30T13:57:21.782829+0000","last_fullsized":"2023-09-30T13:57:21.782829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787400+0000","last_change":"2023-09-30T13:57:21.784862+0000","last_active":"2023-09-30T13:57:21.787400+0000","last_peered":"2023-09-30T13:57:21.787400+0000","last_clean":"2023-09-30T13:57:21.787400+0000","last_became_active":"2023-09-30T13:57:21.784610+0000","last_became_peered":"2023-09-30T13:57:21.784610+0000","last_unstale":"2023-09-30T13:57:21.787400+0000","last_undegraded":"2023-09-30T13:57:21.787400+0000","last_fullsized":"2023-09-30T13:57:21.787400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781776+0000","last_change":"2023-09-30T13:57:21.777451+0000","last_active":"2023-09-30T13:57:21.781776+0000","last_peered":"2023-09-30T13:57:21.781776+0000","last_clean":"2023-09-30T13:57:21.781776+0000","last_became_active":"2023-09-30T13:57:21.777184+0000","last_became_peered":"2023-09-30T13:57:21.777184+0000","last_unstale":"2023-09-30T13:57:21.781776+0000","last_undegraded":"2023-09-30T13:57:21.781776+0000","last_fullsized":"2023-09-30T13:57:21.781776+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:54.004534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778367+0000","last_change":"2023-09-30T13:57:21.776129+0000","last_active":"2023-09-30T13:57:21.778367+0000","last_peered":"2023-09-30T13:57:21.778367+0000","last_clean":"2023-09-30T13:57:21.778367+0000","last_became_active":"2023-09-30T13:57:21.775838+0000","last_became_peered":"2023-09-30T13:57:21.775838+0000","last_unstale":"2023-09-30T13:57:21.778367+0000","last_undegraded":"2023-09-30T13:57:21.778367+0000","last_fullsized":"2023-09-30T13:57:21.778367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782920+0000","last_change":"2023-09-30T13:57:21.775885+0000","last_active":"2023-09-30T13:57:21.782920+0000","last_peered":"2023-09-30T13:57:21.782920+0000","last_clean":"2023-09-30T13:57:21.782920+0000","last_became_active":"2023-09-30T13:57:21.775195+0000","last_became_peered":"2023-09-30T13:57:21.775195+0000","last_unstale":"2023-09-30T13:57:21.782920+0000","last_undegraded":"2023-09-30T13:57:21.782920+0000","last_fullsized":"2023-09-30T13:57:21.782920+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.790657+0000","last_change":"2023-09-30T13:57:21.784510+0000","last_active":"2023-09-30T13:57:21.790657+0000","last_peered":"2023-09-30T13:57:21.790657+0000","last_clean":"2023-09-30T13:57:21.790657+0000","last_became_active":"2023-09-30T13:57:21.784207+0000","last_became_peered":"2023-09-30T13:57:21.784207+0000","last_unstale":"2023-09-30T13:57:21.790657+0000","last_undegraded":"2023-09-30T13:57:21.790657+0000","last_fullsized":"2023-09-30T13:57:21.790657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.789847+0000","last_change":"2023-09-30T13:57:21.785466+0000","last_active":"2023-09-30T13:57:21.789847+0000","last_peered":"2023-09-30T13:57:21.789847+0000","last_clean":"2023-09-30T13:57:21.789847+0000","last_became_active":"2023-09-30T13:57:21.784920+0000","last_became_peered":"2023-09-30T13:57:21.784920+0000","last_unstale":"2023-09-30T13:57:21.789847+0000","last_undegraded":"2023-09-30T13:57:21.789847+0000","last_fullsized":"2023-09-30T13:57:21.789847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:47:34.093615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771482+0000","last_change":"2023-09-30T13:57:21.767923+0000","last_active":"2023-09-30T13:57:21.771482+0000","last_peered":"2023-09-30T13:57:21.771482+0000","last_clean":"2023-09-30T13:57:21.771482+0000","last_became_active":"2023-09-30T13:57:21.767629+0000","last_became_peered":"2023-09-30T13:57:21.767629+0000","last_unstale":"2023-09-30T13:57:21.771482+0000","last_undegraded":"2023-09-30T13:57:21.771482+0000","last_fullsized":"2023-09-30T13:57:21.771482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784625+0000","last_change":"2023-09-30T13:57:21.779910+0000","last_active":"2023-09-30T13:57:21.784625+0000","last_peered":"2023-09-30T13:57:21.784625+0000","last_clean":"2023-09-30T13:57:21.784625+0000","last_became_active":"2023-09-30T13:57:21.779598+0000","last_became_peered":"2023-09-30T13:57:21.779598+0000","last_unstale":"2023-09-30T13:57:21.784625+0000","last_undegraded":"2023-09-30T13:57:21.784625+0000","last_fullsized":"2023-09-30T13:57:21.784625+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:04:02.616667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786015+0000","last_change":"2023-09-30T13:57:21.782729+0000","last_active":"2023-09-30T13:57:21.786015+0000","last_peered":"2023-09-30T13:57:21.786015+0000","last_clean":"2023-09-30T13:57:21.786015+0000","last_became_active":"2023-09-30T13:57:21.782425+0000","last_became_peered":"2023-09-30T13:57:21.782425+0000","last_unstale":"2023-09-30T13:57:21.786015+0000","last_undegraded":"2023-09-30T13:57:21.786015+0000","last_fullsized":"2023-09-30T13:57:21.786015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:30:22.286918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771170+0000","last_change":"2023-09-30T13:57:21.768156+0000","last_active":"2023-09-30T13:57:21.771170+0000","last_peered":"2023-09-30T13:57:21.771170+0000","last_clean":"2023-09-30T13:57:21.771170+0000","last_became_active":"2023-09-30T13:57:21.767769+0000","last_became_peered":"2023-09-30T13:57:21.767769+0000","last_unstale":"2023-09-30T13:57:21.771170+0000","last_undegraded":"2023-09-30T13:57:21.771170+0000","last_fullsized":"2023-09-30T13:57:21.771170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783064+0000","last_change":"2023-09-30T13:57:21.777387+0000","last_active":"2023-09-30T13:57:21.783064+0000","last_peered":"2023-09-30T13:57:21.783064+0000","last_clean":"2023-09-30T13:57:21.783064+0000","last_became_active":"2023-09-30T13:57:21.775094+0000","last_became_peered":"2023-09-30T13:57:21.775094+0000","last_unstale":"2023-09-30T13:57:21.783064+0000","last_undegraded":"2023-09-30T13:57:21.783064+0000","last_fullsized":"2023-09-30T13:57:21.783064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:47:34.093615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777517+0000","last_change":"2023-09-30T13:57:21.775353+0000","last_active":"2023-09-30T13:57:21.777517+0000","last_peered":"2023-09-30T13:57:21.777517+0000","last_clean":"2023-09-30T13:57:21.777517+0000","last_became_active":"2023-09-30T13:57:21.775102+0000","last_became_peered":"2023-09-30T13:57:21.775102+0000","last_unstale":"2023-09-30T13:57:21.777517+0000","last_undegraded":"2023-09-30T13:57:21.777517+0000","last_fullsized":"2023-09-30T13:57:21.777517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771149+0000","last_change":"2023-09-30T13:57:21.767483+0000","last_active":"2023-09-30T13:57:21.771149+0000","last_peered":"2023-09-30T13:57:21.771149+0000","last_clean":"2023-09-30T13:57:21.771149+0000","last_became_active":"2023-09-30T13:57:21.767198+0000","last_became_peered":"2023-09-30T13:57:21.767198+0000","last_unstale":"2023-09-30T13:57:21.771149+0000","last_undegraded":"2023-09-30T13:57:21.771149+0000","last_fullsized":"2023-09-30T13:57:21.771149+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:36.577612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786772+0000","last_change":"2023-09-30T13:57:21.780540+0000","last_active":"2023-09-30T13:57:21.786772+0000","last_peered":"2023-09-30T13:57:21.786772+0000","last_clean":"2023-09-30T13:57:21.786772+0000","last_became_active":"2023-09-30T13:57:21.780276+0000","last_became_peered":"2023-09-30T13:57:21.780276+0000","last_unstale":"2023-09-30T13:57:21.786772+0000","last_undegraded":"2023-09-30T13:57:21.786772+0000","last_fullsized":"2023-09-30T13:57:21.786772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787373+0000","last_change":"2023-09-30T13:57:21.783837+0000","last_active":"2023-09-30T13:57:21.787373+0000","last_peered":"2023-09-30T13:57:21.787373+0000","last_clean":"2023-09-30T13:57:21.787373+0000","last_became_active":"2023-09-30T13:57:21.782994+0000","last_became_peered":"2023-09-30T13:57:21.782994+0000","last_unstale":"2023-09-30T13:57:21.787373+0000","last_undegraded":"2023-09-30T13:57:21.787373+0000","last_fullsized":"2023-09-30T13:57:21.787373+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782851+0000","last_change":"2023-09-30T13:57:21.776463+0000","last_active":"2023-09-30T13:57:21.782851+0000","last_peered":"2023-09-30T13:57:21.782851+0000","last_clean":"2023-09-30T13:57:21.782851+0000","last_became_active":"2023-09-30T13:57:21.775916+0000","last_became_peered":"2023-09-30T13:57:21.775916+0000","last_unstale":"2023-09-30T13:57:21.782851+0000","last_undegraded":"2023-09-30T13:57:21.782851+0000","last_fullsized":"2023-09-30T13:57:21.782851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:59:08.602906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782339+0000","last_change":"2023-09-30T13:57:21.779344+0000","last_active":"2023-09-30T13:57:21.782339+0000","last_peered":"2023-09-30T13:57:21.782339+0000","last_clean":"2023-09-30T13:57:21.782339+0000","last_became_active":"2023-09-30T13:57:21.779051+0000","last_became_peered":"2023-09-30T13:57:21.779051+0000","last_unstale":"2023-09-30T13:57:21.782339+0000","last_undegraded":"2023-09-30T13:57:21.782339+0000","last_fullsized":"2023-09-30T13:57:21.782339+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:47.423524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782152+0000","last_change":"2023-09-30T13:57:21.777964+0000","last_active":"2023-09-30T13:57:21.782152+0000","last_peered":"2023-09-30T13:57:21.782152+0000","last_clean":"2023-09-30T13:57:21.782152+0000","last_became_active":"2023-09-30T13:57:21.777478+0000","last_became_peered":"2023-09-30T13:57:21.777478+0000","last_unstale":"2023-09-30T13:57:21.782152+0000","last_undegraded":"2023-09-30T13:57:21.782152+0000","last_fullsized":"2023-09-30T13:57:21.782152+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:54.707156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787203+0000","last_change":"2023-09-30T13:57:21.784466+0000","last_active":"2023-09-30T13:57:21.787203+0000","last_peered":"2023-09-30T13:57:21.787203+0000","last_clean":"2023-09-30T13:57:21.787203+0000","last_became_active":"2023-09-30T13:57:21.784172+0000","last_became_peered":"2023-09-30T13:57:21.784172+0000","last_unstale":"2023-09-30T13:57:21.787203+0000","last_undegraded":"2023-09-30T13:57:21.787203+0000","last_fullsized":"2023-09-30T13:57:21.787203+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778340+0000","last_change":"2023-09-30T13:57:21.774613+0000","last_active":"2023-09-30T13:57:21.778340+0000","last_peered":"2023-09-30T13:57:21.778340+0000","last_clean":"2023-09-30T13:57:21.778340+0000","last_became_active":"2023-09-30T13:57:21.774314+0000","last_became_peered":"2023-09-30T13:57:21.774314+0000","last_unstale":"2023-09-30T13:57:21.778340+0000","last_undegraded":"2023-09-30T13:57:21.778340+0000","last_fullsized":"2023-09-30T13:57:21.778340+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:58:34.819774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783154+0000","last_change":"2023-09-30T13:57:21.777183+0000","last_active":"2023-09-30T13:57:21.783154+0000","last_peered":"2023-09-30T13:57:21.783154+0000","last_clean":"2023-09-30T13:57:21.783154+0000","last_became_active":"2023-09-30T13:57:21.776922+0000","last_became_peered":"2023-09-30T13:57:21.776922+0000","last_unstale":"2023-09-30T13:57:21.783154+0000","last_undegraded":"2023-09-30T13:57:21.783154+0000","last_fullsized":"2023-09-30T13:57:21.783154+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792326+0000","last_change":"2023-09-30T13:57:21.785648+0000","last_active":"2023-09-30T13:57:21.792326+0000","last_peered":"2023-09-30T13:57:21.792326+0000","last_clean":"2023-09-30T13:57:21.792326+0000","last_became_active":"2023-09-30T13:57:21.785379+0000","last_became_peered":"2023-09-30T13:57:21.785379+0000","last_unstale":"2023-09-30T13:57:21.792326+0000","last_undegraded":"2023-09-30T13:57:21.792326+0000","last_fullsized":"2023-09-30T13:57:21.792326+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785966+0000","last_change":"2023-09-30T13:57:21.781392+0000","last_active":"2023-09-30T13:57:21.785966+0000","last_peered":"2023-09-30T13:57:21.785966+0000","last_clean":"2023-09-30T13:57:21.785966+0000","last_became_active":"2023-09-30T13:57:21.781095+0000","last_became_peered":"2023-09-30T13:57:21.781095+0000","last_unstale":"2023-09-30T13:57:21.785966+0000","last_undegraded":"2023-09-30T13:57:21.785966+0000","last_fullsized":"2023-09-30T13:57:21.785966+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778389+0000","last_change":"2023-09-30T13:57:21.777422+0000","last_active":"2023-09-30T13:57:21.778389+0000","last_peered":"2023-09-30T13:57:21.778389+0000","last_clean":"2023-09-30T13:57:21.778389+0000","last_became_active":"2023-09-30T13:57:21.776877+0000","last_became_peered":"2023-09-30T13:57:21.776877+0000","last_unstale":"2023-09-30T13:57:21.778389+0000","last_undegraded":"2023-09-30T13:57:21.778389+0000","last_fullsized":"2023-09-30T13:57:21.778389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782357+0000","last_change":"2023-09-30T13:57:21.779991+0000","last_active":"2023-09-30T13:57:21.782357+0000","last_peered":"2023-09-30T13:57:21.782357+0000","last_clean":"2023-09-30T13:57:21.782357+0000","last_became_active":"2023-09-30T13:57:21.779752+0000","last_became_peered":"2023-09-30T13:57:21.779752+0000","last_unstale":"2023-09-30T13:57:21.782357+0000","last_undegraded":"2023-09-30T13:57:21.782357+0000","last_fullsized":"2023-09-30T13:57:21.782357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:17.654067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783725+0000","last_change":"2023-09-30T13:57:21.776066+0000","last_active":"2023-09-30T13:57:21.783725+0000","last_peered":"2023-09-30T13:57:21.783725+0000","last_clean":"2023-09-30T13:57:21.783725+0000","last_became_active":"2023-09-30T13:57:21.774519+0000","last_became_peered":"2023-09-30T13:57:21.774519+0000","last_unstale":"2023-09-30T13:57:21.783725+0000","last_undegraded":"2023-09-30T13:57:21.783725+0000","last_fullsized":"2023-09-30T13:57:21.783725+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785506+0000","last_change":"2023-09-30T13:57:21.781663+0000","last_active":"2023-09-30T13:57:21.785506+0000","last_peered":"2023-09-30T13:57:21.785506+0000","last_clean":"2023-09-30T13:57:21.785506+0000","last_became_active":"2023-09-30T13:57:21.781372+0000","last_became_peered":"2023-09-30T13:57:21.781372+0000","last_unstale":"2023-09-30T13:57:21.785506+0000","last_undegraded":"2023-09-30T13:57:21.785506+0000","last_fullsized":"2023-09-30T13:57:21.785506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:35.838209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782897+0000","last_change":"2023-09-30T13:57:21.775392+0000","last_active":"2023-09-30T13:57:21.782897+0000","last_peered":"2023-09-30T13:57:21.782897+0000","last_clean":"2023-09-30T13:57:21.782897+0000","last_became_active":"2023-09-30T13:57:21.774898+0000","last_became_peered":"2023-09-30T13:57:21.774898+0000","last_unstale":"2023-09-30T13:57:21.782897+0000","last_undegraded":"2023-09-30T13:57:21.782897+0000","last_fullsized":"2023-09-30T13:57:21.782897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.789363+0000","last_change":"2023-09-30T13:57:21.787331+0000","last_active":"2023-09-30T13:57:21.789363+0000","last_peered":"2023-09-30T13:57:21.789363+0000","last_clean":"2023-09-30T13:57:21.789363+0000","last_became_active":"2023-09-30T13:57:21.787062+0000","last_became_peered":"2023-09-30T13:57:21.787062+0000","last_unstale":"2023-09-30T13:57:21.789363+0000","last_undegraded":"2023-09-30T13:57:21.789363+0000","last_fullsized":"2023-09-30T13:57:21.789363+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781053+0000","last_change":"2023-09-30T13:57:21.776292+0000","last_active":"2023-09-30T13:57:21.781053+0000","last_peered":"2023-09-30T13:57:21.781053+0000","last_clean":"2023-09-30T13:57:21.781053+0000","last_became_active":"2023-09-30T13:57:21.776035+0000","last_became_peered":"2023-09-30T13:57:21.776035+0000","last_unstale":"2023-09-30T13:57:21.781053+0000","last_undegraded":"2023-09-30T13:57:21.781053+0000","last_fullsized":"2023-09-30T13:57:21.781053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.791182+0000","last_change":"2023-09-30T13:57:20.764990+0000","last_active":"2023-09-30T13:57:21.791182+0000","last_peered":"2023-09-30T13:57:21.791182+0000","last_clean":"2023-09-30T13:57:21.791182+0000","last_became_active":"2023-09-30T13:57:20.764722+0000","last_became_peered":"2023-09-30T13:57:20.764722+0000","last_unstale":"2023-09-30T13:57:21.791182+0000","last_undegraded":"2023-09-30T13:57:21.791182+0000","last_fullsized":"2023-09-30T13:57:21.791182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:39.960508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783253+0000","last_change":"2023-09-30T13:57:21.779137+0000","last_active":"2023-09-30T13:57:21.783253+0000","last_peered":"2023-09-30T13:57:21.783253+0000","last_clean":"2023-09-30T13:57:21.783253+0000","last_became_active":"2023-09-30T13:57:21.778867+0000","last_became_peered":"2023-09-30T13:57:21.778867+0000","last_unstale":"2023-09-30T13:57:21.783253+0000","last_undegraded":"2023-09-30T13:57:21.783253+0000","last_fullsized":"2023-09-30T13:57:21.783253+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.795156+0000","last_change":"2023-09-30T13:57:20.768665+0000","last_active":"2023-09-30T13:57:21.795156+0000","last_peered":"2023-09-30T13:57:21.795156+0000","last_clean":"2023-09-30T13:57:21.795156+0000","last_became_active":"2023-09-30T13:57:20.768392+0000","last_became_peered":"2023-09-30T13:57:20.768392+0000","last_unstale":"2023-09-30T13:57:21.795156+0000","last_undegraded":"2023-09-30T13:57:21.795156+0000","last_fullsized":"2023-09-30T13:57:21.795156+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:34.834050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782380+0000","last_change":"2023-09-30T13:57:21.774866+0000","last_active":"2023-09-30T13:57:21.782380+0000","last_peered":"2023-09-30T13:57:21.782380+0000","last_clean":"2023-09-30T13:57:21.782380+0000","last_became_active":"2023-09-30T13:57:21.774417+0000","last_became_peered":"2023-09-30T13:57:21.774417+0000","last_unstale":"2023-09-30T13:57:21.782380+0000","last_undegraded":"2023-09-30T13:57:21.782380+0000","last_fullsized":"2023-09-30T13:57:21.782380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:54.608746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794947+0000","last_change":"2023-09-30T13:57:20.766763+0000","last_active":"2023-09-30T13:57:21.794947+0000","last_peered":"2023-09-30T13:57:21.794947+0000","last_clean":"2023-09-30T13:57:21.794947+0000","last_became_active":"2023-09-30T13:57:20.766343+0000","last_became_peered":"2023-09-30T13:57:20.766343+0000","last_unstale":"2023-09-30T13:57:21.794947+0000","last_undegraded":"2023-09-30T13:57:21.794947+0000","last_fullsized":"2023-09-30T13:57:21.794947+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787272+0000","last_change":"2023-09-30T13:57:21.783593+0000","last_active":"2023-09-30T13:57:21.787272+0000","last_peered":"2023-09-30T13:57:21.787272+0000","last_clean":"2023-09-30T13:57:21.787272+0000","last_became_active":"2023-09-30T13:57:21.783147+0000","last_became_peered":"2023-09-30T13:57:21.783147+0000","last_unstale":"2023-09-30T13:57:21.787272+0000","last_undegraded":"2023-09-30T13:57:21.787272+0000","last_fullsized":"2023-09-30T13:57:21.787272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:17.428201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794440+0000","last_change":"2023-09-30T13:57:20.768909+0000","last_active":"2023-09-30T13:57:21.794440+0000","last_peered":"2023-09-30T13:57:21.794440+0000","last_clean":"2023-09-30T13:57:21.794440+0000","last_became_active":"2023-09-30T13:57:20.768620+0000","last_became_peered":"2023-09-30T13:57:20.768620+0000","last_unstale":"2023-09-30T13:57:21.794440+0000","last_undegraded":"2023-09-30T13:57:21.794440+0000","last_fullsized":"2023-09-30T13:57:21.794440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:15.915406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778731+0000","last_change":"2023-09-30T13:57:21.776373+0000","last_active":"2023-09-30T13:57:21.778731+0000","last_peered":"2023-09-30T13:57:21.778731+0000","last_clean":"2023-09-30T13:57:21.778731+0000","last_became_active":"2023-09-30T13:57:21.776111+0000","last_became_peered":"2023-09-30T13:57:21.776111+0000","last_unstale":"2023-09-30T13:57:21.778731+0000","last_undegraded":"2023-09-30T13:57:21.778731+0000","last_fullsized":"2023-09-30T13:57:21.778731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:12:32.199411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794580+0000","last_change":"2023-09-30T13:57:20.767484+0000","last_active":"2023-09-30T13:57:21.794580+0000","last_peered":"2023-09-30T13:57:21.794580+0000","last_clean":"2023-09-30T13:57:21.794580+0000","last_became_active":"2023-09-30T13:57:20.767190+0000","last_became_peered":"2023-09-30T13:57:20.767190+0000","last_unstale":"2023-09-30T13:57:21.794580+0000","last_undegraded":"2023-09-30T13:57:21.794580+0000","last_fullsized":"2023-09-30T13:57:21.794580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:32.642442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.779944+0000","last_change":"2023-09-30T13:57:21.777165+0000","last_active":"2023-09-30T13:57:21.779944+0000","last_peered":"2023-09-30T13:57:21.779944+0000","last_clean":"2023-09-30T13:57:21.779944+0000","last_became_active":"2023-09-30T13:57:21.776906+0000","last_became_peered":"2023-09-30T13:57:21.776906+0000","last_unstale":"2023-09-30T13:57:21.779944+0000","last_undegraded":"2023-09-30T13:57:21.779944+0000","last_fullsized":"2023-09-30T13:57:21.779944+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.790743+0000","last_change":"2023-09-30T13:57:20.762138+0000","last_active":"2023-09-30T13:57:21.790743+0000","last_peered":"2023-09-30T13:57:21.790743+0000","last_clean":"2023-09-30T13:57:21.790743+0000","last_became_active":"2023-09-30T13:57:20.761826+0000","last_became_peered":"2023-09-30T13:57:20.761826+0000","last_unstale":"2023-09-30T13:57:21.790743+0000","last_undegraded":"2023-09-30T13:57:21.790743+0000","last_fullsized":"2023-09-30T13:57:21.790743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:32.345781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785986+0000","last_change":"2023-09-30T13:57:21.781611+0000","last_active":"2023-09-30T13:57:21.785986+0000","last_peered":"2023-09-30T13:57:21.785986+0000","last_clean":"2023-09-30T13:57:21.785986+0000","last_became_active":"2023-09-30T13:57:21.780911+0000","last_became_peered":"2023-09-30T13:57:21.780911+0000","last_unstale":"2023-09-30T13:57:21.785986+0000","last_undegraded":"2023-09-30T13:57:21.785986+0000","last_fullsized":"2023-09-30T13:57:21.785986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769778+0000","last_change":"2023-09-30T13:57:20.764187+0000","last_active":"2023-09-30T13:57:21.769778+0000","last_peered":"2023-09-30T13:57:21.769778+0000","last_clean":"2023-09-30T13:57:21.769778+0000","last_became_active":"2023-09-30T13:57:20.763921+0000","last_became_peered":"2023-09-30T13:57:20.763921+0000","last_unstale":"2023-09-30T13:57:21.769778+0000","last_undegraded":"2023-09-30T13:57:21.769778+0000","last_fullsized":"2023-09-30T13:57:21.769778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:34.834050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.788591+0000","last_change":"2023-09-30T13:57:21.785626+0000","last_active":"2023-09-30T13:57:21.788591+0000","last_peered":"2023-09-30T13:57:21.788591+0000","last_clean":"2023-09-30T13:57:21.788591+0000","last_became_active":"2023-09-30T13:57:21.785353+0000","last_became_peered":"2023-09-30T13:57:21.785353+0000","last_unstale":"2023-09-30T13:57:21.788591+0000","last_undegraded":"2023-09-30T13:57:21.788591+0000","last_fullsized":"2023-09-30T13:57:21.788591+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.764040+0000","last_change":"2023-09-30T13:57:20.762729+0000","last_active":"2023-09-30T13:57:21.764040+0000","last_peered":"2023-09-30T13:57:21.764040+0000","last_clean":"2023-09-30T13:57:21.764040+0000","last_became_active":"2023-09-30T13:57:20.762465+0000","last_became_peered":"2023-09-30T13:57:20.762465+0000","last_unstale":"2023-09-30T13:57:21.764040+0000","last_undegraded":"2023-09-30T13:57:21.764040+0000","last_fullsized":"2023-09-30T13:57:21.764040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785144+0000","last_change":"2023-09-30T13:57:21.783967+0000","last_active":"2023-09-30T13:57:21.785144+0000","last_peered":"2023-09-30T13:57:21.785144+0000","last_clean":"2023-09-30T13:57:21.785144+0000","last_became_active":"2023-09-30T13:57:21.783691+0000","last_became_peered":"2023-09-30T13:57:21.783691+0000","last_unstale":"2023-09-30T13:57:21.785144+0000","last_undegraded":"2023-09-30T13:57:21.785144+0000","last_fullsized":"2023-09-30T13:57:21.785144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:54.608746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771901+0000","last_change":"2023-09-30T13:57:20.771524+0000","last_active":"2023-09-30T13:57:21.771901+0000","last_peered":"2023-09-30T13:57:21.771901+0000","last_clean":"2023-09-30T13:57:21.771901+0000","last_became_active":"2023-09-30T13:57:20.771224+0000","last_became_peered":"2023-09-30T13:57:20.771224+0000","last_unstale":"2023-09-30T13:57:21.771901+0000","last_undegraded":"2023-09-30T13:57:21.771901+0000","last_fullsized":"2023-09-30T13:57:21.771901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:15.915406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.779230+0000","last_change":"2023-09-30T13:57:21.776092+0000","last_active":"2023-09-30T13:57:21.779230+0000","last_peered":"2023-09-30T13:57:21.779230+0000","last_clean":"2023-09-30T13:57:21.779230+0000","last_became_active":"2023-09-30T13:57:21.775826+0000","last_became_peered":"2023-09-30T13:57:21.775826+0000","last_unstale":"2023-09-30T13:57:21.779230+0000","last_undegraded":"2023-09-30T13:57:21.779230+0000","last_fullsized":"2023-09-30T13:57:21.779230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765279+0000","last_change":"2023-09-30T13:57:20.758531+0000","last_active":"2023-09-30T13:57:21.765279+0000","last_peered":"2023-09-30T13:57:21.765279+0000","last_clean":"2023-09-30T13:57:21.765279+0000","last_became_active":"2023-09-30T13:57:20.758157+0000","last_became_peered":"2023-09-30T13:57:20.758157+0000","last_unstale":"2023-09-30T13:57:21.765279+0000","last_undegraded":"2023-09-30T13:57:21.765279+0000","last_fullsized":"2023-09-30T13:57:21.765279+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:16.649908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783045+0000","last_change":"2023-09-30T13:57:21.775422+0000","last_active":"2023-09-30T13:57:21.783045+0000","last_peered":"2023-09-30T13:57:21.783045+0000","last_clean":"2023-09-30T13:57:21.783045+0000","last_became_active":"2023-09-30T13:57:21.774777+0000","last_became_peered":"2023-09-30T13:57:21.774777+0000","last_unstale":"2023-09-30T13:57:21.783045+0000","last_undegraded":"2023-09-30T13:57:21.783045+0000","last_fullsized":"2023-09-30T13:57:21.783045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:47.423524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792621+0000","last_change":"2023-09-30T13:57:20.768796+0000","last_active":"2023-09-30T13:57:21.792621+0000","last_peered":"2023-09-30T13:57:21.792621+0000","last_clean":"2023-09-30T13:57:21.792621+0000","last_became_active":"2023-09-30T13:57:20.768505+0000","last_became_peered":"2023-09-30T13:57:20.768505+0000","last_unstale":"2023-09-30T13:57:21.792621+0000","last_undegraded":"2023-09-30T13:57:21.792621+0000","last_fullsized":"2023-09-30T13:57:21.792621+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:28.539736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777556+0000","last_change":"2023-09-30T13:57:21.773419+0000","last_active":"2023-09-30T13:57:21.777556+0000","last_peered":"2023-09-30T13:57:21.777556+0000","last_clean":"2023-09-30T13:57:21.777556+0000","last_became_active":"2023-09-30T13:57:21.772697+0000","last_became_peered":"2023-09-30T13:57:21.772697+0000","last_unstale":"2023-09-30T13:57:21.777556+0000","last_undegraded":"2023-09-30T13:57:21.777556+0000","last_fullsized":"2023-09-30T13:57:21.777556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:45:04.515934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.796226+0000","last_change":"2023-09-30T13:57:20.765744+0000","last_active":"2023-09-30T13:57:21.796226+0000","last_peered":"2023-09-30T13:57:21.796226+0000","last_clean":"2023-09-30T13:57:21.796226+0000","last_became_active":"2023-09-30T13:57:20.765439+0000","last_became_peered":"2023-09-30T13:57:20.765439+0000","last_unstale":"2023-09-30T13:57:21.796226+0000","last_undegraded":"2023-09-30T13:57:21.796226+0000","last_fullsized":"2023-09-30T13:57:21.796226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:41:06.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784106+0000","last_change":"2023-09-30T13:57:21.780377+0000","last_active":"2023-09-30T13:57:21.784106+0000","last_peered":"2023-09-30T13:57:21.784106+0000","last_clean":"2023-09-30T13:57:21.784106+0000","last_became_active":"2023-09-30T13:57:21.780099+0000","last_became_peered":"2023-09-30T13:57:21.780099+0000","last_unstale":"2023-09-30T13:57:21.784106+0000","last_undegraded":"2023-09-30T13:57:21.784106+0000","last_fullsized":"2023-09-30T13:57:21.784106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794711+0000","last_change":"2023-09-30T13:57:20.765195+0000","last_active":"2023-09-30T13:57:21.794711+0000","last_peered":"2023-09-30T13:57:21.794711+0000","last_clean":"2023-09-30T13:57:21.794711+0000","last_became_active":"2023-09-30T13:57:20.764935+0000","last_became_peered":"2023-09-30T13:57:20.764935+0000","last_unstale":"2023-09-30T13:57:21.794711+0000","last_undegraded":"2023-09-30T13:57:21.794711+0000","last_fullsized":"2023-09-30T13:57:21.794711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:55.179193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782806+0000","last_change":"2023-09-30T13:57:21.775458+0000","last_active":"2023-09-30T13:57:21.782806+0000","last_peered":"2023-09-30T13:57:21.782806+0000","last_clean":"2023-09-30T13:57:21.782806+0000","last_became_active":"2023-09-30T13:57:21.775082+0000","last_became_peered":"2023-09-30T13:57:21.775082+0000","last_unstale":"2023-09-30T13:57:21.782806+0000","last_undegraded":"2023-09-30T13:57:21.782806+0000","last_fullsized":"2023-09-30T13:57:21.782806+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768157+0000","last_change":"2023-09-30T13:57:20.772753+0000","last_active":"2023-09-30T13:57:21.768157+0000","last_peered":"2023-09-30T13:57:21.768157+0000","last_clean":"2023-09-30T13:57:21.768157+0000","last_became_active":"2023-09-30T13:57:20.772492+0000","last_became_peered":"2023-09-30T13:57:20.772492+0000","last_unstale":"2023-09-30T13:57:21.768157+0000","last_undegraded":"2023-09-30T13:57:21.768157+0000","last_fullsized":"2023-09-30T13:57:21.768157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:29.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785639+0000","last_change":"2023-09-30T13:57:21.778332+0000","last_active":"2023-09-30T13:57:21.785639+0000","last_peered":"2023-09-30T13:57:21.785639+0000","last_clean":"2023-09-30T13:57:21.785639+0000","last_became_active":"2023-09-30T13:57:21.778031+0000","last_became_peered":"2023-09-30T13:57:21.778031+0000","last_unstale":"2023-09-30T13:57:21.785639+0000","last_undegraded":"2023-09-30T13:57:21.785639+0000","last_fullsized":"2023-09-30T13:57:21.785639+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769401+0000","last_change":"2023-09-30T13:57:20.771515+0000","last_active":"2023-09-30T13:57:21.769401+0000","last_peered":"2023-09-30T13:57:21.769401+0000","last_clean":"2023-09-30T13:57:21.769401+0000","last_became_active":"2023-09-30T13:57:20.771246+0000","last_became_peered":"2023-09-30T13:57:20.771246+0000","last_unstale":"2023-09-30T13:57:21.769401+0000","last_undegraded":"2023-09-30T13:57:21.769401+0000","last_fullsized":"2023-09-30T13:57:21.769401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786793+0000","last_change":"2023-09-30T13:57:21.780901+0000","last_active":"2023-09-30T13:57:21.786793+0000","last_peered":"2023-09-30T13:57:21.786793+0000","last_clean":"2023-09-30T13:57:21.786793+0000","last_became_active":"2023-09-30T13:57:21.779908+0000","last_became_peered":"2023-09-30T13:57:21.779908+0000","last_unstale":"2023-09-30T13:57:21.786793+0000","last_undegraded":"2023-09-30T13:57:21.786793+0000","last_fullsized":"2023-09-30T13:57:21.786793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:35.838209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794680+0000","last_change":"2023-09-30T13:57:20.767270+0000","last_active":"2023-09-30T13:57:21.794680+0000","last_peered":"2023-09-30T13:57:21.794680+0000","last_clean":"2023-09-30T13:57:21.794680+0000","last_became_active":"2023-09-30T13:57:20.767016+0000","last_became_peered":"2023-09-30T13:57:20.767016+0000","last_unstale":"2023-09-30T13:57:21.794680+0000","last_undegraded":"2023-09-30T13:57:21.794680+0000","last_fullsized":"2023-09-30T13:57:21.794680+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:13.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786259+0000","last_change":"2023-09-30T13:57:21.781408+0000","last_active":"2023-09-30T13:57:21.786259+0000","last_peered":"2023-09-30T13:57:21.786259+0000","last_clean":"2023-09-30T13:57:21.786259+0000","last_became_active":"2023-09-30T13:57:21.781125+0000","last_became_peered":"2023-09-30T13:57:21.781125+0000","last_unstale":"2023-09-30T13:57:21.786259+0000","last_undegraded":"2023-09-30T13:57:21.786259+0000","last_fullsized":"2023-09-30T13:57:21.786259+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794418+0000","last_change":"2023-09-30T13:57:20.772879+0000","last_active":"2023-09-30T13:57:21.794418+0000","last_peered":"2023-09-30T13:57:21.794418+0000","last_clean":"2023-09-30T13:57:21.794418+0000","last_became_active":"2023-09-30T13:57:20.772533+0000","last_became_peered":"2023-09-30T13:57:20.772533+0000","last_unstale":"2023-09-30T13:57:21.794418+0000","last_undegraded":"2023-09-30T13:57:21.794418+0000","last_fullsized":"2023-09-30T13:57:21.794418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:13.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786911+0000","last_change":"2023-09-30T13:57:21.778126+0000","last_active":"2023-09-30T13:57:21.786911+0000","last_peered":"2023-09-30T13:57:21.786911+0000","last_clean":"2023-09-30T13:57:21.786911+0000","last_became_active":"2023-09-30T13:57:21.777855+0000","last_became_peered":"2023-09-30T13:57:21.777855+0000","last_unstale":"2023-09-30T13:57:21.786911+0000","last_undegraded":"2023-09-30T13:57:21.786911+0000","last_fullsized":"2023-09-30T13:57:21.786911+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:40.964667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.793546+0000","last_change":"2023-09-30T13:57:20.766427+0000","last_active":"2023-09-30T13:57:21.793546+0000","last_peered":"2023-09-30T13:57:21.793546+0000","last_clean":"2023-09-30T13:57:21.793546+0000","last_became_active":"2023-09-30T13:57:20.766144+0000","last_became_peered":"2023-09-30T13:57:20.766144+0000","last_unstale":"2023-09-30T13:57:21.793546+0000","last_undegraded":"2023-09-30T13:57:21.793546+0000","last_fullsized":"2023-09-30T13:57:21.793546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:56.130096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781411+0000","last_change":"2023-09-30T13:57:21.777409+0000","last_active":"2023-09-30T13:57:21.781411+0000","last_peered":"2023-09-30T13:57:21.781411+0000","last_clean":"2023-09-30T13:57:21.781411+0000","last_became_active":"2023-09-30T13:57:21.777149+0000","last_became_peered":"2023-09-30T13:57:21.777149+0000","last_unstale":"2023-09-30T13:57:21.781411+0000","last_undegraded":"2023-09-30T13:57:21.781411+0000","last_fullsized":"2023-09-30T13:57:21.781411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:14:56.462127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792836+0000","last_change":"2023-09-30T13:57:20.765672+0000","last_active":"2023-09-30T13:57:21.792836+0000","last_peered":"2023-09-30T13:57:21.792836+0000","last_clean":"2023-09-30T13:57:21.792836+0000","last_became_active":"2023-09-30T13:57:20.765384+0000","last_became_peered":"2023-09-30T13:57:20.765384+0000","last_unstale":"2023-09-30T13:57:21.792836+0000","last_undegraded":"2023-09-30T13:57:21.792836+0000","last_fullsized":"2023-09-30T13:57:21.792836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778293+0000","last_change":"2023-09-30T13:57:21.776121+0000","last_active":"2023-09-30T13:57:21.778293+0000","last_peered":"2023-09-30T13:57:21.778293+0000","last_clean":"2023-09-30T13:57:21.778293+0000","last_became_active":"2023-09-30T13:57:21.775854+0000","last_became_peered":"2023-09-30T13:57:21.775854+0000","last_unstale":"2023-09-30T13:57:21.778293+0000","last_undegraded":"2023-09-30T13:57:21.778293+0000","last_fullsized":"2023-09-30T13:57:21.778293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769196+0000","last_change":"2023-09-30T13:57:20.768112+0000","last_active":"2023-09-30T13:57:21.769196+0000","last_peered":"2023-09-30T13:57:21.769196+0000","last_clean":"2023-09-30T13:57:21.769196+0000","last_became_active":"2023-09-30T13:57:20.767859+0000","last_became_peered":"2023-09-30T13:57:20.767859+0000","last_unstale":"2023-09-30T13:57:21.769196+0000","last_undegraded":"2023-09-30T13:57:21.769196+0000","last_fullsized":"2023-09-30T13:57:21.769196+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:35.573453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778991+0000","last_change":"2023-09-30T13:57:21.776902+0000","last_active":"2023-09-30T13:57:21.778991+0000","last_peered":"2023-09-30T13:57:21.778991+0000","last_clean":"2023-09-30T13:57:21.778991+0000","last_became_active":"2023-09-30T13:57:21.776644+0000","last_became_peered":"2023-09-30T13:57:21.776644+0000","last_unstale":"2023-09-30T13:57:21.778991+0000","last_undegraded":"2023-09-30T13:57:21.778991+0000","last_fullsized":"2023-09-30T13:57:21.778991+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.795007+0000","last_change":"2023-09-30T13:57:20.767736+0000","last_active":"2023-09-30T13:57:21.795007+0000","last_peered":"2023-09-30T13:57:21.795007+0000","last_clean":"2023-09-30T13:57:21.795007+0000","last_became_active":"2023-09-30T13:57:20.767269+0000","last_became_peered":"2023-09-30T13:57:20.767269+0000","last_unstale":"2023-09-30T13:57:21.795007+0000","last_undegraded":"2023-09-30T13:57:21.795007+0000","last_fullsized":"2023-09-30T13:57:21.795007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:41.629191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782206+0000","last_change":"2023-09-30T13:57:21.778731+0000","last_active":"2023-09-30T13:57:21.782206+0000","last_peered":"2023-09-30T13:57:21.782206+0000","last_clean":"2023-09-30T13:57:21.782206+0000","last_became_active":"2023-09-30T13:57:21.778469+0000","last_became_peered":"2023-09-30T13:57:21.778469+0000","last_unstale":"2023-09-30T13:57:21.782206+0000","last_undegraded":"2023-09-30T13:57:21.782206+0000","last_fullsized":"2023-09-30T13:57:21.782206+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768730+0000","last_change":"2023-09-30T13:57:20.764393+0000","last_active":"2023-09-30T13:57:21.768730+0000","last_peered":"2023-09-30T13:57:21.768730+0000","last_clean":"2023-09-30T13:57:21.768730+0000","last_became_active":"2023-09-30T13:57:20.763317+0000","last_became_peered":"2023-09-30T13:57:20.763317+0000","last_unstale":"2023-09-30T13:57:21.768730+0000","last_undegraded":"2023-09-30T13:57:21.768730+0000","last_fullsized":"2023-09-30T13:57:21.768730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785047+0000","last_change":"2023-09-30T13:57:21.777144+0000","last_active":"2023-09-30T13:57:21.785047+0000","last_peered":"2023-09-30T13:57:21.785047+0000","last_clean":"2023-09-30T13:57:21.785047+0000","last_became_active":"2023-09-30T13:57:21.776684+0000","last_became_peered":"2023-09-30T13:57:21.776684+0000","last_unstale":"2023-09-30T13:57:21.785047+0000","last_undegraded":"2023-09-30T13:57:21.785047+0000","last_fullsized":"2023-09-30T13:57:21.785047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:40.964667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765076+0000","last_change":"2023-09-30T13:57:20.769160+0000","last_active":"2023-09-30T13:57:21.765076+0000","last_peered":"2023-09-30T13:57:21.765076+0000","last_clean":"2023-09-30T13:57:21.765076+0000","last_became_active":"2023-09-30T13:57:20.768874+0000","last_became_peered":"2023-09-30T13:57:20.768874+0000","last_unstale":"2023-09-30T13:57:21.765076+0000","last_undegraded":"2023-09-30T13:57:21.765076+0000","last_fullsized":"2023-09-30T13:57:21.765076+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786430+0000","last_change":"2023-09-30T13:57:21.783859+0000","last_active":"2023-09-30T13:57:21.786430+0000","last_peered":"2023-09-30T13:57:21.786430+0000","last_clean":"2023-09-30T13:57:21.786430+0000","last_became_active":"2023-09-30T13:57:21.783562+0000","last_became_peered":"2023-09-30T13:57:21.783562+0000","last_unstale":"2023-09-30T13:57:21.786430+0000","last_undegraded":"2023-09-30T13:57:21.786430+0000","last_fullsized":"2023-09-30T13:57:21.786430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768381+0000","last_change":"2023-09-30T13:57:20.770875+0000","last_active":"2023-09-30T13:57:21.768381+0000","last_peered":"2023-09-30T13:57:21.768381+0000","last_clean":"2023-09-30T13:57:21.768381+0000","last_became_active":"2023-09-30T13:57:20.770604+0000","last_became_peered":"2023-09-30T13:57:20.770604+0000","last_unstale":"2023-09-30T13:57:21.768381+0000","last_undegraded":"2023-09-30T13:57:21.768381+0000","last_fullsized":"2023-09-30T13:57:21.768381+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:29.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.788726+0000","last_change":"2023-09-30T13:57:21.786661+0000","last_active":"2023-09-30T13:57:21.788726+0000","last_peered":"2023-09-30T13:57:21.788726+0000","last_clean":"2023-09-30T13:57:21.788726+0000","last_became_active":"2023-09-30T13:57:21.786363+0000","last_became_peered":"2023-09-30T13:57:21.786363+0000","last_unstale":"2023-09-30T13:57:21.788726+0000","last_undegraded":"2023-09-30T13:57:21.788726+0000","last_fullsized":"2023-09-30T13:57:21.788726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794769+0000","last_change":"2023-09-30T13:57:20.772729+0000","last_active":"2023-09-30T13:57:21.794769+0000","last_peered":"2023-09-30T13:57:21.794769+0000","last_clean":"2023-09-30T13:57:21.794769+0000","last_became_active":"2023-09-30T13:57:20.772523+0000","last_became_peered":"2023-09-30T13:57:20.772523+0000","last_unstale":"2023-09-30T13:57:21.794769+0000","last_undegraded":"2023-09-30T13:57:21.794769+0000","last_fullsized":"2023-09-30T13:57:21.794769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:22.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777061+0000","last_change":"2023-09-30T13:57:21.774294+0000","last_active":"2023-09-30T13:57:21.777061+0000","last_peered":"2023-09-30T13:57:21.777061+0000","last_clean":"2023-09-30T13:57:21.777061+0000","last_became_active":"2023-09-30T13:57:21.773442+0000","last_became_peered":"2023-09-30T13:57:21.773442+0000","last_unstale":"2023-09-30T13:57:21.777061+0000","last_undegraded":"2023-09-30T13:57:21.777061+0000","last_fullsized":"2023-09-30T13:57:21.777061+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771827+0000","last_change":"2023-09-30T13:57:20.766159+0000","last_active":"2023-09-30T13:57:21.771827+0000","last_peered":"2023-09-30T13:57:21.771827+0000","last_clean":"2023-09-30T13:57:21.771827+0000","last_became_active":"2023-09-30T13:57:20.765845+0000","last_became_peered":"2023-09-30T13:57:20.765845+0000","last_unstale":"2023-09-30T13:57:21.771827+0000","last_undegraded":"2023-09-30T13:57:21.771827+0000","last_fullsized":"2023-09-30T13:57:21.771827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:41.629191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787253+0000","last_change":"2023-09-30T13:57:21.783419+0000","last_active":"2023-09-30T13:57:21.787253+0000","last_peered":"2023-09-30T13:57:21.787253+0000","last_clean":"2023-09-30T13:57:21.787253+0000","last_became_active":"2023-09-30T13:57:21.782858+0000","last_became_peered":"2023-09-30T13:57:21.782858+0000","last_unstale":"2023-09-30T13:57:21.787253+0000","last_undegraded":"2023-09-30T13:57:21.787253+0000","last_fullsized":"2023-09-30T13:57:21.787253+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:33.658457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765237+0000","last_change":"2023-09-30T13:57:20.760054+0000","last_active":"2023-09-30T13:57:21.765237+0000","last_peered":"2023-09-30T13:57:21.765237+0000","last_clean":"2023-09-30T13:57:21.765237+0000","last_became_active":"2023-09-30T13:57:20.759683+0000","last_became_peered":"2023-09-30T13:57:20.759683+0000","last_unstale":"2023-09-30T13:57:21.765237+0000","last_undegraded":"2023-09-30T13:57:21.765237+0000","last_fullsized":"2023-09-30T13:57:21.765237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:30:21.282759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782867+0000","last_change":"2023-09-30T13:57:21.776651+0000","last_active":"2023-09-30T13:57:21.782867+0000","last_peered":"2023-09-30T13:57:21.782867+0000","last_clean":"2023-09-30T13:57:21.782867+0000","last_became_active":"2023-09-30T13:57:21.776181+0000","last_became_peered":"2023-09-30T13:57:21.776181+0000","last_unstale":"2023-09-30T13:57:21.782867+0000","last_undegraded":"2023-09-30T13:57:21.782867+0000","last_fullsized":"2023-09-30T13:57:21.782867+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:36.577612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771032+0000","last_change":"2023-09-30T13:57:20.768918+0000","last_active":"2023-09-30T13:57:21.771032+0000","last_peered":"2023-09-30T13:57:21.771032+0000","last_clean":"2023-09-30T13:57:21.771032+0000","last_became_active":"2023-09-30T13:57:20.768627+0000","last_became_peered":"2023-09-30T13:57:20.768627+0000","last_unstale":"2023-09-30T13:57:21.771032+0000","last_undegraded":"2023-09-30T13:57:21.771032+0000","last_fullsized":"2023-09-30T13:57:21.771032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:41:49.475087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783330+0000","last_change":"2023-09-30T13:57:21.779479+0000","last_active":"2023-09-30T13:57:21.783330+0000","last_peered":"2023-09-30T13:57:21.783330+0000","last_clean":"2023-09-30T13:57:21.783330+0000","last_became_active":"2023-09-30T13:57:21.779182+0000","last_became_peered":"2023-09-30T13:57:21.779182+0000","last_unstale":"2023-09-30T13:57:21.783330+0000","last_undegraded":"2023-09-30T13:57:21.783330+0000","last_fullsized":"2023-09-30T13:57:21.783330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768820+0000","last_change":"2023-09-30T13:57:20.768371+0000","last_active":"2023-09-30T13:57:21.768820+0000","last_peered":"2023-09-30T13:57:21.768820+0000","last_clean":"2023-09-30T13:57:21.768820+0000","last_became_active":"2023-09-30T13:57:20.768111+0000","last_became_peered":"2023-09-30T13:57:20.768111+0000","last_unstale":"2023-09-30T13:57:21.768820+0000","last_undegraded":"2023-09-30T13:57:21.768820+0000","last_fullsized":"2023-09-30T13:57:21.768820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:59:07.598746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785027+0000","last_change":"2023-09-30T13:57:21.776960+0000","last_active":"2023-09-30T13:57:21.785027+0000","last_peered":"2023-09-30T13:57:21.785027+0000","last_clean":"2023-09-30T13:57:21.785027+0000","last_became_active":"2023-09-30T13:57:21.775433+0000","last_became_peered":"2023-09-30T13:57:21.775433+0000","last_unstale":"2023-09-30T13:57:21.785027+0000","last_undegraded":"2023-09-30T13:57:21.785027+0000","last_fullsized":"2023-09-30T13:57:21.785027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765695+0000","last_change":"2023-09-30T13:57:20.763489+0000","last_active":"2023-09-30T13:57:21.765695+0000","last_peered":"2023-09-30T13:57:21.765695+0000","last_clean":"2023-09-30T13:57:21.765695+0000","last_became_active":"2023-09-30T13:57:20.763191+0000","last_became_peered":"2023-09-30T13:57:20.763191+0000","last_unstale":"2023-09-30T13:57:21.765695+0000","last_undegraded":"2023-09-30T13:57:21.765695+0000","last_fullsized":"2023-09-30T13:57:21.765695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:53.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785832+0000","last_change":"2023-09-30T13:57:21.781486+0000","last_active":"2023-09-30T13:57:21.785832+0000","last_peered":"2023-09-30T13:57:21.785832+0000","last_clean":"2023-09-30T13:57:21.785832+0000","last_became_active":"2023-09-30T13:57:21.781198+0000","last_became_peered":"2023-09-30T13:57:21.781198+0000","last_unstale":"2023-09-30T13:57:21.785832+0000","last_undegraded":"2023-09-30T13:57:21.785832+0000","last_fullsized":"2023-09-30T13:57:21.785832+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769203+0000","last_change":"2023-09-30T13:57:20.765407+0000","last_active":"2023-09-30T13:57:21.769203+0000","last_peered":"2023-09-30T13:57:21.769203+0000","last_clean":"2023-09-30T13:57:21.769203+0000","last_became_active":"2023-09-30T13:57:20.765131+0000","last_became_peered":"2023-09-30T13:57:20.765131+0000","last_unstale":"2023-09-30T13:57:21.769203+0000","last_undegraded":"2023-09-30T13:57:21.769203+0000","last_fullsized":"2023-09-30T13:57:21.769203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784078+0000","last_change":"2023-09-30T13:57:21.781882+0000","last_active":"2023-09-30T13:57:21.784078+0000","last_peered":"2023-09-30T13:57:21.784078+0000","last_clean":"2023-09-30T13:57:21.784078+0000","last_became_active":"2023-09-30T13:57:21.781628+0000","last_became_peered":"2023-09-30T13:57:21.781628+0000","last_unstale":"2023-09-30T13:57:21.784078+0000","last_undegraded":"2023-09-30T13:57:21.784078+0000","last_fullsized":"2023-09-30T13:57:21.784078+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:33.349940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765580+0000","last_change":"2023-09-30T13:57:20.767211+0000","last_active":"2023-09-30T13:57:21.765580+0000","last_peered":"2023-09-30T13:57:21.765580+0000","last_clean":"2023-09-30T13:57:21.765580+0000","last_became_active":"2023-09-30T13:57:20.766865+0000","last_became_peered":"2023-09-30T13:57:20.766865+0000","last_unstale":"2023-09-30T13:57:21.765580+0000","last_undegraded":"2023-09-30T13:57:21.765580+0000","last_fullsized":"2023-09-30T13:57:21.765580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:32.654297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-09-30T13:57:20.761316+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:57:20.761316+0000","last_peered":"2023-09-30T13:57:20.761316+0000","last_clean":"2023-09-30T13:57:20.761316+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:57:20.761316+0000","last_undegraded":"2023-09-30T13:57:20.761316+0000","last_fullsized":"2023-09-30T13:57:20.761316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":858110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.749,"5min":1.024,"15min":1.024},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.90400000000000003,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":268270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69799999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.68200000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.69099999999999995,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.432}]},{"osd":5,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":267618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.505,"15min":0.49399999999999999},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39700000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73799999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.437,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76800000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.77800000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44500000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77400000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69299999999999995,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.67800000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70599999999999996,"5min":2.202,"15min":2.202},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":2.266,"15min":2.266},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":269252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.499,"15min":0.499},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.46400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.38800000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55300000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.372},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.29999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78400000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81100000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.73999999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77100000000000002,"5min":1.258,"15min":1.258},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":269230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.315,"15min":0.307},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.26400000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.24199999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.58599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.49199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40200000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.53900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.54900000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":267778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.22600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61699999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.377,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.58799999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.38200000000000001,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":1.002,"15min":1.002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.873,"5min":1.161,"15min":1.161},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.503}]},{"osd":7,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85999999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1208320,"data_stored":858042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.218,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.35799999999999998,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.38800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.46400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84299999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84299999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.52200000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.434}]},{"osd":6,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.53000000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.89600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.54500000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.91100000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.54100000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:57:24.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:57:24.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.916+0000 7f094f494640 1 Processor -- start 2023-09-30T13:57:24.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.916+0000 7f094f494640 1 -- start start 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094f494640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09481598c0 0x7f09480ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094f494640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480b1e20 con 0x7f09480ceea0 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094f494640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094815e340 con 0x7f09480cea30 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094f494640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480b1530 con 0x7f09481598c0 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094d230640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09481598c0 0x7f09480ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094da31640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f09480ceea0 0x7f094815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53576/0 (socket says 172.21.15.62:53576) 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094da31640 1 -- 172.21.15.62:0/3720899209 learned_addr learned my addr 172.21.15.62:0/3720899209 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094d230640 1 -- 172.21.15.62:0/3720899209 >> v1:172.21.15.135:6789/0 conn(0x7f09480cea30 legacy=0x7f094815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094d230640 1 -- 172.21.15.62:0/3720899209 >> v1:172.21.15.62:6789/0 conn(0x7f09480ceea0 legacy=0x7f094815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.917+0000 7f094d230640 1 -- 172.21.15.62:0/3720899209 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480b17d0 con 0x7f09481598c0 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f094d230640 1 --2- 172.21.15.62:0/3720899209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09481598c0 0x7f09480ccc20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f09440097c0 tx=0x7f094402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee770dcb5a7ce611 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f093ffff640 1 -- 172.21.15.62:0/3720899209 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944031800 con 0x7f09481598c0 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f093ffff640 1 -- 172.21.15.62:0/3720899209 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944031960 con 0x7f09481598c0 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f093ffff640 1 -- 172.21.15.62:0/3720899209 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944031cf0 con 0x7f09481598c0 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f094f494640 1 -- 172.21.15.62:0/3720899209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09481598c0 msgr2=0x7f09480ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.918+0000 7f094f494640 1 --2- 172.21.15.62:0/3720899209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09481598c0 0x7f09480ccc20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f09440097c0 tx=0x7f094402b8a0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.919+0000 7f094f494640 1 -- 172.21.15.62:0/3720899209 shutdown_connections 2023-09-30T13:57:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.919+0000 7f094f494640 1 --2- 172.21.15.62:0/3720899209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09481598c0 0x7f09480ccc20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.919+0000 7f094f494640 1 -- 172.21.15.62:0/3720899209 >> 172.21.15.62:0/3720899209 conn(0x7f094806a170 msgr2=0x7f094806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.919+0000 7f094f494640 1 -- 172.21.15.62:0/3720899209 shutdown_connections 2023-09-30T13:57:24.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.919+0000 7f094f494640 1 -- 172.21.15.62:0/3720899209 wait complete. 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.920+0000 7f094f494640 1 Processor -- start 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.920+0000 7f094f494640 1 -- start start 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09480cea30 0x7f09481f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 0x7f09480cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094806d1b0 con 0x7f09480ceea0 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094815c680 con 0x7f09480cea30 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094815cb10 con 0x7f09481598c0 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33388/0 (socket says 172.21.15.62:33388) 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 -- 172.21.15.62:0/773160130 learned_addr learned my addr 172.21.15.62:0/773160130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094da31640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 0x7f09480cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094d230640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09480cea30 0x7f09481f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 -- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 msgr2=0x7f09480cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 0x7f09480cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 -- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09480cea30 msgr2=0x7f09481f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09480cea30 0x7f09481f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 -- 172.21.15.62:0/773160130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440093a0 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094da31640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 0x7f09480cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094ca2f640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f093800c430 tx=0x7f093800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938011790 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380118f0 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09481f2570 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.921+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938011ce0 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.922+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094815bd50 con 0x7f09480ceea0 2023-09-30T13:57:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.923+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094804e0d0 con 0x7f09480ceea0 2023-09-30T13:57:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.923+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f093801c460 con 0x7f09480ceea0 2023-09-30T13:57:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.924+0000 7f093dffb640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 0x7f092c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.924+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0938089320 con 0x7f09480ceea0 2023-09-30T13:57:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.924+0000 7f094d230640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 0x7f092c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.924+0000 7f094d230640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 0x7f092c06cff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0944036000 tx=0x7f094403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:24.928+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0938054440 con 0x7f09480ceea0 2023-09-30T13:57:25.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.098+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09480cf310 con 0x7f092c06ab30 2023-09-30T13:57:25.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.106+0000 7f093dffb640 1 -- 172.21.15.62:0/773160130 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289837 (secure 0 0 0) 0x7f0944031bd0 con 0x7f092c06ab30 2023-09-30T13:57:25.110 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:25.111 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:57:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 msgr2=0x7f092c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 0x7f092c06cff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0944036000 tx=0x7f094403c040 comp rx=0 tx=0).stop 2023-09-30T13:57:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 msgr2=0x7f09480c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f093800c430 tx=0x7f093800c8f0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 shutdown_connections 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f092c06ab30 0x7f092c06cff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09481598c0 0x7f09480cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09480ceea0 0x7f09480c9b20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 --2- 172.21.15.62:0/773160130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09480cea30 0x7f09481f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.109+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 >> 172.21.15.62:0/773160130 conn(0x7f094806a170 msgr2=0x7f0948158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.110+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 shutdown_connections 2023-09-30T13:57:25.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.110+0000 7f094f494640 1 -- 172.21.15.62:0/773160130 wait complete. 2023-09-30T13:57:25.120 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-09-30T13:57:23.711091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226292,"kb_used_data":5944,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748428,"statfs":{"total":773094113280,"available":772862390272,"internally_reserved":0,"allocated":6086656,"data_stored":3318823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":225496632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001052"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778331+0000","last_change":"2023-09-30T13:57:21.776787+0000","last_active":"2023-09-30T13:57:21.778331+0000","last_peered":"2023-09-30T13:57:21.778331+0000","last_clean":"2023-09-30T13:57:21.778331+0000","last_became_active":"2023-09-30T13:57:21.776487+0000","last_became_peered":"2023-09-30T13:57:21.776487+0000","last_unstale":"2023-09-30T13:57:21.778331+0000","last_undegraded":"2023-09-30T13:57:21.778331+0000","last_fullsized":"2023-09-30T13:57:21.778331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787347+0000","last_change":"2023-09-30T13:57:21.782406+0000","last_active":"2023-09-30T13:57:21.787347+0000","last_peered":"2023-09-30T13:57:21.787347+0000","last_clean":"2023-09-30T13:57:21.787347+0000","last_became_active":"2023-09-30T13:57:21.782087+0000","last_became_peered":"2023-09-30T13:57:21.782087+0000","last_unstale":"2023-09-30T13:57:21.787347+0000","last_undegraded":"2023-09-30T13:57:21.787347+0000","last_fullsized":"2023-09-30T13:57:21.787347+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782829+0000","last_change":"2023-09-30T13:57:21.776113+0000","last_active":"2023-09-30T13:57:21.782829+0000","last_peered":"2023-09-30T13:57:21.782829+0000","last_clean":"2023-09-30T13:57:21.782829+0000","last_became_active":"2023-09-30T13:57:21.774710+0000","last_became_peered":"2023-09-30T13:57:21.774710+0000","last_unstale":"2023-09-30T13:57:21.782829+0000","last_undegraded":"2023-09-30T13:57:21.782829+0000","last_fullsized":"2023-09-30T13:57:21.782829+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787400+0000","last_change":"2023-09-30T13:57:21.784862+0000","last_active":"2023-09-30T13:57:21.787400+0000","last_peered":"2023-09-30T13:57:21.787400+0000","last_clean":"2023-09-30T13:57:21.787400+0000","last_became_active":"2023-09-30T13:57:21.784610+0000","last_became_peered":"2023-09-30T13:57:21.784610+0000","last_unstale":"2023-09-30T13:57:21.787400+0000","last_undegraded":"2023-09-30T13:57:21.787400+0000","last_fullsized":"2023-09-30T13:57:21.787400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781776+0000","last_change":"2023-09-30T13:57:21.777451+0000","last_active":"2023-09-30T13:57:21.781776+0000","last_peered":"2023-09-30T13:57:21.781776+0000","last_clean":"2023-09-30T13:57:21.781776+0000","last_became_active":"2023-09-30T13:57:21.777184+0000","last_became_peered":"2023-09-30T13:57:21.777184+0000","last_unstale":"2023-09-30T13:57:21.781776+0000","last_undegraded":"2023-09-30T13:57:21.781776+0000","last_fullsized":"2023-09-30T13:57:21.781776+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:50:54.004534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778367+0000","last_change":"2023-09-30T13:57:21.776129+0000","last_active":"2023-09-30T13:57:21.778367+0000","last_peered":"2023-09-30T13:57:21.778367+0000","last_clean":"2023-09-30T13:57:21.778367+0000","last_became_active":"2023-09-30T13:57:21.775838+0000","last_became_peered":"2023-09-30T13:57:21.775838+0000","last_unstale":"2023-09-30T13:57:21.778367+0000","last_undegraded":"2023-09-30T13:57:21.778367+0000","last_fullsized":"2023-09-30T13:57:21.778367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782920+0000","last_change":"2023-09-30T13:57:21.775885+0000","last_active":"2023-09-30T13:57:21.782920+0000","last_peered":"2023-09-30T13:57:21.782920+0000","last_clean":"2023-09-30T13:57:21.782920+0000","last_became_active":"2023-09-30T13:57:21.775195+0000","last_became_peered":"2023-09-30T13:57:21.775195+0000","last_unstale":"2023-09-30T13:57:21.782920+0000","last_undegraded":"2023-09-30T13:57:21.782920+0000","last_fullsized":"2023-09-30T13:57:21.782920+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.790657+0000","last_change":"2023-09-30T13:57:21.784510+0000","last_active":"2023-09-30T13:57:21.790657+0000","last_peered":"2023-09-30T13:57:21.790657+0000","last_clean":"2023-09-30T13:57:21.790657+0000","last_became_active":"2023-09-30T13:57:21.784207+0000","last_became_peered":"2023-09-30T13:57:21.784207+0000","last_unstale":"2023-09-30T13:57:21.790657+0000","last_undegraded":"2023-09-30T13:57:21.790657+0000","last_fullsized":"2023-09-30T13:57:21.790657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.789847+0000","last_change":"2023-09-30T13:57:21.785466+0000","last_active":"2023-09-30T13:57:21.789847+0000","last_peered":"2023-09-30T13:57:21.789847+0000","last_clean":"2023-09-30T13:57:21.789847+0000","last_became_active":"2023-09-30T13:57:21.784920+0000","last_became_peered":"2023-09-30T13:57:21.784920+0000","last_unstale":"2023-09-30T13:57:21.789847+0000","last_undegraded":"2023-09-30T13:57:21.789847+0000","last_fullsized":"2023-09-30T13:57:21.789847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:47:34.093615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771482+0000","last_change":"2023-09-30T13:57:21.767923+0000","last_active":"2023-09-30T13:57:21.771482+0000","last_peered":"2023-09-30T13:57:21.771482+0000","last_clean":"2023-09-30T13:57:21.771482+0000","last_became_active":"2023-09-30T13:57:21.767629+0000","last_became_peered":"2023-09-30T13:57:21.767629+0000","last_unstale":"2023-09-30T13:57:21.771482+0000","last_undegraded":"2023-09-30T13:57:21.771482+0000","last_fullsized":"2023-09-30T13:57:21.771482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784625+0000","last_change":"2023-09-30T13:57:21.779910+0000","last_active":"2023-09-30T13:57:21.784625+0000","last_peered":"2023-09-30T13:57:21.784625+0000","last_clean":"2023-09-30T13:57:21.784625+0000","last_became_active":"2023-09-30T13:57:21.779598+0000","last_became_peered":"2023-09-30T13:57:21.779598+0000","last_unstale":"2023-09-30T13:57:21.784625+0000","last_undegraded":"2023-09-30T13:57:21.784625+0000","last_fullsized":"2023-09-30T13:57:21.784625+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:04:02.616667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786015+0000","last_change":"2023-09-30T13:57:21.782729+0000","last_active":"2023-09-30T13:57:21.786015+0000","last_peered":"2023-09-30T13:57:21.786015+0000","last_clean":"2023-09-30T13:57:21.786015+0000","last_became_active":"2023-09-30T13:57:21.782425+0000","last_became_peered":"2023-09-30T13:57:21.782425+0000","last_unstale":"2023-09-30T13:57:21.786015+0000","last_undegraded":"2023-09-30T13:57:21.786015+0000","last_fullsized":"2023-09-30T13:57:21.786015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:30:22.286918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771170+0000","last_change":"2023-09-30T13:57:21.768156+0000","last_active":"2023-09-30T13:57:21.771170+0000","last_peered":"2023-09-30T13:57:21.771170+0000","last_clean":"2023-09-30T13:57:21.771170+0000","last_became_active":"2023-09-30T13:57:21.767769+0000","last_became_peered":"2023-09-30T13:57:21.767769+0000","last_unstale":"2023-09-30T13:57:21.771170+0000","last_undegraded":"2023-09-30T13:57:21.771170+0000","last_fullsized":"2023-09-30T13:57:21.771170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783064+0000","last_change":"2023-09-30T13:57:21.777387+0000","last_active":"2023-09-30T13:57:21.783064+0000","last_peered":"2023-09-30T13:57:21.783064+0000","last_clean":"2023-09-30T13:57:21.783064+0000","last_became_active":"2023-09-30T13:57:21.775094+0000","last_became_peered":"2023-09-30T13:57:21.775094+0000","last_unstale":"2023-09-30T13:57:21.783064+0000","last_undegraded":"2023-09-30T13:57:21.783064+0000","last_fullsized":"2023-09-30T13:57:21.783064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:47:34.093615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777517+0000","last_change":"2023-09-30T13:57:21.775353+0000","last_active":"2023-09-30T13:57:21.777517+0000","last_peered":"2023-09-30T13:57:21.777517+0000","last_clean":"2023-09-30T13:57:21.777517+0000","last_became_active":"2023-09-30T13:57:21.775102+0000","last_became_peered":"2023-09-30T13:57:21.775102+0000","last_unstale":"2023-09-30T13:57:21.777517+0000","last_undegraded":"2023-09-30T13:57:21.777517+0000","last_fullsized":"2023-09-30T13:57:21.777517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771149+0000","last_change":"2023-09-30T13:57:21.767483+0000","last_active":"2023-09-30T13:57:21.771149+0000","last_peered":"2023-09-30T13:57:21.771149+0000","last_clean":"2023-09-30T13:57:21.771149+0000","last_became_active":"2023-09-30T13:57:21.767198+0000","last_became_peered":"2023-09-30T13:57:21.767198+0000","last_unstale":"2023-09-30T13:57:21.771149+0000","last_undegraded":"2023-09-30T13:57:21.771149+0000","last_fullsized":"2023-09-30T13:57:21.771149+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:36.577612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786772+0000","last_change":"2023-09-30T13:57:21.780540+0000","last_active":"2023-09-30T13:57:21.786772+0000","last_peered":"2023-09-30T13:57:21.786772+0000","last_clean":"2023-09-30T13:57:21.786772+0000","last_became_active":"2023-09-30T13:57:21.780276+0000","last_became_peered":"2023-09-30T13:57:21.780276+0000","last_unstale":"2023-09-30T13:57:21.786772+0000","last_undegraded":"2023-09-30T13:57:21.786772+0000","last_fullsized":"2023-09-30T13:57:21.786772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787373+0000","last_change":"2023-09-30T13:57:21.783837+0000","last_active":"2023-09-30T13:57:21.787373+0000","last_peered":"2023-09-30T13:57:21.787373+0000","last_clean":"2023-09-30T13:57:21.787373+0000","last_became_active":"2023-09-30T13:57:21.782994+0000","last_became_peered":"2023-09-30T13:57:21.782994+0000","last_unstale":"2023-09-30T13:57:21.787373+0000","last_undegraded":"2023-09-30T13:57:21.787373+0000","last_fullsized":"2023-09-30T13:57:21.787373+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782851+0000","last_change":"2023-09-30T13:57:21.776463+0000","last_active":"2023-09-30T13:57:21.782851+0000","last_peered":"2023-09-30T13:57:21.782851+0000","last_clean":"2023-09-30T13:57:21.782851+0000","last_became_active":"2023-09-30T13:57:21.775916+0000","last_became_peered":"2023-09-30T13:57:21.775916+0000","last_unstale":"2023-09-30T13:57:21.782851+0000","last_undegraded":"2023-09-30T13:57:21.782851+0000","last_fullsized":"2023-09-30T13:57:21.782851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:59:08.602906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782339+0000","last_change":"2023-09-30T13:57:21.779344+0000","last_active":"2023-09-30T13:57:21.782339+0000","last_peered":"2023-09-30T13:57:21.782339+0000","last_clean":"2023-09-30T13:57:21.782339+0000","last_became_active":"2023-09-30T13:57:21.779051+0000","last_became_peered":"2023-09-30T13:57:21.779051+0000","last_unstale":"2023-09-30T13:57:21.782339+0000","last_undegraded":"2023-09-30T13:57:21.782339+0000","last_fullsized":"2023-09-30T13:57:21.782339+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:47.423524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782152+0000","last_change":"2023-09-30T13:57:21.777964+0000","last_active":"2023-09-30T13:57:21.782152+0000","last_peered":"2023-09-30T13:57:21.782152+0000","last_clean":"2023-09-30T13:57:21.782152+0000","last_became_active":"2023-09-30T13:57:21.777478+0000","last_became_peered":"2023-09-30T13:57:21.777478+0000","last_unstale":"2023-09-30T13:57:21.782152+0000","last_undegraded":"2023-09-30T13:57:21.782152+0000","last_fullsized":"2023-09-30T13:57:21.782152+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:54.707156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787203+0000","last_change":"2023-09-30T13:57:21.784466+0000","last_active":"2023-09-30T13:57:21.787203+0000","last_peered":"2023-09-30T13:57:21.787203+0000","last_clean":"2023-09-30T13:57:21.787203+0000","last_became_active":"2023-09-30T13:57:21.784172+0000","last_became_peered":"2023-09-30T13:57:21.784172+0000","last_unstale":"2023-09-30T13:57:21.787203+0000","last_undegraded":"2023-09-30T13:57:21.787203+0000","last_fullsized":"2023-09-30T13:57:21.787203+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:16.919566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778340+0000","last_change":"2023-09-30T13:57:21.774613+0000","last_active":"2023-09-30T13:57:21.778340+0000","last_peered":"2023-09-30T13:57:21.778340+0000","last_clean":"2023-09-30T13:57:21.778340+0000","last_became_active":"2023-09-30T13:57:21.774314+0000","last_became_peered":"2023-09-30T13:57:21.774314+0000","last_unstale":"2023-09-30T13:57:21.778340+0000","last_undegraded":"2023-09-30T13:57:21.778340+0000","last_fullsized":"2023-09-30T13:57:21.778340+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:58:34.819774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783154+0000","last_change":"2023-09-30T13:57:21.777183+0000","last_active":"2023-09-30T13:57:21.783154+0000","last_peered":"2023-09-30T13:57:21.783154+0000","last_clean":"2023-09-30T13:57:21.783154+0000","last_became_active":"2023-09-30T13:57:21.776922+0000","last_became_peered":"2023-09-30T13:57:21.776922+0000","last_unstale":"2023-09-30T13:57:21.783154+0000","last_undegraded":"2023-09-30T13:57:21.783154+0000","last_fullsized":"2023-09-30T13:57:21.783154+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792326+0000","last_change":"2023-09-30T13:57:21.785648+0000","last_active":"2023-09-30T13:57:21.792326+0000","last_peered":"2023-09-30T13:57:21.792326+0000","last_clean":"2023-09-30T13:57:21.792326+0000","last_became_active":"2023-09-30T13:57:21.785379+0000","last_became_peered":"2023-09-30T13:57:21.785379+0000","last_unstale":"2023-09-30T13:57:21.792326+0000","last_undegraded":"2023-09-30T13:57:21.792326+0000","last_fullsized":"2023-09-30T13:57:21.792326+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785966+0000","last_change":"2023-09-30T13:57:21.781392+0000","last_active":"2023-09-30T13:57:21.785966+0000","last_peered":"2023-09-30T13:57:21.785966+0000","last_clean":"2023-09-30T13:57:21.785966+0000","last_became_active":"2023-09-30T13:57:21.781095+0000","last_became_peered":"2023-09-30T13:57:21.781095+0000","last_unstale":"2023-09-30T13:57:21.785966+0000","last_undegraded":"2023-09-30T13:57:21.785966+0000","last_fullsized":"2023-09-30T13:57:21.785966+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778389+0000","last_change":"2023-09-30T13:57:21.777422+0000","last_active":"2023-09-30T13:57:21.778389+0000","last_peered":"2023-09-30T13:57:21.778389+0000","last_clean":"2023-09-30T13:57:21.778389+0000","last_became_active":"2023-09-30T13:57:21.776877+0000","last_became_peered":"2023-09-30T13:57:21.776877+0000","last_unstale":"2023-09-30T13:57:21.778389+0000","last_undegraded":"2023-09-30T13:57:21.778389+0000","last_fullsized":"2023-09-30T13:57:21.778389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782357+0000","last_change":"2023-09-30T13:57:21.779991+0000","last_active":"2023-09-30T13:57:21.782357+0000","last_peered":"2023-09-30T13:57:21.782357+0000","last_clean":"2023-09-30T13:57:21.782357+0000","last_became_active":"2023-09-30T13:57:21.779752+0000","last_became_peered":"2023-09-30T13:57:21.779752+0000","last_unstale":"2023-09-30T13:57:21.782357+0000","last_undegraded":"2023-09-30T13:57:21.782357+0000","last_fullsized":"2023-09-30T13:57:21.782357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:17.654067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783725+0000","last_change":"2023-09-30T13:57:21.776066+0000","last_active":"2023-09-30T13:57:21.783725+0000","last_peered":"2023-09-30T13:57:21.783725+0000","last_clean":"2023-09-30T13:57:21.783725+0000","last_became_active":"2023-09-30T13:57:21.774519+0000","last_became_peered":"2023-09-30T13:57:21.774519+0000","last_unstale":"2023-09-30T13:57:21.783725+0000","last_undegraded":"2023-09-30T13:57:21.783725+0000","last_fullsized":"2023-09-30T13:57:21.783725+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785506+0000","last_change":"2023-09-30T13:57:21.781663+0000","last_active":"2023-09-30T13:57:21.785506+0000","last_peered":"2023-09-30T13:57:21.785506+0000","last_clean":"2023-09-30T13:57:21.785506+0000","last_became_active":"2023-09-30T13:57:21.781372+0000","last_became_peered":"2023-09-30T13:57:21.781372+0000","last_unstale":"2023-09-30T13:57:21.785506+0000","last_undegraded":"2023-09-30T13:57:21.785506+0000","last_fullsized":"2023-09-30T13:57:21.785506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:35.838209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782897+0000","last_change":"2023-09-30T13:57:21.775392+0000","last_active":"2023-09-30T13:57:21.782897+0000","last_peered":"2023-09-30T13:57:21.782897+0000","last_clean":"2023-09-30T13:57:21.782897+0000","last_became_active":"2023-09-30T13:57:21.774898+0000","last_became_peered":"2023-09-30T13:57:21.774898+0000","last_unstale":"2023-09-30T13:57:21.782897+0000","last_undegraded":"2023-09-30T13:57:21.782897+0000","last_fullsized":"2023-09-30T13:57:21.782897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.789363+0000","last_change":"2023-09-30T13:57:21.787331+0000","last_active":"2023-09-30T13:57:21.789363+0000","last_peered":"2023-09-30T13:57:21.789363+0000","last_clean":"2023-09-30T13:57:21.789363+0000","last_became_active":"2023-09-30T13:57:21.787062+0000","last_became_peered":"2023-09-30T13:57:21.787062+0000","last_unstale":"2023-09-30T13:57:21.789363+0000","last_undegraded":"2023-09-30T13:57:21.789363+0000","last_fullsized":"2023-09-30T13:57:21.789363+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781053+0000","last_change":"2023-09-30T13:57:21.776292+0000","last_active":"2023-09-30T13:57:21.781053+0000","last_peered":"2023-09-30T13:57:21.781053+0000","last_clean":"2023-09-30T13:57:21.781053+0000","last_became_active":"2023-09-30T13:57:21.776035+0000","last_became_peered":"2023-09-30T13:57:21.776035+0000","last_unstale":"2023-09-30T13:57:21.781053+0000","last_undegraded":"2023-09-30T13:57:21.781053+0000","last_fullsized":"2023-09-30T13:57:21.781053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.791182+0000","last_change":"2023-09-30T13:57:20.764990+0000","last_active":"2023-09-30T13:57:21.791182+0000","last_peered":"2023-09-30T13:57:21.791182+0000","last_clean":"2023-09-30T13:57:21.791182+0000","last_became_active":"2023-09-30T13:57:20.764722+0000","last_became_peered":"2023-09-30T13:57:20.764722+0000","last_unstale":"2023-09-30T13:57:21.791182+0000","last_undegraded":"2023-09-30T13:57:21.791182+0000","last_fullsized":"2023-09-30T13:57:21.791182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:39.960508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783253+0000","last_change":"2023-09-30T13:57:21.779137+0000","last_active":"2023-09-30T13:57:21.783253+0000","last_peered":"2023-09-30T13:57:21.783253+0000","last_clean":"2023-09-30T13:57:21.783253+0000","last_became_active":"2023-09-30T13:57:21.778867+0000","last_became_peered":"2023-09-30T13:57:21.778867+0000","last_unstale":"2023-09-30T13:57:21.783253+0000","last_undegraded":"2023-09-30T13:57:21.783253+0000","last_fullsized":"2023-09-30T13:57:21.783253+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:56.183353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.795156+0000","last_change":"2023-09-30T13:57:20.768665+0000","last_active":"2023-09-30T13:57:21.795156+0000","last_peered":"2023-09-30T13:57:21.795156+0000","last_clean":"2023-09-30T13:57:21.795156+0000","last_became_active":"2023-09-30T13:57:20.768392+0000","last_became_peered":"2023-09-30T13:57:20.768392+0000","last_unstale":"2023-09-30T13:57:21.795156+0000","last_undegraded":"2023-09-30T13:57:21.795156+0000","last_fullsized":"2023-09-30T13:57:21.795156+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:34.834050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782380+0000","last_change":"2023-09-30T13:57:21.774866+0000","last_active":"2023-09-30T13:57:21.782380+0000","last_peered":"2023-09-30T13:57:21.782380+0000","last_clean":"2023-09-30T13:57:21.782380+0000","last_became_active":"2023-09-30T13:57:21.774417+0000","last_became_peered":"2023-09-30T13:57:21.774417+0000","last_unstale":"2023-09-30T13:57:21.782380+0000","last_undegraded":"2023-09-30T13:57:21.782380+0000","last_fullsized":"2023-09-30T13:57:21.782380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:54.608746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794947+0000","last_change":"2023-09-30T13:57:20.766763+0000","last_active":"2023-09-30T13:57:21.794947+0000","last_peered":"2023-09-30T13:57:21.794947+0000","last_clean":"2023-09-30T13:57:21.794947+0000","last_became_active":"2023-09-30T13:57:20.766343+0000","last_became_peered":"2023-09-30T13:57:20.766343+0000","last_unstale":"2023-09-30T13:57:21.794947+0000","last_undegraded":"2023-09-30T13:57:21.794947+0000","last_fullsized":"2023-09-30T13:57:21.794947+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787272+0000","last_change":"2023-09-30T13:57:21.783593+0000","last_active":"2023-09-30T13:57:21.787272+0000","last_peered":"2023-09-30T13:57:21.787272+0000","last_clean":"2023-09-30T13:57:21.787272+0000","last_became_active":"2023-09-30T13:57:21.783147+0000","last_became_peered":"2023-09-30T13:57:21.783147+0000","last_unstale":"2023-09-30T13:57:21.787272+0000","last_undegraded":"2023-09-30T13:57:21.787272+0000","last_fullsized":"2023-09-30T13:57:21.787272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:36:17.428201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794440+0000","last_change":"2023-09-30T13:57:20.768909+0000","last_active":"2023-09-30T13:57:21.794440+0000","last_peered":"2023-09-30T13:57:21.794440+0000","last_clean":"2023-09-30T13:57:21.794440+0000","last_became_active":"2023-09-30T13:57:20.768620+0000","last_became_peered":"2023-09-30T13:57:20.768620+0000","last_unstale":"2023-09-30T13:57:21.794440+0000","last_undegraded":"2023-09-30T13:57:21.794440+0000","last_fullsized":"2023-09-30T13:57:21.794440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:15.915406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778731+0000","last_change":"2023-09-30T13:57:21.776373+0000","last_active":"2023-09-30T13:57:21.778731+0000","last_peered":"2023-09-30T13:57:21.778731+0000","last_clean":"2023-09-30T13:57:21.778731+0000","last_became_active":"2023-09-30T13:57:21.776111+0000","last_became_peered":"2023-09-30T13:57:21.776111+0000","last_unstale":"2023-09-30T13:57:21.778731+0000","last_undegraded":"2023-09-30T13:57:21.778731+0000","last_fullsized":"2023-09-30T13:57:21.778731+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:12:32.199411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794580+0000","last_change":"2023-09-30T13:57:20.767484+0000","last_active":"2023-09-30T13:57:21.794580+0000","last_peered":"2023-09-30T13:57:21.794580+0000","last_clean":"2023-09-30T13:57:21.794580+0000","last_became_active":"2023-09-30T13:57:20.767190+0000","last_became_peered":"2023-09-30T13:57:20.767190+0000","last_unstale":"2023-09-30T13:57:21.794580+0000","last_undegraded":"2023-09-30T13:57:21.794580+0000","last_fullsized":"2023-09-30T13:57:21.794580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:32.642442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.779944+0000","last_change":"2023-09-30T13:57:21.777165+0000","last_active":"2023-09-30T13:57:21.779944+0000","last_peered":"2023-09-30T13:57:21.779944+0000","last_clean":"2023-09-30T13:57:21.779944+0000","last_became_active":"2023-09-30T13:57:21.776906+0000","last_became_peered":"2023-09-30T13:57:21.776906+0000","last_unstale":"2023-09-30T13:57:21.779944+0000","last_undegraded":"2023-09-30T13:57:21.779944+0000","last_fullsized":"2023-09-30T13:57:21.779944+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.790743+0000","last_change":"2023-09-30T13:57:20.762138+0000","last_active":"2023-09-30T13:57:21.790743+0000","last_peered":"2023-09-30T13:57:21.790743+0000","last_clean":"2023-09-30T13:57:21.790743+0000","last_became_active":"2023-09-30T13:57:20.761826+0000","last_became_peered":"2023-09-30T13:57:20.761826+0000","last_unstale":"2023-09-30T13:57:21.790743+0000","last_undegraded":"2023-09-30T13:57:21.790743+0000","last_fullsized":"2023-09-30T13:57:21.790743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:32.345781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785986+0000","last_change":"2023-09-30T13:57:21.781611+0000","last_active":"2023-09-30T13:57:21.785986+0000","last_peered":"2023-09-30T13:57:21.785986+0000","last_clean":"2023-09-30T13:57:21.785986+0000","last_became_active":"2023-09-30T13:57:21.780911+0000","last_became_peered":"2023-09-30T13:57:21.780911+0000","last_unstale":"2023-09-30T13:57:21.785986+0000","last_undegraded":"2023-09-30T13:57:21.785986+0000","last_fullsized":"2023-09-30T13:57:21.785986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769778+0000","last_change":"2023-09-30T13:57:20.764187+0000","last_active":"2023-09-30T13:57:21.769778+0000","last_peered":"2023-09-30T13:57:21.769778+0000","last_clean":"2023-09-30T13:57:21.769778+0000","last_became_active":"2023-09-30T13:57:20.763921+0000","last_became_peered":"2023-09-30T13:57:20.763921+0000","last_unstale":"2023-09-30T13:57:21.769778+0000","last_undegraded":"2023-09-30T13:57:21.769778+0000","last_fullsized":"2023-09-30T13:57:21.769778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:34.834050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.788591+0000","last_change":"2023-09-30T13:57:21.785626+0000","last_active":"2023-09-30T13:57:21.788591+0000","last_peered":"2023-09-30T13:57:21.788591+0000","last_clean":"2023-09-30T13:57:21.788591+0000","last_became_active":"2023-09-30T13:57:21.785353+0000","last_became_peered":"2023-09-30T13:57:21.785353+0000","last_unstale":"2023-09-30T13:57:21.788591+0000","last_undegraded":"2023-09-30T13:57:21.788591+0000","last_fullsized":"2023-09-30T13:57:21.788591+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.764040+0000","last_change":"2023-09-30T13:57:20.762729+0000","last_active":"2023-09-30T13:57:21.764040+0000","last_peered":"2023-09-30T13:57:21.764040+0000","last_clean":"2023-09-30T13:57:21.764040+0000","last_became_active":"2023-09-30T13:57:20.762465+0000","last_became_peered":"2023-09-30T13:57:20.762465+0000","last_unstale":"2023-09-30T13:57:21.764040+0000","last_undegraded":"2023-09-30T13:57:21.764040+0000","last_fullsized":"2023-09-30T13:57:21.764040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785144+0000","last_change":"2023-09-30T13:57:21.783967+0000","last_active":"2023-09-30T13:57:21.785144+0000","last_peered":"2023-09-30T13:57:21.785144+0000","last_clean":"2023-09-30T13:57:21.785144+0000","last_became_active":"2023-09-30T13:57:21.783691+0000","last_became_peered":"2023-09-30T13:57:21.783691+0000","last_unstale":"2023-09-30T13:57:21.785144+0000","last_undegraded":"2023-09-30T13:57:21.785144+0000","last_fullsized":"2023-09-30T13:57:21.785144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:17:54.608746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771901+0000","last_change":"2023-09-30T13:57:20.771524+0000","last_active":"2023-09-30T13:57:21.771901+0000","last_peered":"2023-09-30T13:57:21.771901+0000","last_clean":"2023-09-30T13:57:21.771901+0000","last_became_active":"2023-09-30T13:57:20.771224+0000","last_became_peered":"2023-09-30T13:57:20.771224+0000","last_unstale":"2023-09-30T13:57:21.771901+0000","last_undegraded":"2023-09-30T13:57:21.771901+0000","last_fullsized":"2023-09-30T13:57:21.771901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:34:15.915406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.779230+0000","last_change":"2023-09-30T13:57:21.776092+0000","last_active":"2023-09-30T13:57:21.779230+0000","last_peered":"2023-09-30T13:57:21.779230+0000","last_clean":"2023-09-30T13:57:21.779230+0000","last_became_active":"2023-09-30T13:57:21.775826+0000","last_became_peered":"2023-09-30T13:57:21.775826+0000","last_unstale":"2023-09-30T13:57:21.779230+0000","last_undegraded":"2023-09-30T13:57:21.779230+0000","last_fullsized":"2023-09-30T13:57:21.779230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765279+0000","last_change":"2023-09-30T13:57:20.758531+0000","last_active":"2023-09-30T13:57:21.765279+0000","last_peered":"2023-09-30T13:57:21.765279+0000","last_clean":"2023-09-30T13:57:21.765279+0000","last_became_active":"2023-09-30T13:57:20.758157+0000","last_became_peered":"2023-09-30T13:57:20.758157+0000","last_unstale":"2023-09-30T13:57:21.765279+0000","last_undegraded":"2023-09-30T13:57:21.765279+0000","last_fullsized":"2023-09-30T13:57:21.765279+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:16.649908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783045+0000","last_change":"2023-09-30T13:57:21.775422+0000","last_active":"2023-09-30T13:57:21.783045+0000","last_peered":"2023-09-30T13:57:21.783045+0000","last_clean":"2023-09-30T13:57:21.783045+0000","last_became_active":"2023-09-30T13:57:21.774777+0000","last_became_peered":"2023-09-30T13:57:21.774777+0000","last_unstale":"2023-09-30T13:57:21.783045+0000","last_undegraded":"2023-09-30T13:57:21.783045+0000","last_fullsized":"2023-09-30T13:57:21.783045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:47.423524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792621+0000","last_change":"2023-09-30T13:57:20.768796+0000","last_active":"2023-09-30T13:57:21.792621+0000","last_peered":"2023-09-30T13:57:21.792621+0000","last_clean":"2023-09-30T13:57:21.792621+0000","last_became_active":"2023-09-30T13:57:20.768505+0000","last_became_peered":"2023-09-30T13:57:20.768505+0000","last_unstale":"2023-09-30T13:57:21.792621+0000","last_undegraded":"2023-09-30T13:57:21.792621+0000","last_fullsized":"2023-09-30T13:57:21.792621+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:28.539736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777556+0000","last_change":"2023-09-30T13:57:21.773419+0000","last_active":"2023-09-30T13:57:21.777556+0000","last_peered":"2023-09-30T13:57:21.777556+0000","last_clean":"2023-09-30T13:57:21.777556+0000","last_became_active":"2023-09-30T13:57:21.772697+0000","last_became_peered":"2023-09-30T13:57:21.772697+0000","last_unstale":"2023-09-30T13:57:21.777556+0000","last_undegraded":"2023-09-30T13:57:21.777556+0000","last_fullsized":"2023-09-30T13:57:21.777556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:45:04.515934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.796226+0000","last_change":"2023-09-30T13:57:20.765744+0000","last_active":"2023-09-30T13:57:21.796226+0000","last_peered":"2023-09-30T13:57:21.796226+0000","last_clean":"2023-09-30T13:57:21.796226+0000","last_became_active":"2023-09-30T13:57:20.765439+0000","last_became_peered":"2023-09-30T13:57:20.765439+0000","last_unstale":"2023-09-30T13:57:21.796226+0000","last_undegraded":"2023-09-30T13:57:21.796226+0000","last_fullsized":"2023-09-30T13:57:21.796226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:41:06.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784106+0000","last_change":"2023-09-30T13:57:21.780377+0000","last_active":"2023-09-30T13:57:21.784106+0000","last_peered":"2023-09-30T13:57:21.784106+0000","last_clean":"2023-09-30T13:57:21.784106+0000","last_became_active":"2023-09-30T13:57:21.780099+0000","last_became_peered":"2023-09-30T13:57:21.780099+0000","last_unstale":"2023-09-30T13:57:21.784106+0000","last_undegraded":"2023-09-30T13:57:21.784106+0000","last_fullsized":"2023-09-30T13:57:21.784106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794711+0000","last_change":"2023-09-30T13:57:20.765195+0000","last_active":"2023-09-30T13:57:21.794711+0000","last_peered":"2023-09-30T13:57:21.794711+0000","last_clean":"2023-09-30T13:57:21.794711+0000","last_became_active":"2023-09-30T13:57:20.764935+0000","last_became_peered":"2023-09-30T13:57:20.764935+0000","last_unstale":"2023-09-30T13:57:21.794711+0000","last_undegraded":"2023-09-30T13:57:21.794711+0000","last_fullsized":"2023-09-30T13:57:21.794711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:49:55.179193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782806+0000","last_change":"2023-09-30T13:57:21.775458+0000","last_active":"2023-09-30T13:57:21.782806+0000","last_peered":"2023-09-30T13:57:21.782806+0000","last_clean":"2023-09-30T13:57:21.782806+0000","last_became_active":"2023-09-30T13:57:21.775082+0000","last_became_peered":"2023-09-30T13:57:21.775082+0000","last_unstale":"2023-09-30T13:57:21.782806+0000","last_undegraded":"2023-09-30T13:57:21.782806+0000","last_fullsized":"2023-09-30T13:57:21.782806+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:27.867458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768157+0000","last_change":"2023-09-30T13:57:20.772753+0000","last_active":"2023-09-30T13:57:21.768157+0000","last_peered":"2023-09-30T13:57:21.768157+0000","last_clean":"2023-09-30T13:57:21.768157+0000","last_became_active":"2023-09-30T13:57:20.772492+0000","last_became_peered":"2023-09-30T13:57:20.772492+0000","last_unstale":"2023-09-30T13:57:21.768157+0000","last_undegraded":"2023-09-30T13:57:21.768157+0000","last_fullsized":"2023-09-30T13:57:21.768157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:29.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785639+0000","last_change":"2023-09-30T13:57:21.778332+0000","last_active":"2023-09-30T13:57:21.785639+0000","last_peered":"2023-09-30T13:57:21.785639+0000","last_clean":"2023-09-30T13:57:21.785639+0000","last_became_active":"2023-09-30T13:57:21.778031+0000","last_became_peered":"2023-09-30T13:57:21.778031+0000","last_unstale":"2023-09-30T13:57:21.785639+0000","last_undegraded":"2023-09-30T13:57:21.785639+0000","last_fullsized":"2023-09-30T13:57:21.785639+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:42.633350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769401+0000","last_change":"2023-09-30T13:57:20.771515+0000","last_active":"2023-09-30T13:57:21.769401+0000","last_peered":"2023-09-30T13:57:21.769401+0000","last_clean":"2023-09-30T13:57:21.769401+0000","last_became_active":"2023-09-30T13:57:20.771246+0000","last_became_peered":"2023-09-30T13:57:20.771246+0000","last_unstale":"2023-09-30T13:57:21.769401+0000","last_undegraded":"2023-09-30T13:57:21.769401+0000","last_fullsized":"2023-09-30T13:57:21.769401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786793+0000","last_change":"2023-09-30T13:57:21.780901+0000","last_active":"2023-09-30T13:57:21.786793+0000","last_peered":"2023-09-30T13:57:21.786793+0000","last_clean":"2023-09-30T13:57:21.786793+0000","last_became_active":"2023-09-30T13:57:21.779908+0000","last_became_peered":"2023-09-30T13:57:21.779908+0000","last_unstale":"2023-09-30T13:57:21.786793+0000","last_undegraded":"2023-09-30T13:57:21.786793+0000","last_fullsized":"2023-09-30T13:57:21.786793+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:35.838209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794680+0000","last_change":"2023-09-30T13:57:20.767270+0000","last_active":"2023-09-30T13:57:21.794680+0000","last_peered":"2023-09-30T13:57:21.794680+0000","last_clean":"2023-09-30T13:57:21.794680+0000","last_became_active":"2023-09-30T13:57:20.767016+0000","last_became_peered":"2023-09-30T13:57:20.767016+0000","last_unstale":"2023-09-30T13:57:21.794680+0000","last_undegraded":"2023-09-30T13:57:21.794680+0000","last_fullsized":"2023-09-30T13:57:21.794680+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:13.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786259+0000","last_change":"2023-09-30T13:57:21.781408+0000","last_active":"2023-09-30T13:57:21.786259+0000","last_peered":"2023-09-30T13:57:21.786259+0000","last_clean":"2023-09-30T13:57:21.786259+0000","last_became_active":"2023-09-30T13:57:21.781125+0000","last_became_peered":"2023-09-30T13:57:21.781125+0000","last_unstale":"2023-09-30T13:57:21.786259+0000","last_undegraded":"2023-09-30T13:57:21.786259+0000","last_fullsized":"2023-09-30T13:57:21.786259+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794418+0000","last_change":"2023-09-30T13:57:20.772879+0000","last_active":"2023-09-30T13:57:21.794418+0000","last_peered":"2023-09-30T13:57:21.794418+0000","last_clean":"2023-09-30T13:57:21.794418+0000","last_became_active":"2023-09-30T13:57:20.772533+0000","last_became_peered":"2023-09-30T13:57:20.772533+0000","last_unstale":"2023-09-30T13:57:21.794418+0000","last_undegraded":"2023-09-30T13:57:21.794418+0000","last_fullsized":"2023-09-30T13:57:21.794418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:13.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786911+0000","last_change":"2023-09-30T13:57:21.778126+0000","last_active":"2023-09-30T13:57:21.786911+0000","last_peered":"2023-09-30T13:57:21.786911+0000","last_clean":"2023-09-30T13:57:21.786911+0000","last_became_active":"2023-09-30T13:57:21.777855+0000","last_became_peered":"2023-09-30T13:57:21.777855+0000","last_unstale":"2023-09-30T13:57:21.786911+0000","last_undegraded":"2023-09-30T13:57:21.786911+0000","last_fullsized":"2023-09-30T13:57:21.786911+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:40.964667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.793546+0000","last_change":"2023-09-30T13:57:20.766427+0000","last_active":"2023-09-30T13:57:21.793546+0000","last_peered":"2023-09-30T13:57:21.793546+0000","last_clean":"2023-09-30T13:57:21.793546+0000","last_became_active":"2023-09-30T13:57:20.766144+0000","last_became_peered":"2023-09-30T13:57:20.766144+0000","last_unstale":"2023-09-30T13:57:21.793546+0000","last_undegraded":"2023-09-30T13:57:21.793546+0000","last_fullsized":"2023-09-30T13:57:21.793546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:56.130096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.781411+0000","last_change":"2023-09-30T13:57:21.777409+0000","last_active":"2023-09-30T13:57:21.781411+0000","last_peered":"2023-09-30T13:57:21.781411+0000","last_clean":"2023-09-30T13:57:21.781411+0000","last_became_active":"2023-09-30T13:57:21.777149+0000","last_became_peered":"2023-09-30T13:57:21.777149+0000","last_unstale":"2023-09-30T13:57:21.781411+0000","last_undegraded":"2023-09-30T13:57:21.781411+0000","last_fullsized":"2023-09-30T13:57:21.781411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:14:56.462127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.792836+0000","last_change":"2023-09-30T13:57:20.765672+0000","last_active":"2023-09-30T13:57:21.792836+0000","last_peered":"2023-09-30T13:57:21.792836+0000","last_clean":"2023-09-30T13:57:21.792836+0000","last_became_active":"2023-09-30T13:57:20.765384+0000","last_became_peered":"2023-09-30T13:57:20.765384+0000","last_unstale":"2023-09-30T13:57:21.792836+0000","last_undegraded":"2023-09-30T13:57:21.792836+0000","last_fullsized":"2023-09-30T13:57:21.792836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:20:24.113705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778293+0000","last_change":"2023-09-30T13:57:21.776121+0000","last_active":"2023-09-30T13:57:21.778293+0000","last_peered":"2023-09-30T13:57:21.778293+0000","last_clean":"2023-09-30T13:57:21.778293+0000","last_became_active":"2023-09-30T13:57:21.775854+0000","last_became_peered":"2023-09-30T13:57:21.775854+0000","last_unstale":"2023-09-30T13:57:21.778293+0000","last_undegraded":"2023-09-30T13:57:21.778293+0000","last_fullsized":"2023-09-30T13:57:21.778293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:01:29.543895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769196+0000","last_change":"2023-09-30T13:57:20.768112+0000","last_active":"2023-09-30T13:57:21.769196+0000","last_peered":"2023-09-30T13:57:21.769196+0000","last_clean":"2023-09-30T13:57:21.769196+0000","last_became_active":"2023-09-30T13:57:20.767859+0000","last_became_peered":"2023-09-30T13:57:20.767859+0000","last_unstale":"2023-09-30T13:57:21.769196+0000","last_undegraded":"2023-09-30T13:57:21.769196+0000","last_fullsized":"2023-09-30T13:57:21.769196+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:35.573453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.778991+0000","last_change":"2023-09-30T13:57:21.776902+0000","last_active":"2023-09-30T13:57:21.778991+0000","last_peered":"2023-09-30T13:57:21.778991+0000","last_clean":"2023-09-30T13:57:21.778991+0000","last_became_active":"2023-09-30T13:57:21.776644+0000","last_became_peered":"2023-09-30T13:57:21.776644+0000","last_unstale":"2023-09-30T13:57:21.778991+0000","last_undegraded":"2023-09-30T13:57:21.778991+0000","last_fullsized":"2023-09-30T13:57:21.778991+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.795007+0000","last_change":"2023-09-30T13:57:20.767736+0000","last_active":"2023-09-30T13:57:21.795007+0000","last_peered":"2023-09-30T13:57:21.795007+0000","last_clean":"2023-09-30T13:57:21.795007+0000","last_became_active":"2023-09-30T13:57:20.767269+0000","last_became_peered":"2023-09-30T13:57:20.767269+0000","last_unstale":"2023-09-30T13:57:21.795007+0000","last_undegraded":"2023-09-30T13:57:21.795007+0000","last_fullsized":"2023-09-30T13:57:21.795007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:41.629191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782206+0000","last_change":"2023-09-30T13:57:21.778731+0000","last_active":"2023-09-30T13:57:21.782206+0000","last_peered":"2023-09-30T13:57:21.782206+0000","last_clean":"2023-09-30T13:57:21.782206+0000","last_became_active":"2023-09-30T13:57:21.778469+0000","last_became_peered":"2023-09-30T13:57:21.778469+0000","last_unstale":"2023-09-30T13:57:21.782206+0000","last_undegraded":"2023-09-30T13:57:21.782206+0000","last_fullsized":"2023-09-30T13:57:21.782206+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:15:29.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768730+0000","last_change":"2023-09-30T13:57:20.764393+0000","last_active":"2023-09-30T13:57:21.768730+0000","last_peered":"2023-09-30T13:57:21.768730+0000","last_clean":"2023-09-30T13:57:21.768730+0000","last_became_active":"2023-09-30T13:57:20.763317+0000","last_became_peered":"2023-09-30T13:57:20.763317+0000","last_unstale":"2023-09-30T13:57:21.768730+0000","last_undegraded":"2023-09-30T13:57:21.768730+0000","last_fullsized":"2023-09-30T13:57:21.768730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785047+0000","last_change":"2023-09-30T13:57:21.777144+0000","last_active":"2023-09-30T13:57:21.785047+0000","last_peered":"2023-09-30T13:57:21.785047+0000","last_clean":"2023-09-30T13:57:21.785047+0000","last_became_active":"2023-09-30T13:57:21.776684+0000","last_became_peered":"2023-09-30T13:57:21.776684+0000","last_unstale":"2023-09-30T13:57:21.785047+0000","last_undegraded":"2023-09-30T13:57:21.785047+0000","last_fullsized":"2023-09-30T13:57:21.785047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:37:40.964667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765076+0000","last_change":"2023-09-30T13:57:20.769160+0000","last_active":"2023-09-30T13:57:21.765076+0000","last_peered":"2023-09-30T13:57:21.765076+0000","last_clean":"2023-09-30T13:57:21.765076+0000","last_became_active":"2023-09-30T13:57:20.768874+0000","last_became_peered":"2023-09-30T13:57:20.768874+0000","last_unstale":"2023-09-30T13:57:21.765076+0000","last_undegraded":"2023-09-30T13:57:21.765076+0000","last_fullsized":"2023-09-30T13:57:21.765076+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.786430+0000","last_change":"2023-09-30T13:57:21.783859+0000","last_active":"2023-09-30T13:57:21.786430+0000","last_peered":"2023-09-30T13:57:21.786430+0000","last_clean":"2023-09-30T13:57:21.786430+0000","last_became_active":"2023-09-30T13:57:21.783562+0000","last_became_peered":"2023-09-30T13:57:21.783562+0000","last_unstale":"2023-09-30T13:57:21.786430+0000","last_undegraded":"2023-09-30T13:57:21.786430+0000","last_fullsized":"2023-09-30T13:57:21.786430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T15:27:28.647477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768381+0000","last_change":"2023-09-30T13:57:20.770875+0000","last_active":"2023-09-30T13:57:21.768381+0000","last_peered":"2023-09-30T13:57:21.768381+0000","last_clean":"2023-09-30T13:57:21.768381+0000","last_became_active":"2023-09-30T13:57:20.770604+0000","last_became_peered":"2023-09-30T13:57:20.770604+0000","last_unstale":"2023-09-30T13:57:21.768381+0000","last_undegraded":"2023-09-30T13:57:21.768381+0000","last_fullsized":"2023-09-30T13:57:21.768381+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:25:29.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.788726+0000","last_change":"2023-09-30T13:57:21.786661+0000","last_active":"2023-09-30T13:57:21.788726+0000","last_peered":"2023-09-30T13:57:21.788726+0000","last_clean":"2023-09-30T13:57:21.788726+0000","last_became_active":"2023-09-30T13:57:21.786363+0000","last_became_peered":"2023-09-30T13:57:21.786363+0000","last_unstale":"2023-09-30T13:57:21.788726+0000","last_undegraded":"2023-09-30T13:57:21.788726+0000","last_fullsized":"2023-09-30T13:57:21.788726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.794769+0000","last_change":"2023-09-30T13:57:20.772729+0000","last_active":"2023-09-30T13:57:21.794769+0000","last_peered":"2023-09-30T13:57:21.794769+0000","last_clean":"2023-09-30T13:57:21.794769+0000","last_became_active":"2023-09-30T13:57:20.772523+0000","last_became_peered":"2023-09-30T13:57:20.772523+0000","last_unstale":"2023-09-30T13:57:21.794769+0000","last_undegraded":"2023-09-30T13:57:21.794769+0000","last_fullsized":"2023-09-30T13:57:21.794769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:22.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.777061+0000","last_change":"2023-09-30T13:57:21.774294+0000","last_active":"2023-09-30T13:57:21.777061+0000","last_peered":"2023-09-30T13:57:21.777061+0000","last_clean":"2023-09-30T13:57:21.777061+0000","last_became_active":"2023-09-30T13:57:21.773442+0000","last_became_peered":"2023-09-30T13:57:21.773442+0000","last_unstale":"2023-09-30T13:57:21.777061+0000","last_undegraded":"2023-09-30T13:57:21.777061+0000","last_fullsized":"2023-09-30T13:57:21.777061+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:07:04.740178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771827+0000","last_change":"2023-09-30T13:57:20.766159+0000","last_active":"2023-09-30T13:57:21.771827+0000","last_peered":"2023-09-30T13:57:21.771827+0000","last_clean":"2023-09-30T13:57:21.771827+0000","last_became_active":"2023-09-30T13:57:20.765845+0000","last_became_peered":"2023-09-30T13:57:20.765845+0000","last_unstale":"2023-09-30T13:57:21.771827+0000","last_undegraded":"2023-09-30T13:57:21.771827+0000","last_fullsized":"2023-09-30T13:57:21.771827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:42:41.629191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.787253+0000","last_change":"2023-09-30T13:57:21.783419+0000","last_active":"2023-09-30T13:57:21.787253+0000","last_peered":"2023-09-30T13:57:21.787253+0000","last_clean":"2023-09-30T13:57:21.787253+0000","last_became_active":"2023-09-30T13:57:21.782858+0000","last_became_peered":"2023-09-30T13:57:21.782858+0000","last_unstale":"2023-09-30T13:57:21.787253+0000","last_undegraded":"2023-09-30T13:57:21.787253+0000","last_fullsized":"2023-09-30T13:57:21.787253+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:33.658457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765237+0000","last_change":"2023-09-30T13:57:20.760054+0000","last_active":"2023-09-30T13:57:21.765237+0000","last_peered":"2023-09-30T13:57:21.765237+0000","last_clean":"2023-09-30T13:57:21.765237+0000","last_became_active":"2023-09-30T13:57:20.759683+0000","last_became_peered":"2023-09-30T13:57:20.759683+0000","last_unstale":"2023-09-30T13:57:21.765237+0000","last_undegraded":"2023-09-30T13:57:21.765237+0000","last_fullsized":"2023-09-30T13:57:21.765237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T16:30:21.282759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.782867+0000","last_change":"2023-09-30T13:57:21.776651+0000","last_active":"2023-09-30T13:57:21.782867+0000","last_peered":"2023-09-30T13:57:21.782867+0000","last_clean":"2023-09-30T13:57:21.782867+0000","last_became_active":"2023-09-30T13:57:21.776181+0000","last_became_peered":"2023-09-30T13:57:21.776181+0000","last_unstale":"2023-09-30T13:57:21.782867+0000","last_undegraded":"2023-09-30T13:57:21.782867+0000","last_fullsized":"2023-09-30T13:57:21.782867+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:29:36.577612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.771032+0000","last_change":"2023-09-30T13:57:20.768918+0000","last_active":"2023-09-30T13:57:21.771032+0000","last_peered":"2023-09-30T13:57:21.771032+0000","last_clean":"2023-09-30T13:57:21.771032+0000","last_became_active":"2023-09-30T13:57:20.768627+0000","last_became_peered":"2023-09-30T13:57:20.768627+0000","last_unstale":"2023-09-30T13:57:21.771032+0000","last_undegraded":"2023-09-30T13:57:21.771032+0000","last_fullsized":"2023-09-30T13:57:21.771032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:41:49.475087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.783330+0000","last_change":"2023-09-30T13:57:21.779479+0000","last_active":"2023-09-30T13:57:21.783330+0000","last_peered":"2023-09-30T13:57:21.783330+0000","last_clean":"2023-09-30T13:57:21.783330+0000","last_became_active":"2023-09-30T13:57:21.779182+0000","last_became_peered":"2023-09-30T13:57:21.779182+0000","last_unstale":"2023-09-30T13:57:21.783330+0000","last_undegraded":"2023-09-30T13:57:21.783330+0000","last_fullsized":"2023-09-30T13:57:21.783330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:03:33.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.768820+0000","last_change":"2023-09-30T13:57:20.768371+0000","last_active":"2023-09-30T13:57:21.768820+0000","last_peered":"2023-09-30T13:57:21.768820+0000","last_clean":"2023-09-30T13:57:21.768820+0000","last_became_active":"2023-09-30T13:57:20.768111+0000","last_became_peered":"2023-09-30T13:57:20.768111+0000","last_unstale":"2023-09-30T13:57:21.768820+0000","last_undegraded":"2023-09-30T13:57:21.768820+0000","last_fullsized":"2023-09-30T13:57:21.768820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T14:59:07.598746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785027+0000","last_change":"2023-09-30T13:57:21.776960+0000","last_active":"2023-09-30T13:57:21.785027+0000","last_peered":"2023-09-30T13:57:21.785027+0000","last_clean":"2023-09-30T13:57:21.785027+0000","last_became_active":"2023-09-30T13:57:21.775433+0000","last_became_peered":"2023-09-30T13:57:21.775433+0000","last_unstale":"2023-09-30T13:57:21.785027+0000","last_undegraded":"2023-09-30T13:57:21.785027+0000","last_fullsized":"2023-09-30T13:57:21.785027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:34:23.811589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765695+0000","last_change":"2023-09-30T13:57:20.763489+0000","last_active":"2023-09-30T13:57:21.765695+0000","last_peered":"2023-09-30T13:57:21.765695+0000","last_clean":"2023-09-30T13:57:21.765695+0000","last_became_active":"2023-09-30T13:57:20.763191+0000","last_became_peered":"2023-09-30T13:57:20.763191+0000","last_unstale":"2023-09-30T13:57:21.765695+0000","last_undegraded":"2023-09-30T13:57:21.765695+0000","last_fullsized":"2023-09-30T13:57:21.765695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:22:53.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.785832+0000","last_change":"2023-09-30T13:57:21.781486+0000","last_active":"2023-09-30T13:57:21.785832+0000","last_peered":"2023-09-30T13:57:21.785832+0000","last_clean":"2023-09-30T13:57:21.785832+0000","last_became_active":"2023-09-30T13:57:21.781198+0000","last_became_peered":"2023-09-30T13:57:21.781198+0000","last_unstale":"2023-09-30T13:57:21.785832+0000","last_undegraded":"2023-09-30T13:57:21.785832+0000","last_fullsized":"2023-09-30T13:57:21.785832+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:46:24.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.769203+0000","last_change":"2023-09-30T13:57:20.765407+0000","last_active":"2023-09-30T13:57:21.769203+0000","last_peered":"2023-09-30T13:57:21.769203+0000","last_clean":"2023-09-30T13:57:21.769203+0000","last_became_active":"2023-09-30T13:57:20.765131+0000","last_became_peered":"2023-09-30T13:57:20.765131+0000","last_unstale":"2023-09-30T13:57:21.769203+0000","last_undegraded":"2023-09-30T13:57:21.769203+0000","last_fullsized":"2023-09-30T13:57:21.769203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:36.460832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.784078+0000","last_change":"2023-09-30T13:57:21.781882+0000","last_active":"2023-09-30T13:57:21.784078+0000","last_peered":"2023-09-30T13:57:21.784078+0000","last_clean":"2023-09-30T13:57:21.784078+0000","last_became_active":"2023-09-30T13:57:21.781628+0000","last_became_peered":"2023-09-30T13:57:21.781628+0000","last_unstale":"2023-09-30T13:57:21.784078+0000","last_undegraded":"2023-09-30T13:57:21.784078+0000","last_fullsized":"2023-09-30T13:57:21.784078+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:20.746190+0000","last_clean_scrub_stamp":"2023-09-30T13:57:20.746190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:42:33.349940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-09-30T13:57:21.765580+0000","last_change":"2023-09-30T13:57:20.767211+0000","last_active":"2023-09-30T13:57:21.765580+0000","last_peered":"2023-09-30T13:57:21.765580+0000","last_clean":"2023-09-30T13:57:21.765580+0000","last_became_active":"2023-09-30T13:57:20.766865+0000","last_became_peered":"2023-09-30T13:57:20.766865+0000","last_unstale":"2023-09-30T13:57:21.765580+0000","last_undegraded":"2023-09-30T13:57:21.765580+0000","last_fullsized":"2023-09-30T13:57:21.765580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:57:19.742031+0000","last_clean_scrub_stamp":"2023-09-30T13:57:19.742031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:48:32.654297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-09-30T13:57:20.761316+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:57:20.761316+0000","last_peered":"2023-09-30T13:57:20.761316+0000","last_clean":"2023-09-30T13:57:20.761316+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:57:20.761316+0000","last_undegraded":"2023-09-30T13:57:20.761316+0000","last_fullsized":"2023-09-30T13:57:20.761316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":858110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.748},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.749,"5min":1.024,"15min":1.024},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.90400000000000003,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":268270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69799999999999995,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53200000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.68200000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.501},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.69099999999999995,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.432}]},{"osd":5,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.442,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:56:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.77800000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":267618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.505,"15min":0.49399999999999999},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39700000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.53500000000000003,"15min":0.52200000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77200000000000002,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73799999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.437,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76800000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":260523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.77800000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44500000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70199999999999996,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77400000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69299999999999995,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.622,"15min":0.63300000000000001},"min":{"1min":0.44500000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.67800000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70599999999999996,"5min":2.202,"15min":2.202},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.73199999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.66900000000000004,"15min":0.68400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75800000000000001,"5min":2.266,"15min":2.266},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":269252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48999999999999999,"5min":0.499,"15min":0.499},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.46400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.38800000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55300000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.372},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.29999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76100000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78400000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81100000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.73999999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Sep 30 13:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77100000000000002,"5min":1.258,"15min":1.258},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":269230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.315,"15min":0.307},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.63200000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.26400000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.24199999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.58599999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.443},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.49199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40200000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.53900000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.54900000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":267778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.22600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61699999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.377,"15min":0.376},"min":{"1min":0.30099999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35199999999999998},"min":{"1min":0.26600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.58799999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.38200000000000001,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88500000000000001,"5min":1.002,"15min":1.002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.45600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.873,"5min":1.161,"15min":1.161},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.503}]},{"osd":7,"last update":"Sat Sep 30 13:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85999999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93100000000000005,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1208320,"data_stored":858042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.218,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.35799999999999998,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.36199999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.23100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.38800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.46400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84299999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.84299999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.52200000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.434}]},{"osd":6,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.53000000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.89600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.54500000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Sep 30 13:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.91100000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.54100000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:57:25.128 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T13:57:25.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-30T13:57:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.273+0000 7f1ba44e0640 1 Processor -- start 2023-09-30T13:57:25.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.273+0000 7f1ba44e0640 1 -- start start 2023-09-30T13:57:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba44e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c1601a0 0x7f1b9c0b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba44e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba44e0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0d20c0 con 0x7f1b9c0d2550 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba44e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0ce2f0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba44e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c160580 con 0x7f1b9c1601a0 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba2a7d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba2a7d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33402/0 (socket says 172.21.15.62:33402) 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.274+0000 7f1ba2a7d640 1 -- 172.21.15.62:0/2684461200 learned_addr learned my addr 172.21.15.62:0/2684461200 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba2a7d640 1 -- 172.21.15.62:0/2684461200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c1601a0 msgr2=0x7f1b9c0b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba2a7d640 1 --2- 172.21.15.62:0/2684461200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c1601a0 0x7f1b9c0b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba2a7d640 1 -- 172.21.15.62:0/2684461200 >> v1:172.21.15.135:6789/0 conn(0x7f1b9c0d2550 legacy=0x7f1b9c0d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:25.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba2a7d640 1 -- 172.21.15.62:0/2684461200 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0d14b0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba2a7d640 1 --2- 172.21.15.62:0/2684461200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009870 tx=0x7f1b9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3470f8c2f82ee25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba127a640 1 -- 172.21.15.62:0/2684461200 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94031640 con 0x7f1b9c0cd920 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.275+0000 7f1ba127a640 1 -- 172.21.15.62:0/2684461200 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940317a0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba127a640 1 -- 172.21.15.62:0/2684461200 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94031b30 con 0x7f1b9c0cd920 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 -- 172.21.15.62:0/2684461200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 msgr2=0x7f1b9c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/2684461200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009870 tx=0x7f1b9402b8f0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 -- 172.21.15.62:0/2684461200 shutdown_connections 2023-09-30T13:57:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/2684461200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c0cddb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/2684461200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c1601a0 0x7f1b9c0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 -- 172.21.15.62:0/2684461200 >> 172.21.15.62:0/2684461200 conn(0x7f1b9c06b520 msgr2=0x7f1b9c06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 -- 172.21.15.62:0/2684461200 shutdown_connections 2023-09-30T13:57:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.276+0000 7f1ba44e0640 1 -- 172.21.15.62:0/2684461200 wait complete. 2023-09-30T13:57:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.277+0000 7f1ba44e0640 1 Processor -- start 2023-09-30T13:57:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.277+0000 7f1ba44e0640 1 -- start start 2023-09-30T13:57:25.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c0d2550 0x7f1b9c0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 0x7f1b9c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cb720 con 0x7f1b9c0cd920 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cba00 con 0x7f1b9c1601a0 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba44e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cbce0 con 0x7f1b9c0d2550 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33410/0 (socket says 172.21.15.62:33410) 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 -- 172.21.15.62:0/1218410435 learned_addr learned my addr 172.21.15.62:0/1218410435 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba1a7b640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c0d2550 0x7f1b9c0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba2a7d640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 0x7f1b9c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 -- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c0d2550 msgr2=0x7f1b9c0b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c0d2550 0x7f1b9c0b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 -- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 msgr2=0x7f1b9c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 0x7f1b9c0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba227c640 1 -- 172.21.15.62:0/1218410435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b940094d0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.278+0000 7f1ba2a7d640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 0x7f1b9c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1ba227c640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba50 tx=0x7f1b8c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00cbe0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00cd60 con 0x7f1b9c0cd920 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c0cbfc0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c014680 con 0x7f1b9c0cd920 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.279+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c1f2250 con 0x7f1b9c0cd920 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.280+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c04e0d0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.280+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1b8c01d3b0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.281+0000 7f1b9affd640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 0x7f1b8806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.281+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b8c0892b0 con 0x7f1b9c0cd920 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.281+0000 7f1ba1a7b640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 0x7f1b8806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.281+0000 7f1ba1a7b640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 0x7f1b8806cff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0b8180 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.285+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1b8c054450 con 0x7f1b9c0cd920 2023-09-30T13:57:25.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.528+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1b9c0d0460 con 0x7f1b9c0cd920 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.530+0000 7f1b9affd640 1 -- 172.21.15.62:0/1218410435 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1b8c057a70 con 0x7f1b9c0cd920 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBwKBhl44ecAxAA5A5/ulasj9z4XotgfXUIyQ== 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stdout: caps mds = "allow" 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stdout: caps mon = "allow r" 2023-09-30T13:57:25.531 INFO:teuthology.orchestra.run.smithi062.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-30T13:57:25.532 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2023-09-30T13:57:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 msgr2=0x7f1b8806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 0x7f1b8806cff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0b8180 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2023-09-30T13:57:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 msgr2=0x7f1b9c1f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba50 tx=0x7f1b8c00bf10 comp rx=0 tx=0).stop 2023-09-30T13:57:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 shutdown_connections 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1b8806ab30 0x7f1b8806cff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b9c1601a0 0x7f1b9c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b9c0d2550 0x7f1b9c0b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 --2- 172.21.15.62:0/1218410435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c0cd920 0x7f1b9c1f1b30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 >> 172.21.15.62:0/1218410435 conn(0x7f1b9c06b520 msgr2=0x7f1b9c15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 shutdown_connections 2023-09-30T13:57:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.533+0000 7f1ba44e0640 1 -- 172.21.15.62:0/1218410435 wait complete. 2023-09-30T13:57:25.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:57:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 Processor -- start 2023-09-30T13:57:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 -- start start 2023-09-30T13:57:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5415d190 con 0x7fac540d0040 2023-09-30T13:57:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac540d05e0 con 0x7fac540ca200 2023-09-30T13:57:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.650+0000 7fac5c67c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540b0900 con 0x7fac5415cdb0 2023-09-30T13:57:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5ac19640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:36890/0 (socket says 172.21.15.62:36890) 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 -- 172.21.15.62:0/943950777 learned_addr learned my addr 172.21.15.62:0/943950777 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5ac19640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:50116/0 (socket says 172.21.15.62:50116) 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac59c17640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fac540d0040 0x7fac540cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:35680/0 (socket says 172.21.15.62:35680) 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 -- 172.21.15.62:0/943950777 >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 msgr2=0x7fac540ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 --2- 172.21.15.62:0/943950777 >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 -- 172.21.15.62:0/943950777 >> v1:172.21.15.135:6789/0 conn(0x7fac540d0040 legacy=0x7fac540cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5a418640 1 -- 172.21.15.62:0/943950777 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540b0be0 con 0x7fac5415cdb0 2023-09-30T13:57:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.651+0000 7fac5ac19640 1 --2- 172.21.15.62:0/943950777 >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:25.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.652+0000 7fac5a418640 1 --2- 172.21.15.62:0/943950777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009850 tx=0x7fac4c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb33f5cd33d109b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.652+0000 7fac59416640 1 -- 172.21.15.62:0/943950777 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c004230 con 0x7fac5415cdb0 2023-09-30T13:57:25.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.652+0000 7fac59416640 1 -- 172.21.15.62:0/943950777 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c004390 con 0x7fac5415cdb0 2023-09-30T13:57:25.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.652+0000 7fac59416640 1 -- 172.21.15.62:0/943950777 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c003810 con 0x7fac5415cdb0 2023-09-30T13:57:25.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 -- 172.21.15.62:0/943950777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 msgr2=0x7fac540cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 --2- 172.21.15.62:0/943950777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009850 tx=0x7fac4c02b960 comp rx=0 tx=0).stop 2023-09-30T13:57:25.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 -- 172.21.15.62:0/943950777 shutdown_connections 2023-09-30T13:57:25.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 --2- 172.21.15.62:0/943950777 >> v2:172.21.15.135:3300/0 conn(0x7fac540ca200 0x7fac540ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 --2- 172.21.15.62:0/943950777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5415cdb0 0x7fac540cbf00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 -- 172.21.15.62:0/943950777 >> 172.21.15.62:0/943950777 conn(0x7fac54098a50 msgr2=0x7fac540cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 -- 172.21.15.62:0/943950777 shutdown_connections 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.653+0000 7fac5c67c640 1 -- 172.21.15.62:0/943950777 wait complete. 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.654+0000 7fac5c67c640 1 Processor -- start 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.654+0000 7fac5c67c640 1 -- start start 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 0x7fac540c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac540d0040 0x7fac541f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415ee20 con 0x7fac5415cdb0 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415f100 con 0x7fac540d0040 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5c67c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415f3e0 con 0x7fac540ca200 2023-09-30T13:57:25.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33418/0 (socket says 172.21.15.62:33418) 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 -- 172.21.15.62:0/361781795 learned_addr learned my addr 172.21.15.62:0/361781795 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac59c17640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac540d0040 0x7fac541f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5a418640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 0x7fac540c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 -- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 msgr2=0x7fac540c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 0x7fac540c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 -- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac540d0040 msgr2=0x7fac541f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac540d0040 0x7fac541f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 -- 172.21.15.62:0/361781795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009a70 con 0x7fac5415cdb0 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5a418640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 0x7fac540c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:25.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.655+0000 7fac5ac19640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fac4400efc0 tx=0x7fac4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44009cd0 con 0x7fac5415cdb0 2023-09-30T13:57:25.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c009460 con 0x7fac5415cdb0 2023-09-30T13:57:25.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4400f040 con 0x7fac5415cdb0 2023-09-30T13:57:25.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44003990 con 0x7fac5415cdb0 2023-09-30T13:57:25.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5415f9a0 con 0x7fac5415cdb0 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.656+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5404e0d0 con 0x7fac5415cdb0 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.657+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fac44014480 con 0x7fac5415cdb0 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.657+0000 7fac52ffd640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 0x7fac4006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.657+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fac44089f20 con 0x7fac5415cdb0 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.658+0000 7fac5a418640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 0x7fac4006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:25.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.658+0000 7fac5a418640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 0x7fac4006cff0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fac4c035000 tx=0x7fac4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:25.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.662+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fac44054fb0 con 0x7fac5415cdb0 2023-09-30T13:57:25.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.876+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac540b1e80 con 0x7fac5415cdb0 2023-09-30T13:57:25.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.876+0000 7fac52ffd640 1 -- 172.21.15.62:0/361781795 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fac440585d0 con 0x7fac5415cdb0 2023-09-30T13:57:25.877 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:25.877 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:57:23.118346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:57:25.877 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 22 2023-09-30T13:57:25.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 msgr2=0x7fac4006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 0x7fac4006cff0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fac4c035000 tx=0x7fac4c008030 comp rx=0 tx=0).stop 2023-09-30T13:57:25.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 msgr2=0x7fac54151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:25.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fac4400efc0 tx=0x7fac4400c490 comp rx=0 tx=0).stop 2023-09-30T13:57:25.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 shutdown_connections 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fac4006ab30 0x7fac4006cff0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac5415cdb0 0x7fac54151840 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac540d0040 0x7fac541f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 --2- 172.21.15.62:0/361781795 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac540ca200 0x7fac540c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 >> 172.21.15.62:0/361781795 conn(0x7fac54098a50 msgr2=0x7fac540cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 shutdown_connections 2023-09-30T13:57:25.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:25.878+0000 7fac5c67c640 1 -- 172.21.15.62:0/361781795 wait complete. 2023-09-30T13:57:26.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T13:57:21.122438+0000', 'modified': '2023-09-30T13:57:23.118346+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6045}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6045': {'gid': 6045, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6836/126973186', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 126973186}, {'type': 'v1', 'addr': '172.21.15.135:6836', 'nonce': 126973186}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T13:57:26.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T13:57:26.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-30T13:57:26.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.403+0000 7f48f597c640 1 Processor -- start 2023-09-30T13:57:26.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48f597c640 1 -- start start 2023-09-30T13:57:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48f597c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48f015dd20 0x7f48f00ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48f597c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00b0000 con 0x7f48f00cb600 2023-09-30T13:57:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48f597c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00b02a0 con 0x7f48f015e100 2023-09-30T13:57:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48f597c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00b0c40 con 0x7f48f015dd20 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48eeffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48f015dd20 0x7f48f00ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48ef7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48f00cb600 0x7f48f00b13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53590/0 (socket says 172.21.15.62:53590) 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.404+0000 7f48ef7fe640 1 -- 172.21.15.62:0/3659492192 learned_addr learned my addr 172.21.15.62:0/3659492192 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.405+0000 7f48eeffd640 1 -- 172.21.15.62:0/3659492192 >> v1:172.21.15.135:6789/0 conn(0x7f48f015e100 legacy=0x7f48f00caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.405+0000 7f48eeffd640 1 -- 172.21.15.62:0/3659492192 >> v1:172.21.15.62:6789/0 conn(0x7f48f00cb600 legacy=0x7f48f00b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.405+0000 7f48eeffd640 1 -- 172.21.15.62:0/3659492192 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00b0580 con 0x7f48f015dd20 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.405+0000 7f48edffb640 1 -- 172.21.15.62:0/3659492192 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416507202 0 0) 0x7f48f00b0000 con 0x7f48f00cb600 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3659492192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f00ca7f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f48e80097a0 tx=0x7f48e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124546b73b36abf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48edffb640 1 -- 172.21.15.62:0/3659492192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8030610 con 0x7f48f015dd20 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48edffb640 1 -- 172.21.15.62:0/3659492192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e8030770 con 0x7f48f015dd20 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48edffb640 1 -- 172.21.15.62:0/3659492192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8030b00 con 0x7f48f015dd20 2023-09-30T13:57:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 -- 172.21.15.62:0/3659492192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 msgr2=0x7f48f00ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 --2- 172.21.15.62:0/3659492192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f00ca7f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f48e80097a0 tx=0x7f48e802b960 comp rx=0 tx=0).stop 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 -- 172.21.15.62:0/3659492192 shutdown_connections 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 --2- 172.21.15.62:0/3659492192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f00ca7f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 -- 172.21.15.62:0/3659492192 >> 172.21.15.62:0/3659492192 conn(0x7f48f006a430 msgr2=0x7f48f006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 -- 172.21.15.62:0/3659492192 shutdown_connections 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.406+0000 7f48f597c640 1 -- 172.21.15.62:0/3659492192 wait complete. 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.407+0000 7f48f597c640 1 Processor -- start 2023-09-30T13:57:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 -- start start 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48f00cb600 0x7f48f00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f015e100 0x7f48f00c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00cad30 con 0x7f48f015dd20 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c2490 con 0x7f48f015e100 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48f597c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0157390 con 0x7f48f00cb600 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.408+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33428/0 (socket says 172.21.15.62:33428) 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 -- 172.21.15.62:0/1587214901 learned_addr learned my addr 172.21.15.62:0/1587214901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48eeffd640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48f00cb600 0x7f48f00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f015e100 0x7f48f00c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 -- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48f00cb600 msgr2=0x7f48f00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48f00cb600 0x7f48f00b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 -- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f015e100 msgr2=0x7f48f00c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f015e100 0x7f48f00c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 -- 172.21.15.62:0/1587214901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009400 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c400 tx=0x7f48d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48e7fff640 1 -- 172.21.15.62:0/1587214901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80052d0 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48e7fff640 1 -- 172.21.15.62:0/1587214901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8005430 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00b33b0 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48e7fff640 1 -- 172.21.15.62:0/1587214901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003830 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.409+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f00b3970 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.411+0000 7f48e7fff640 1 -- 172.21.15.62:0/1587214901 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f48d8003990 con 0x7f48f015dd20 2023-09-30T13:57:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.411+0000 7f48e7fff640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 0x7f48d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.411+0000 7f48e7fff640 1 -- 172.21.15.62:0/1587214901 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f48d8088810 con 0x7f48f015dd20 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.411+0000 7f48eeffd640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 0x7f48d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.412+0000 7f48eeffd640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 0x7f48d006cff0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f48e8036000 tx=0x7f48e803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.412+0000 7f48f85ec740 1 Processor -- start 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.412+0000 7f48f85ec740 1 -- start start 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf1e0 0x561ae53920e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae5304770 con 0x561ae5392620 2023-09-30T13:57:26.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae5301e60 con 0x561ae53bf5c0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae52fd750 con 0x561ae53bf1e0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33440/0 (socket says 172.21.15.62:33440) 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 -- 172.21.15.62:0/1469263531 learned_addr learned my addr 172.21.15.62:0/1469263531 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48eeffd640 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf1e0 0x561ae53920e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 -- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf1e0 msgr2=0x561ae53920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf1e0 0x561ae53920e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 -- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 msgr2=0x561ae53c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 -- 172.21.15.62:0/1469263531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae52fbdd0 con 0x561ae5392620 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.413+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001e30 tx=0x7f48e000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c5dac56c2504f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48e57fa640 1 -- 172.21.15.62:0/1469263531 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000de30 con 0x561ae5392620 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48e57fa640 1 -- 172.21.15.62:0/1469263531 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0004b60 con 0x561ae5392620 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48e57fa640 1 -- 172.21.15.62:0/1469263531 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00070d0 con 0x561ae5392620 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 -- 172.21.15.62:0/1469263531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 msgr2=0x561ae53c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001e30 tx=0x7f48e000d520 comp rx=0 tx=0).stop 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 -- 172.21.15.62:0/1469263531 shutdown_connections 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae5392620 0x561ae53c24b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 --2- 172.21.15.62:0/1469263531 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf1e0 0x561ae53920e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 -- 172.21.15.62:0/1469263531 >> 172.21.15.62:0/1469263531 conn(0x561ae53943f0 msgr2=0x561ae53dcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 -- 172.21.15.62:0/1469263531 shutdown_connections 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.414+0000 7f48f85ec740 1 -- 172.21.15.62:0/1469263531 wait complete. 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.415+0000 7f48f85ec740 1 -- start start 2023-09-30T13:57:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.415+0000 7f48f85ec740 1 Processor -- start 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf5c0 0x561ae53c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53ac9c0 0x561ae53ba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae529b820 con 0x561ae53bf1e0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae529b4c0 con 0x561ae53ac9c0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae527e240 con 0x561ae53bf5c0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 10 client.0 _ll_register_callbacks cb 0x561ae52bd9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33450/0 (socket says 172.21.15.62:33450) 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 -- 172.21.15.62:0/996112922 learned_addr learned my addr 172.21.15.62:0/996112922 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf5c0 0x561ae53c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53ac9c0 0x561ae53ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 -- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf5c0 msgr2=0x561ae53c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf5c0 0x561ae53c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 -- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53ac9c0 msgr2=0x561ae53ba340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53ac9c0 0x561ae53ba340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 -- 172.21.15.62:0/996112922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e0001a30 con 0x561ae53bf1e0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48eeffd640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009890 tx=0x7f48e802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2442b024a044c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e804d040 con 0x561ae53bf1e0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f48e80399e0 con 0x561ae53bf1e0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.416+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ae53231b0 con 0x561ae53bf1e0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48e803e040 con 0x561ae53bf1e0 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 10 client.6168 fetch_fsmap learned FSMap version 22 2023-09-30T13:57:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561ae52d8470 con 0x561ae53bf1e0 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ae53231b0 con 0x561ae53bf1e0 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f48e8041030 con 0x561ae53bf1e0 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 10 client.6168 fetch_fsmap finished waiting for FSMap version 22 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 10 client.6168 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 20 client.6168 populate_metadata read hostname 'smithi062' 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53b8a60 0x561ae53c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 4 client.6168 mds_command: new command op to 6045 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 --> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ae52d0e60 con 0x561ae53b8a60 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.417+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53b8a60 0x561ae53c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.418+0000 7f48ce7fc640 10 client.6168 ms_handle_connect on v2:172.21.15.135:6834/126973186 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.418+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53b8a60 0x561ae53c4010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea79f8bc31a3a92 server_cookie=832eab64cd344aa7 in_seq=0 out_seq=0 2023-09-30T13:57:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48ce7fc640 1 -- 172.21.15.62:0/996112922 <== mds.0 v2:172.21.15.135:6834/126973186 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ae52d0e60 con 0x561ae53b8a60 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48ce7fc640 10 client.6168 handle_command_reply: tid=0 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 client.6168 shutdown 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 msgr2=0x561ae53ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009890 tx=0x7f48e802e000 comp rx=0 tx=0).stop 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 shutdown_connections 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53b8a60 0x561ae53c4010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53ac9c0 0x561ae53ba340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53bf5c0 0x561ae53c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48ce7fc640 0 client.6168 ms_handle_reset on v2:172.21.15.135:6834/126973186 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 --2- 172.21.15.62:0/996112922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53ac440 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 >> 172.21.15.62:0/996112922 conn(0x561ae5392620 msgr2=0x561ae5395f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 shutdown_connections 2023-09-30T13:57:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 1 -- 172.21.15.62:0/996112922 wait complete. 2023-09-30T13:57:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.419+0000 7f48f85ec740 20 client.6168 trim_cache size 0 max 16384 2023-09-30T13:57:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.434+0000 7f48f85ec740 1 Processor -- start 2023-09-30T13:57:26.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.434+0000 7f48f85ec740 1 -- start start 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae532fe20 con 0x561ae53bf1e0 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae5393b40 con 0x561ae53bf5c0 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae53c52c0 con 0x561ae53ac9c0 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33464/0 (socket says 172.21.15.62:33464) 2023-09-30T13:57:26.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.435+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3419694615 learned_addr learned my addr 172.21.15.62:0/3419694615 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 msgr2=0x561ae53ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 msgr2=0x561ae53c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3419694615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae532c500 con 0x561ae53bf1e0 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f48d8001eb0 tx=0x7f48d8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6810ec9bbdf9aa70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48e5ffb640 1 -- 172.21.15.62:0/3419694615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8055a10 con 0x561ae53bf1e0 2023-09-30T13:57:26.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48e5ffb640 1 -- 172.21.15.62:0/3419694615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8053d80 con 0x561ae53bf1e0 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48e5ffb640 1 -- 172.21.15.62:0/3419694615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d805f720 con 0x561ae53bf1e0 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.436+0000 7f48f85ec740 1 -- 172.21.15.62:0/3419694615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 msgr2=0x561ae53c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f48d8001eb0 tx=0x7f48d8014040 comp rx=0 tx=0).stop 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 -- 172.21.15.62:0/3419694615 shutdown_connections 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c3150 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3419694615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 -- 172.21.15.62:0/3419694615 >> 172.21.15.62:0/3419694615 conn(0x561ae5392620 msgr2=0x561ae53bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 -- 172.21.15.62:0/3419694615 shutdown_connections 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 -- 172.21.15.62:0/3419694615 wait complete. 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 -- start start 2023-09-30T13:57:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.437+0000 7f48f85ec740 1 Processor -- start 2023-09-30T13:57:26.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae53fce30 con 0x561ae53bf1e0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae53c6390 con 0x561ae53bf5c0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae53c60b0 con 0x561ae53ac9c0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48f85ec740 10 client.0 _ll_register_callbacks cb 0x7f48e8009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33478/0 (socket says 172.21.15.62:33478) 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3859501847 learned_addr learned my addr 172.21.15.62:0/3859501847 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 msgr2=0x561ae53c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 msgr2=0x561ae53ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ee7fc640 1 -- 172.21.15.62:0/3859501847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f00b3970 con 0x561ae53bf1e0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.438+0000 7f48ef7fe640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ee7fc640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f48d800cdc0 tx=0x7f48d801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e134add60e327b00 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8077020 con 0x561ae53bf1e0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f48d8080bb0 con 0x561ae53bf1e0 2023-09-30T13:57:26.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48e0004b60 con 0x561ae53bf1e0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48d8080d70 con 0x561ae53bf1e0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 10 client.6174 fetch_fsmap learned FSMap version 22 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561ae529acd0 con 0x561ae53bf1e0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0004b60 con 0x561ae53bf1e0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f48d807a020 con 0x561ae53bf1e0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 10 client.6174 fetch_fsmap finished waiting for FSMap version 22 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 10 client.6174 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 20 client.6174 populate_metadata read hostname 'smithi062' 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53fd2c0 0x561ae53ff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 4 client.6174 mds_command: new command op to 6045 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 --> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ae52f6730 con 0x561ae53fd2c0 2023-09-30T13:57:26.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.439+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53fd2c0 0x561ae53ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48ce7fc640 10 client.6174 ms_handle_connect on v2:172.21.15.135:6834/126973186 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48eeffd640 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53fd2c0 0x561ae53ff870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866db2defe4026e5 server_cookie=f830698d8405bc1e in_seq=0 out_seq=0 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48ce7fc640 1 -- 172.21.15.62:0/3859501847 <== mds.0 v2:172.21.15.135:6834/126973186 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f48e804a160 con 0x561ae53fd2c0 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48ce7fc640 10 client.6174 handle_command_reply: tid=0 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 client.6174 shutdown 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 msgr2=0x561ae53c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f48d800cdc0 tx=0x7f48d801e040 comp rx=0 tx=0).stop 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 shutdown_connections 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:6834/126973186,v1:172.21.15.135:6836/126973186] conn(0x561ae53fd2c0 0x561ae53ff870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ae53bf5c0 0x561ae53ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561ae53bf1e0 0x561ae53c5a20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 --2- 172.21.15.62:0/3859501847 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x561ae53ac9c0 0x561ae53c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48ce7fc640 0 client.6174 ms_handle_reset on v2:172.21.15.135:6834/126973186 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 >> 172.21.15.62:0/3859501847 conn(0x561ae5392620 msgr2=0x561ae53c3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 shutdown_connections 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.440+0000 7f48f85ec740 1 -- 172.21.15.62:0/3859501847 wait complete. 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f85ec740 20 client.6174 trim_cache size 0 max 16384 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "79595c1b-6895-4c76-9183-336503666b5b", 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 6045, 2023-09-30T13:57:26.448 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 4.6705360809999998, 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 22, 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 52, 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 52, 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 10.681466217000001 2023-09-30T13:57:26.449 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 msgr2=0x7f48d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 0x7f48d006cff0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f48e8036000 tx=0x7f48e803b040 comp rx=0 tx=0).stop 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 msgr2=0x7f48f0158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c400 tx=0x7f48d800c8c0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 shutdown_connections 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f48d006ab30 0x7f48d006cff0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f015e100 0x7f48f00c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48f015dd20 0x7f48f0158a10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 --2- 172.21.15.62:0/1587214901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48f00cb600 0x7f48f00b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 >> 172.21.15.62:0/1587214901 conn(0x7f48f006a430 msgr2=0x7f48f006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 shutdown_connections 2023-09-30T13:57:26.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.441+0000 7f48f597c640 1 -- 172.21.15.62:0/1587214901 wait complete. 2023-09-30T13:57:26.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:57:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.560+0000 7fe058651640 1 Processor -- start 2023-09-30T13:57:26.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.560+0000 7fe058651640 1 -- start start 2023-09-30T13:57:26.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe058651640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0500ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe058651640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500b1e20 con 0x7fe0501598c0 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe058651640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500b1530 con 0x7fe0500c8c90 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe058651640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500b17d0 con 0x7fe0500cf140 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe0563ed640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe0501598c0 0x7fe0500cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53596/0 (socket says 172.21.15.62:53596) 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.561+0000 7fe0563ed640 1 -- 172.21.15.62:0/740634809 learned_addr learned my addr 172.21.15.62:0/740634809 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe055bec640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0500ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879491923 0 0) 0x7fe0500b1e20 con 0x7fe0501598c0 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe038003520 con 0x7fe0501598c0 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605653968 0 0) 0x7fe0500b1530 con 0x7fe0500c8c90 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0500b1e20 con 0x7fe0500c8c90 2023-09-30T13:57:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517891394 0 0) 0x7fe038003520 con 0x7fe0501598c0 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 msgr2=0x7fe0500ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0500ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 >> v1:172.21.15.135:6789/0 conn(0x7fe0500c8c90 legacy=0x7fe0500c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500b1ab0 con 0x7fe0501598c0 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fe0480017f0 con 0x7fe0501598c0 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 >> v1:172.21.15.62:6789/0 conn(0x7fe0501598c0 legacy=0x7fe0500cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe038003b30 0x7fe038003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038004d00 0x7fe038005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500b17d0 con 0x7fe038003b30 2023-09-30T13:57:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800ba60 con 0x7fe038004d00 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800bc20 con 0x7fe0500cf140 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe038003b30 0x7fe038003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe055bec640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe056bee640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038004d00 0x7fe038005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 -- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 msgr2=0x7fe0380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500cf140 0x7fe0380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 -- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038004d00 msgr2=0x7fe038005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038004d00 0x7fe038005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe0563ed640 1 -- 172.21.15.62:0/740634809 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038003520 con 0x7fe038003b30 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.562+0000 7fe056bee640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038004d00 0x7fe038005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.563+0000 7fe0563ed640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe038003b30 0x7fe038003f30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c190 tx=0x7fe0380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77d4d64e8d67bb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.563+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048007270 con 0x7fe038003b30 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.563+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0480073d0 con 0x7fe038003b30 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.563+0000 7fe0553eb640 1 -- 172.21.15.62:0/740634809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04802c850 con 0x7fe038003b30 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 -- 172.21.15.62:0/740634809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe038003b30 msgr2=0x7fe038003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 --2- 172.21.15.62:0/740634809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe038003b30 0x7fe038003f30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c190 tx=0x7fe0380057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe056bee640 1 -- 172.21.15.62:0/740634809 reap_dead start 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 -- 172.21.15.62:0/740634809 shutdown_connections 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 -- 172.21.15.62:0/740634809 >> 172.21.15.62:0/740634809 conn(0x7fe05006a170 msgr2=0x7fe05006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 -- 172.21.15.62:0/740634809 shutdown_connections 2023-09-30T13:57:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.564+0000 7fe058651640 1 -- 172.21.15.62:0/740634809 wait complete. 2023-09-30T13:57:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.565+0000 7fe058651640 1 Processor -- start 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.565+0000 7fe058651640 1 -- start start 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038003b30 0x7fe0501533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05006c360 0x7fe050151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050158c70 con 0x7fe0500abb70 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05006cbf0 con 0x7fe038003b30 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe058651640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05006ced0 con 0x7fe05006c360 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33492/0 (socket says 172.21.15.62:33492) 2023-09-30T13:57:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 -- 172.21.15.62:0/3662050798 learned_addr learned my addr 172.21.15.62:0/3662050798 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe0563ed640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038003b30 0x7fe0501533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe056bee640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05006c360 0x7fe050151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 -- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05006c360 msgr2=0x7fe050151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05006c360 0x7fe050151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 -- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038003b30 msgr2=0x7fe0501533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038003b30 0x7fe0501533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.566+0000 7fe055bec640 1 -- 172.21.15.62:0/3662050798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050153930 con 0x7fe0500abb70 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe055bec640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe0440119a0 tx=0x7fe044011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400faf0 con 0x7fe0500abb70 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400fc50 con 0x7fe0500abb70 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05006c7e0 con 0x7fe0500abb70 2023-09-30T13:57:26.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044014440 con 0x7fe0500abb70 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.567+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe050152310 con 0x7fe0500abb70 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.568+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0500ca420 con 0x7fe0500abb70 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.568+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe0440145a0 con 0x7fe0500abb70 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.569+0000 7fe04effd640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 0x7fe03c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.569+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe044089a30 con 0x7fe0500abb70 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.569+0000 7fe0563ed640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 0x7fe03c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.569+0000 7fe0563ed640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 0x7fe03c06cff0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe048034000 tx=0x7fe048007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:26.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.573+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe044054c80 con 0x7fe0500abb70 2023-09-30T13:57:26.744 INFO:tasks.ceph.mds.b.smithi135.stderr:2023-09-30T13:57:26.744+0000 7fcff65d6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T13:57:26.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.786+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe05006cd30 con 0x7fe0500abb70 2023-09-30T13:57:26.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.787+0000 7fe04effd640 1 -- 172.21.15.62:0/3662050798 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe05006cd30 con 0x7fe0500abb70 2023-09-30T13:57:26.787 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T13:57:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.788+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 msgr2=0x7fe03c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.788+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 0x7fe03c06cff0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe048034000 tx=0x7fe048007000 comp rx=0 tx=0).stop 2023-09-30T13:57:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 msgr2=0x7fe05006be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe0440119a0 tx=0x7fe044011e60 comp rx=0 tx=0).stop 2023-09-30T13:57:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 shutdown_connections 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe03c06ab30 0x7fe03c06cff0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe05006c360 0x7fe050151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0500abb70 0x7fe05006be20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 --2- 172.21.15.62:0/3662050798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe038003b30 0x7fe0501533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 >> 172.21.15.62:0/3662050798 conn(0x7fe05006a170 msgr2=0x7fe0500713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 shutdown_connections 2023-09-30T13:57:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:26.789+0000 7fe058651640 1 -- 172.21.15.62:0/3662050798 wait complete. 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:57:26.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:26.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:26.801 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42547sec preferred_lft 42547sec 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.817 INFO:teuthology.orchestra.run.smithi062.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1036:68ff:fe6f:69f4/64 scope link 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 76:90:4c:92:44:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::7490:4cff:fe92:4462/64 scope link 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:26.818 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::19:42ff:fea1:ef3d/64 scope link 2023-09-30T13:57:26.819 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:26.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:26.819 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:57:26.885 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:57:26.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:26.887 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:57:26.942 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:57:26.944 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:57:26.944 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:57:26.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:57:26.944 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:57:26.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:57:26.945 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:57:27.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.049 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:57:27.064 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T13:57:27.064 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T13:57:27.064 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:27.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-09-30T13:57:27.135 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T13:57:27.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:27.135 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:27.190 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:27.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:27.191 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:27.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:57:27.317 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:27.373 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:57:27.374 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:27.375 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:57:27.376 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:57:27.377 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:27.377 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:27.377 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:27.377 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:27.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.377 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:57:27.429 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:57:27.429 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T13:57:27.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:57:27.502 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:27.558 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:57:27.558 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:57:27.558 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:57:27.558 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:57:27.559 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:57:27.560 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:27.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.561 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:57:27.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:2023-09-30T13:57:27.564+0000 7f47a1e35480 -1 init, newargv = 0x55d362d348d0 newargc=15 2023-09-30T13:57:27.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[107808]: starting ceph client 2023-09-30T13:57:27.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[107808]: starting fuse 2023-09-30T13:57:27.579 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:57:27.580 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:57:27.580 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:57:27.581 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2023-09-30T13:57:27.582 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:57:27.706 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.107808.asok 2023-09-30T13:57:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:57:27.716 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107808.asok 2023-09-30T13:57:27.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107808.asok status 2023-09-30T13:57:27.856 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "0", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "107808", 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:27.857 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 6189, 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 6189 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:27.858 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 178821775 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 178821775 2023-09-30T13:57:27.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.6189 192.168.0.1:0/178821775", 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/178821775", 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 22, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 52, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:57:27.860 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:57:27.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.865 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:57:27.865 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:27.880 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:57:27.880 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:27.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:27.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:27.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:57:28.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.097+0000 7f8a373fb640 1 Processor -- start 2023-09-30T13:57:28.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.097+0000 7f8a373fb640 1 -- start start 2023-09-30T13:57:28.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a373fb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a301598c0 0x7f8a300ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a373fb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300b1e20 con 0x7f8a300cea30 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a373fb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3015e340 con 0x7f8a300ceea0 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a373fb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300b1530 con 0x7f8a301598c0 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a35197640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a301598c0 0x7f8a300ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a34996640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8a300cea30 0x7f8a3015d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39232/0 (socket says 172.21.15.62:39232) 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a34996640 1 -- 172.21.15.62:0/1406697766 learned_addr learned my addr 172.21.15.62:0/1406697766 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a35197640 1 -- 172.21.15.62:0/1406697766 >> v1:172.21.15.135:6789/0 conn(0x7f8a300ceea0 legacy=0x7f8a3015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a35197640 1 -- 172.21.15.62:0/1406697766 >> v1:172.21.15.62:6789/0 conn(0x7f8a300cea30 legacy=0x7f8a3015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a27fff640 1 -- 172.21.15.62:0/1406697766 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220737602 0 0) 0x7f8a300b1e20 con 0x7f8a300cea30 2023-09-30T13:57:28.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.098+0000 7f8a35197640 1 -- 172.21.15.62:0/1406697766 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300b17d0 con 0x7f8a301598c0 2023-09-30T13:57:28.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a35197640 1 --2- 172.21.15.62:0/1406697766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a300ccc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0097c0 tx=0x7f8a2c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a28fc2a88e406dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:28.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a27fff640 1 -- 172.21.15.62:0/1406697766 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c031800 con 0x7f8a301598c0 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a27fff640 1 -- 172.21.15.62:0/1406697766 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c031960 con 0x7f8a301598c0 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a27fff640 1 -- 172.21.15.62:0/1406697766 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c031cf0 con 0x7f8a301598c0 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a373fb640 1 -- 172.21.15.62:0/1406697766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 msgr2=0x7f8a300ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a373fb640 1 --2- 172.21.15.62:0/1406697766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a300ccc20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0097c0 tx=0x7f8a2c02b8a0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a373fb640 1 -- 172.21.15.62:0/1406697766 shutdown_connections 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a373fb640 1 --2- 172.21.15.62:0/1406697766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a300ccc20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.099+0000 7f8a373fb640 1 -- 172.21.15.62:0/1406697766 >> 172.21.15.62:0/1406697766 conn(0x7f8a3006a170 msgr2=0x7f8a3006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.100+0000 7f8a373fb640 1 -- 172.21.15.62:0/1406697766 shutdown_connections 2023-09-30T13:57:28.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.100+0000 7f8a373fb640 1 -- 172.21.15.62:0/1406697766 wait complete. 2023-09-30T13:57:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 Processor -- start 2023-09-30T13:57:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 -- start start 2023-09-30T13:57:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a300cea30 0x7f8a3015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:28.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a300ceea0 0x7f8a301ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3015b1f0 con 0x7f8a301598c0 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3015cc50 con 0x7f8a300ceea0 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.101+0000 7f8a373fb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a301efd80 con 0x7f8a300cea30 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58484/0 (socket says 172.21.15.62:58484) 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 -- 172.21.15.62:0/3001763207 learned_addr learned my addr 172.21.15.62:0/3001763207 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a34996640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a300ceea0 0x7f8a301ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:28.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 -- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a300cea30 msgr2=0x7f8a3015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a300cea30 0x7f8a3015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 -- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a300ceea0 msgr2=0x7f8a301ef300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a300ceea0 0x7f8a301ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 -- 172.21.15.62:0/3001763207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0093a0 con 0x7f8a301598c0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a35998640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c780 tx=0x7f8a2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28003d80 con 0x7f8a301598c0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2800ce90 con 0x7f8a301598c0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300af740 con 0x7f8a301598c0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280052b0 con 0x7f8a301598c0 2023-09-30T13:57:28.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.102+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3015ab30 con 0x7f8a301598c0 2023-09-30T13:57:28.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.103+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3004e0d0 con 0x7f8a301598c0 2023-09-30T13:57:28.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.104+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8a28005410 con 0x7f8a301598c0 2023-09-30T13:57:28.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.104+0000 7f8a25ffb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 0x7f8a1406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:28.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.104+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8a28088760 con 0x7f8a301598c0 2023-09-30T13:57:28.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.105+0000 7f8a35197640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 0x7f8a1406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:28.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.105+0000 7f8a35197640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 0x7f8a1406cff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c036000 tx=0x7f8a2c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:28.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.108+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8a28053900 con 0x7f8a301598c0 2023-09-30T13:57:28.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.322+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a300b3410 con 0x7f8a301598c0 2023-09-30T13:57:28.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.323+0000 7f8a25ffb640 1 -- 172.21.15.62:0/3001763207 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a28017060 con 0x7f8a301598c0 2023-09-30T13:57:28.323 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 msgr2=0x7f8a1406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 0x7f8a1406cff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c036000 tx=0x7f8a2c030000 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 msgr2=0x7f8a301ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c780 tx=0x7f8a2800cc40 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 shutdown_connections 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8a1406ab30 0x7f8a1406cff0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a301598c0 0x7f8a301ef840 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a300ceea0 0x7f8a301ef300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 --2- 172.21.15.62:0/3001763207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a300cea30 0x7f8a3015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 >> 172.21.15.62:0/3001763207 conn(0x7f8a3006a170 msgr2=0x7f8a300abac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 shutdown_connections 2023-09-30T13:57:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:28.325+0000 7f8a373fb640 1 -- 172.21.15.62:0/3001763207 wait complete. 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:57:28.336 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:57:28.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.337 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-09-30T13:57:28.355 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:57:28.355 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:57:28.355 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:57:28.355 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:28.356 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42547sec preferred_lft 42547sec 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::6cbb:34ff:fe6b:3087/64 scope link 2023-09-30T13:57:28.357 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 96:13:a8:d8:bd:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::9413:a8ff:fed8:bd0b/64 scope link 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether be:ca:13:d8:10:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::bcca:13ff:fed8:10d9/64 scope link 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:28.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.358 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:57:28.425 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-09-30T13:57:28.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.426 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-09-30T13:57:28.484 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-09-30T13:57:28.484 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:57:28.484 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:57:28.484 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:57:28.484 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:57:28.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:57:28.485 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-09-30T13:57:28.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.585 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:57:28.600 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T13:57:28.600 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T13:57:28.600 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:57:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-09-30T13:57:28.667 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-09-30T13:57:28.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:28.667 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:28.722 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-30T13:57:28.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:28.723 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:28.777 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:57:28.845 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:28.901 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:57:28.901 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:57:28.902 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:28.903 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:57:28.904 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:57:28.905 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:57:28.905 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:57:28.905 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:57:28.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:28.905 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:57:28.956 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:57:28.956 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-09-30T13:57:28.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2023-09-30T13:57:29.024 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2023-09-30T13:57:29.081 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2023-09-30T13:57:29.082 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:29.083 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-4 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-5 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-6 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-7 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:57:29.084 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:57:29.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:29.085 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2023-09-30T13:57:29.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:2023-09-30T13:57:29.083+0000 7f296c1fd480 -1 init, newargv = 0x56015f6f3d50 newargc=15 2023-09-30T13:57:29.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[95424]: starting ceph client 2023-09-30T13:57:29.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[95424]: starting fuse 2023-09-30T13:57:29.099 INFO:teuthology.orchestra.run.smithi135.stdout:41 2023-09-30T13:57:29.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> import re 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> import os 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2023-09-30T13:57:29.100 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2023-09-30T13:57:29.101 DEBUG:teuthology.orchestra.run.smithi135:> return f 2023-09-30T13:57:29.102 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:57:29.102 DEBUG:teuthology.orchestra.run.smithi135:> 2023-09-30T13:57:29.102 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.1")) 2023-09-30T13:57:29.102 DEBUG:teuthology.orchestra.run.smithi135:> ' 2023-09-30T13:57:29.218 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.1.95424.asok 2023-09-30T13:57:29.221 INFO:teuthology.orchestra.run.smithi135.stderr:2023-09-30T13:57:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:57:29.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95424.asok 2023-09-30T13:57:29.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:29.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95424.asok status 2023-09-30T13:57:29.363 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-09-30T13:57:29.363 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2023-09-30T13:57:29.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:57:29.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:57:29.363 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "1", 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "95424", 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 5713, 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2023-09-30T13:57:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 5713 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1252859751 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:29.365 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1252859751 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.5713 192.168.0.1:0/1252859751", 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/1252859751", 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 22, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 52, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2023-09-30T13:57:29.366 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-09-30T13:57:29.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:29.371 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2023-09-30T13:57:29.371 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:29.386 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2023-09-30T13:57:29.386 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:29.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:29.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-30T13:57:29.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set client client_inject_fixed_oldest_tid true 2023-09-30T13:57:29.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.574+0000 7fb51359e640 1 Processor -- start 2023-09-30T13:57:29.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.574+0000 7fb51359e640 1 -- start start 2023-09-30T13:57:29.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 0x7fb5140d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51359e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5140ce6c0 0x7fb5140d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51359e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5140d1870 con 0x7fb5140d0ed0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51359e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5140d0090 con 0x7fb5140ce6c0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51359e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cf1e0 con 0x7fb51415c9c0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb512d9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5140ce6c0 0x7fb5140d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb51259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 0x7fb5140d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb511d9b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb5140d0ed0 0x7fb5141604c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:44762/0 (socket says 172.21.15.62:44762) 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.575+0000 7fb511d9b640 1 -- 172.21.15.62:0/2902488750 learned_addr learned my addr 172.21.15.62:0/2902488750 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb512d9d640 1 -- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 msgr2=0x7fb5140d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb512d9d640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 0x7fb5140d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb512d9d640 1 -- 172.21.15.62:0/2902488750 >> v1:172.21.15.135:6789/0 conn(0x7fb5140d0ed0 legacy=0x7fb5141604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb512d9d640 1 -- 172.21.15.62:0/2902488750 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51415cda0 con 0x7fb5140ce6c0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb51159a640 1 -- 172.21.15.62:0/2902488750 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174552469 0 0) 0x7fb5140d1870 con 0x7fb5140d0ed0 2023-09-30T13:57:29.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.576+0000 7fb51259c640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 0x7fb5140d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb512d9d640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5140ce6c0 0x7fb5140d1330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb51415cf90 tx=0x7fb50c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc871c4642be342 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51159a640 1 -- 172.21.15.62:0/2902488750 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c031800 con 0x7fb5140ce6c0 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51159a640 1 -- 172.21.15.62:0/2902488750 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c031960 con 0x7fb5140ce6c0 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51159a640 1 -- 172.21.15.62:0/2902488750 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c031cf0 con 0x7fb5140ce6c0 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 -- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5140ce6c0 msgr2=0x7fb5140d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5140ce6c0 0x7fb5140d1330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb51415cf90 tx=0x7fb50c02b8a0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 -- 172.21.15.62:0/2902488750 shutdown_connections 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5140ce6c0 0x7fb5140d1330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 --2- 172.21.15.62:0/2902488750 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb51415c9c0 0x7fb5140d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 -- 172.21.15.62:0/2902488750 >> 172.21.15.62:0/2902488750 conn(0x7fb514089fe0 msgr2=0x7fb51409bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:29.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.577+0000 7fb51359e640 1 -- 172.21.15.62:0/2902488750 shutdown_connections 2023-09-30T13:57:29.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.578+0000 7fb51359e640 1 -- 172.21.15.62:0/2902488750 wait complete. 2023-09-30T13:57:29.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.579+0000 7fb51359e640 1 Processor -- start 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.579+0000 7fb51359e640 1 -- start start 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5140ce6c0 0x7fb5140caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb51415c9c0 0x7fb5140b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cc800 con 0x7fb5140d0ed0 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cb580 con 0x7fb51415c9c0 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51359e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cb860 con 0x7fb5140ce6c0 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58496/0 (socket says 172.21.15.62:58496) 2023-09-30T13:57:29.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 -- 172.21.15.62:0/1192188488 learned_addr learned my addr 172.21.15.62:0/1192188488 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb512d9d640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb51415c9c0 0x7fb5140b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb51259c640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5140ce6c0 0x7fb5140caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 -- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5140ce6c0 msgr2=0x7fb5140caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5140ce6c0 0x7fb5140caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 -- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb51415c9c0 msgr2=0x7fb5140b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb51415c9c0 0x7fb5140b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 -- 172.21.15.62:0/1192188488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009a70 con 0x7fb5140d0ed0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.580+0000 7fb511d9b640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c4d0 tx=0x7fb4fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.581+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0074e0 con 0x7fb5140d0ed0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.581+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc007660 con 0x7fb5140d0ed0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.581+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c009400 con 0x7fb5140d0ed0 2023-09-30T13:57:29.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.581+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc004a20 con 0x7fb5140d0ed0 2023-09-30T13:57:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.581+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51409ce30 con 0x7fb5140d0ed0 2023-09-30T13:57:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.582+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb514073e70 con 0x7fb5140d0ed0 2023-09-30T13:57:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.582+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb4fc004b80 con 0x7fb5140d0ed0 2023-09-30T13:57:29.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.583+0000 7fb50affd640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 0x7fb4f406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.583+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb4fc088720 con 0x7fb5140d0ed0 2023-09-30T13:57:29.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.583+0000 7fb51259c640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 0x7fb4f406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.583+0000 7fb51259c640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 0x7fb4f406d020 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb504011520 tx=0x7fb50400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.587+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb4fc053970 con 0x7fb5140d0ed0 2023-09-30T13:57:29.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.762+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=client_inject_fixed_oldest_tid}] v 0) v1 -- 0x7fb51408ca20 con 0x7fb5140d0ed0 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.765+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_inject_fixed_oldest_tid}]=0 v17)=0 v17) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb4fc056f90 con 0x7fb5140d0ed0 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.766+0000 7fb50affd640 1 -- 172.21.15.62:0/1192188488 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb4fc053970 con 0x7fb5140d0ed0 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 msgr2=0x7fb4f406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 0x7fb4f406d020 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb504011520 tx=0x7fb50400b040 comp rx=0 tx=0).stop 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 msgr2=0x7fb5140caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c4d0 tx=0x7fb4fc00c990 comp rx=0 tx=0).stop 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 shutdown_connections 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb4f406ab60 0x7fb4f406d020 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb51415c9c0 0x7fb5140b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5140d0ed0 0x7fb5140caf50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 --2- 172.21.15.62:0/1192188488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5140ce6c0 0x7fb5140caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 >> 172.21.15.62:0/1192188488 conn(0x7fb514089fe0 msgr2=0x7fb5140d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 shutdown_connections 2023-09-30T13:57:29.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.767+0000 7fb51359e640 1 -- 172.21.15.62:0/1192188488 wait complete. 2023-09-30T13:57:29.782 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:29.782 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:29.797 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:57:29.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.943+0000 7f8dd011d640 1 Processor -- start 2023-09-30T13:57:29.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.943+0000 7f8dd011d640 1 -- start start 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8dc81598c0 0x7f8dc80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc80cea30 0x7f8dc80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8dc815d520 0x7f8dc815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80b1e20 con 0x7f8dc81598c0 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80cf3b0 con 0x7f8dc815d520 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dd011d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80b1530 con 0x7f8dc80cea30 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8dc81598c0 0x7f8dc80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8dc81598c0 0x7f8dc80ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58504/0 (socket says 172.21.15.62:58504) 2023-09-30T13:57:29.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 -- 172.21.15.62:0/3054872854 learned_addr learned my addr 172.21.15.62:0/3054872854 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 -- 172.21.15.62:0/3054872854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc80cea30 msgr2=0x7f8dc80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/3054872854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc80cea30 0x7f8dc80cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 -- 172.21.15.62:0/3054872854 >> v2:172.21.15.135:3300/0 conn(0x7f8dc815d520 msgr2=0x7f8dc815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/3054872854 >> v2:172.21.15.135:3300/0 conn(0x7f8dc815d520 0x7f8dc815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.944+0000 7f8dcdeb9640 1 -- 172.21.15.62:0/3054872854 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80b17d0 con 0x7f8dc81598c0 2023-09-30T13:57:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/3054872854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc81598c0 0x7f8dc80ccc20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80c56a0 tx=0x7f8dc402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60abf7a0f16e614c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dcceb7640 1 -- 172.21.15.62:0/3054872854 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4004230 con 0x7f8dc81598c0 2023-09-30T13:57:29.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dcceb7640 1 -- 172.21.15.62:0/3054872854 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8dc4004390 con 0x7f8dc81598c0 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dcceb7640 1 -- 172.21.15.62:0/3054872854 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4003810 con 0x7f8dc81598c0 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dd011d640 1 -- 172.21.15.62:0/3054872854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc81598c0 msgr2=0x7f8dc80ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.945+0000 7f8dd011d640 1 --2- 172.21.15.62:0/3054872854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc81598c0 0x7f8dc80ccc20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80c56a0 tx=0x7f8dc402b8f0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 -- 172.21.15.62:0/3054872854 shutdown_connections 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 --2- 172.21.15.62:0/3054872854 >> v2:172.21.15.135:3300/0 conn(0x7f8dc815d520 0x7f8dc815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 --2- 172.21.15.62:0/3054872854 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc80cea30 0x7f8dc80cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 --2- 172.21.15.62:0/3054872854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc81598c0 0x7f8dc80ccc20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 -- 172.21.15.62:0/3054872854 >> 172.21.15.62:0/3054872854 conn(0x7f8dc806a170 msgr2=0x7f8dc806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 -- 172.21.15.62:0/3054872854 shutdown_connections 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.946+0000 7f8dd011d640 1 -- 172.21.15.62:0/3054872854 wait complete. 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.947+0000 7f8dd011d640 1 Processor -- start 2023-09-30T13:57:29.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.947+0000 7f8dd011d640 1 -- start start 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.947+0000 7f8dd011d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 0x7f8dc8097ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 0x7f8dc80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80cc4c0 con 0x7f8dc815d520 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c2770 con 0x7f8dc80cea30 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81506f0 con 0x7f8dc81598c0 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58518/0 (socket says 172.21.15.62:58518) 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 -- 172.21.15.62:0/1144729450 learned_addr learned my addr 172.21.15.62:0/1144729450 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:29.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 0x7f8dc8097ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dcd6b8640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 0x7f8dc80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 -- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 msgr2=0x7f8dc80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 0x7f8dc80c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 -- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 msgr2=0x7f8dc8097ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 0x7f8dc8097ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 -- 172.21.15.62:0/1144729450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4009460 con 0x7f8dc815d520 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 0x7f8dc8097ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:29.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dcd6b8640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 0x7f8dc80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dce6ba640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000b9a0 tx=0x7f8dc000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000cb40 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8dc000ccc0 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0014680 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80c28d0 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.948+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8158a30 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.949+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc80b2290 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.950+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8dc001e440 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.950+0000 7f8dbe7fc640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 0x7f8dac06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.950+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8dc0089230 con 0x7f8dc815d520 2023-09-30T13:57:29.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.950+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 0x7f8dac06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:29.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.951+0000 7f8dcdeb9640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 0x7f8dac06cff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80c56a0 tx=0x7f8dc4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:29.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:29.954+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8dc80b2290 con 0x7f8dc815d520 2023-09-30T13:57:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.131+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dc80c1f50 con 0x7f8dc815d520 2023-09-30T13:57:30.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.132+0000 7f8dbe7fc640 1 -- 172.21.15.62:0/1144729450 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f8dc80c1f50 con 0x7f8dc815d520 2023-09-30T13:57:30.133 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:57:30.133 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":52,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:22.758333+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 msgr2=0x7f8dac06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 0x7f8dac06cff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80c56a0 tx=0x7f8dc4008030 comp rx=0 tx=0).stop 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 msgr2=0x7f8dc815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000b9a0 tx=0x7f8dc000be60 comp rx=0 tx=0).stop 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 shutdown_connections 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8dac06ab30 0x7f8dac06cff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8dc815d520 0x7f8dc815bcb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8dc81598c0 0x7f8dc80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 --2- 172.21.15.62:0/1144729450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dc80cea30 0x7f8dc8097ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 >> 172.21.15.62:0/1144729450 conn(0x7f8dc806a170 msgr2=0x7f8dc80ab250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 shutdown_connections 2023-09-30T13:57:30.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.134+0000 7f8dd011d640 1 -- 172.21.15.62:0/1144729450 wait complete. 2023-09-30T13:57:30.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:57:19.089309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:57:20.102791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:57:30.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:57:30.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.254+0000 7f9d5910a640 1 Processor -- start 2023-09-30T13:57:30.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.254+0000 7f9d5910a640 1 -- start start 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5910a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5415cbc0 0x7f9d540d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5910a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d540b8760 0x7f9d540d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5910a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540d1410 con 0x7f9d540cd8c0 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5910a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540d16f0 con 0x7f9d540b8760 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5910a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540d19d0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d540b8760 0x7f9d540d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d540b8760 0x7f9d540d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58526/0 (socket says 172.21.15.62:58526) 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 -- 172.21.15.62:0/4050641700 learned_addr learned my addr 172.21.15.62:0/4050641700 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5359e640 1 --1- 172.21.15.62:0/4050641700 >> v1:172.21.15.135:6789/0 conn(0x7f9d540cd8c0 0x7f9d540b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:44776/0 (socket says 172.21.15.62:44776) 2023-09-30T13:57:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d52d9d640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5415cbc0 0x7f9d540d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 -- 172.21.15.62:0/4050641700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5415cbc0 msgr2=0x7f9d540d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5415cbc0 0x7f9d540d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.255+0000 7f9d5259c640 1 -- 172.21.15.62:0/4050641700 >> v1:172.21.15.135:6789/0 conn(0x7f9d540cd8c0 legacy=0x7f9d540b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d51d9b640 1 -- 172.21.15.62:0/4050641700 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073103910 0 0) 0x7f9d540d1410 con 0x7f9d540cd8c0 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d5259c640 1 -- 172.21.15.62:0/4050641700 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540d1cb0 con 0x7f9d540b8760 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d5259c640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d540b8760 0x7f9d540d0be0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009870 tx=0x7f9d3c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93c9fe1f159981d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d51d9b640 1 -- 172.21.15.62:0/4050641700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c030840 con 0x7f9d540b8760 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d51d9b640 1 -- 172.21.15.62:0/4050641700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f9d3c0309a0 con 0x7f9d540b8760 2023-09-30T13:57:30.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.256+0000 7f9d51d9b640 1 -- 172.21.15.62:0/4050641700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c030d30 con 0x7f9d540b8760 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 -- 172.21.15.62:0/4050641700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d540b8760 msgr2=0x7f9d540d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d540b8760 0x7f9d540d0be0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009870 tx=0x7f9d3c02b980 comp rx=0 tx=0).stop 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 -- 172.21.15.62:0/4050641700 shutdown_connections 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d540b8760 0x7f9d540d0be0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 --2- 172.21.15.62:0/4050641700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d5415cbc0 0x7f9d540d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 -- 172.21.15.62:0/4050641700 >> 172.21.15.62:0/4050641700 conn(0x7f9d540718a0 msgr2=0x7f9d54071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 -- 172.21.15.62:0/4050641700 shutdown_connections 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.257+0000 7f9d5910a640 1 -- 172.21.15.62:0/4050641700 wait complete. 2023-09-30T13:57:30.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.258+0000 7f9d5910a640 1 Processor -- start 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 -- start start 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d540b8760 0x7f9d54153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d540cd8c0 0x7f9d5415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540ca590 con 0x7f9d5415cbc0 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c9c60 con 0x7f9d540b8760 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5910a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c9f40 con 0x7f9d540cd8c0 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58534/0 (socket says 172.21.15.62:58534) 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5359e640 1 -- 172.21.15.62:0/3717845961 learned_addr learned my addr 172.21.15.62:0/3717845961 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d5259c640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d540cd8c0 0x7f9d5415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.259+0000 7f9d52d9d640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d540b8760 0x7f9d54153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 -- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d540cd8c0 msgr2=0x7f9d5415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d540cd8c0 0x7f9d5415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 -- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d540b8760 msgr2=0x7f9d54153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d540b8760 0x7f9d54153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 -- 172.21.15.62:0/3717845961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0094d0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5359e640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c7e0 tx=0x7f9d4400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400a640 con 0x7f9d5415cbc0 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f9d4400a7c0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d540ca220 con 0x7f9d5415cbc0 2023-09-30T13:57:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400ab70 con 0x7f9d5415cbc0 2023-09-30T13:57:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.260+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541535b0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.261+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5404e0d0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.261+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f9d4400acd0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.262+0000 7f9d4b7fe640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 0x7f9d3406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.262+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d440888e0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.262+0000 7f9d52d9d640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 0x7f9d3406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.262+0000 7f9d52d9d640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 0x7f9d3406cff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009aa0 tx=0x7f9d4c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.266+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f9d44053aa0 con 0x7f9d5415cbc0 2023-09-30T13:57:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.439+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d540d2c90 con 0x7f9d5415cbc0 2023-09-30T13:57:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.440+0000 7f9d4b7fe640 1 -- 172.21.15.62:0/3717845961 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d44018070 con 0x7f9d5415cbc0 2023-09-30T13:57:30.441 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:57:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 msgr2=0x7f9d3406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 0x7f9d3406cff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009aa0 tx=0x7f9d4c009190 comp rx=0 tx=0).stop 2023-09-30T13:57:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 msgr2=0x7f9d5415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c7e0 tx=0x7f9d4400cca0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 shutdown_connections 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f9d3406ab30 0x7f9d3406cff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d5415cbc0 0x7f9d5415be70 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d540cd8c0 0x7f9d5415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 --2- 172.21.15.62:0/3717845961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d540b8760 0x7f9d54153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 >> 172.21.15.62:0/3717845961 conn(0x7f9d540718a0 msgr2=0x7f9d54154150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 shutdown_connections 2023-09-30T13:57:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.442+0000 7f9d5910a640 1 -- 172.21.15.62:0/3717845961 wait complete. 2023-09-30T13:57:30.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:57:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 Processor -- start 2023-09-30T13:57:30.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 -- start start 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 0x7f98b8071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 0x7f98b80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98b80ae300 0x7f98b806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80c9a00 con 0x7f98b80ae300 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b806d740 con 0x7f98b815cb00 2023-09-30T13:57:30.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.563+0000 7f98be244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b806da20 con 0x7f98b815cee0 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98b80ae300 0x7f98b806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98b80ae300 0x7f98b806ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58538/0 (socket says 172.21.15.62:58538) 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 -- 172.21.15.62:0/810237143 learned_addr learned my addr 172.21.15.62:0/810237143 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b6ffd640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 0x7f98b80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b77fe640 1 --2- 172.21.15.62:0/810237143 >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 0x7f98b8071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 -- 172.21.15.62:0/810237143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 msgr2=0x7f98b80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 0x7f98b80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 -- 172.21.15.62:0/810237143 >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 msgr2=0x7f98b8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 --2- 172.21.15.62:0/810237143 >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 0x7f98b8071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b7fff640 1 -- 172.21.15.62:0/810237143 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b806dd00 con 0x7f98b80ae300 2023-09-30T13:57:30.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b6ffd640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 0x7f98b80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.564+0000 7f98b77fe640 1 --2- 172.21.15.62:0/810237143 >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 0x7f98b8071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98b7fff640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b80ae300 0x7f98b806ad60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f98b8066910 tx=0x7f98b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2558378fefef693b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98b67fc640 1 -- 172.21.15.62:0/810237143 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b002ca70 con 0x7f98b80ae300 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98b67fc640 1 -- 172.21.15.62:0/810237143 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f98b002cbd0 con 0x7f98b80ae300 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98b67fc640 1 -- 172.21.15.62:0/810237143 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00343f0 con 0x7f98b80ae300 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 -- 172.21.15.62:0/810237143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b80ae300 msgr2=0x7f98b806ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b80ae300 0x7f98b806ad60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f98b8066910 tx=0x7f98b002bed0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 -- 172.21.15.62:0/810237143 shutdown_connections 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b80ae300 0x7f98b806ad60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 --2- 172.21.15.62:0/810237143 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b815cee0 0x7f98b80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 --2- 172.21.15.62:0/810237143 >> v2:172.21.15.135:3300/0 conn(0x7f98b815cb00 0x7f98b8071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 -- 172.21.15.62:0/810237143 >> 172.21.15.62:0/810237143 conn(0x7f98b8070970 msgr2=0x7f98b8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 -- 172.21.15.62:0/810237143 shutdown_connections 2023-09-30T13:57:30.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.565+0000 7f98be244640 1 -- 172.21.15.62:0/810237143 wait complete. 2023-09-30T13:57:30.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 Processor -- start 2023-09-30T13:57:30.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 -- start start 2023-09-30T13:57:30.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b80ae300 0x7f98b80c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b815cb00 0x7f98b8153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80c79a0 con 0x7f98b815cee0 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b806b1e0 con 0x7f98b815cb00 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.567+0000 7f98be244640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80c7b80 con 0x7f98b80ae300 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58544/0 (socket says 172.21.15.62:58544) 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 -- 172.21.15.62:0/4251346682 learned_addr learned my addr 172.21.15.62:0/4251346682 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b77fe640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b80ae300 0x7f98b80c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b6ffd640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b815cb00 0x7f98b8153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 -- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b80ae300 msgr2=0x7f98b80c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b80ae300 0x7f98b80c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 -- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b815cb00 msgr2=0x7f98b8153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b815cb00 0x7f98b8153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 -- 172.21.15.62:0/4251346682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0009b30 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98b7fff640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036040 tx=0x7f98b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0009510 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f98b003e450 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b003e7e0 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b80c7e60 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.568+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b80c8420 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.569+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b80666d0 con 0x7f98b815cee0 2023-09-30T13:57:30.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.570+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f98b003e940 con 0x7f98b815cee0 2023-09-30T13:57:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.570+0000 7f98affff640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 0x7f989806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.570+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98b00abf90 con 0x7f98b815cee0 2023-09-30T13:57:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.570+0000 7f98b77fe640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 0x7f989806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.571+0000 7f98b77fe640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 0x7f989806d020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f98b815fc80 tx=0x7f98a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.574+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f98b00dead0 con 0x7f98b815cee0 2023-09-30T13:57:30.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.751+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98b804e0d0 con 0x7f98b815cee0 2023-09-30T13:57:30.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.751+0000 7f98affff640 1 -- 172.21.15.62:0/4251346682 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98b00771e0 con 0x7f98b815cee0 2023-09-30T13:57:30.752 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 msgr2=0x7f989806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 0x7f989806d020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f98b815fc80 tx=0x7f98a0008040 comp rx=0 tx=0).stop 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 msgr2=0x7f98b80b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036040 tx=0x7f98b0004a40 comp rx=0 tx=0).stop 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 shutdown_connections 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f989806ab60 0x7f989806d020 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98b815cee0 0x7f98b80b1ac0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b815cb00 0x7f98b8153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 --2- 172.21.15.62:0/4251346682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b80ae300 0x7f98b80c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 >> 172.21.15.62:0/4251346682 conn(0x7f98b8070970 msgr2=0x7f98b80af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 shutdown_connections 2023-09-30T13:57:30.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.753+0000 7f98be244640 1 -- 172.21.15.62:0/4251346682 wait complete. 2023-09-30T13:57:30.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:57:30.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.872+0000 7f8469fa5640 1 Processor -- start 2023-09-30T13:57:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.872+0000 7f8469fa5640 1 -- start start 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8469fa5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84640b2160 0x7f84640b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8469fa5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84640b4400 0x7f8464070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8469fa5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846415b190 con 0x7f84640b0a70 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8469fa5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84640b0f20 con 0x7f84640b2160 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8469fa5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846415afa0 con 0x7f84640b4400 2023-09-30T13:57:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84640b2160 0x7f84640b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f84640b2160 0x7f84640b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58550/0 (socket says 172.21.15.62:58550) 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 -- 172.21.15.62:0/3560506724 learned_addr learned my addr 172.21.15.62:0/3560506724 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f8463fff640 1 --2- 172.21.15.62:0/3560506724 >> v2:172.21.15.135:3300/0 conn(0x7f84640b4400 0x7f8464070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 -- 172.21.15.62:0/3560506724 >> v2:172.21.15.135:3300/0 conn(0x7f84640b4400 msgr2=0x7f8464070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 --2- 172.21.15.62:0/3560506724 >> v2:172.21.15.135:3300/0 conn(0x7f84640b4400 0x7f8464070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 -- 172.21.15.62:0/3560506724 >> v1:172.21.15.135:6789/0 conn(0x7f84640b0a70 legacy=0x7f84640b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:30.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.873+0000 7f84637fe640 1 -- 172.21.15.62:0/3560506724 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846415b470 con 0x7f84640b2160 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.874+0000 7f84637fe640 1 --2- 172.21.15.62:0/3560506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f84640b0530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f846406da30 tx=0x7f845402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb7d708c02ed73f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.874+0000 7f84627fc640 1 -- 172.21.15.62:0/3560506724 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030860 con 0x7f84640b2160 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.874+0000 7f84627fc640 1 -- 172.21.15.62:0/3560506724 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f84540309c0 con 0x7f84640b2160 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.874+0000 7f84627fc640 1 -- 172.21.15.62:0/3560506724 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030d50 con 0x7f84640b2160 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 -- 172.21.15.62:0/3560506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 msgr2=0x7f84640b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 --2- 172.21.15.62:0/3560506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f84640b0530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f846406da30 tx=0x7f845402b9a0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 -- 172.21.15.62:0/3560506724 shutdown_connections 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 --2- 172.21.15.62:0/3560506724 >> v2:172.21.15.135:3300/0 conn(0x7f84640b4400 0x7f8464070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 --2- 172.21.15.62:0/3560506724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f84640b0530 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 -- 172.21.15.62:0/3560506724 >> 172.21.15.62:0/3560506724 conn(0x7f84640cb720 msgr2=0x7f84640ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 -- 172.21.15.62:0/3560506724 shutdown_connections 2023-09-30T13:57:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.875+0000 7f8469fa5640 1 -- 172.21.15.62:0/3560506724 wait complete. 2023-09-30T13:57:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.876+0000 7f8469fa5640 1 Processor -- start 2023-09-30T13:57:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.876+0000 7f8469fa5640 1 -- start start 2023-09-30T13:57:30.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84640b0a70 0x7f8464142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84640b4400 0x7f84641594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464143530 con 0x7f84640b2160 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640ad230 con 0x7f84640b0a70 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8469fa5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640acf50 con 0x7f84640b4400 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58564/0 (socket says 172.21.15.62:58564) 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 -- 172.21.15.62:0/1307081113 learned_addr learned my addr 172.21.15.62:0/1307081113 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f84637fe640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84640b0a70 0x7f8464142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8463fff640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84640b4400 0x7f84641594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 -- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84640b4400 msgr2=0x7f84641594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84640b4400 0x7f84641594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 -- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84640b0a70 msgr2=0x7f8464142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84640b0a70 0x7f8464142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 -- 172.21.15.62:0/1307081113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540094d0 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.877+0000 7f8462ffd640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f845800c450 tx=0x7f845800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.878+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580052d0 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.878+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8458005430 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.878+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84640ae430 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.878+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458012870 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.878+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640ae9f0 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.879+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846415b730 con 0x7f84640b2160 2023-09-30T13:57:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.879+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f84580129d0 con 0x7f84640b2160 2023-09-30T13:57:30.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.880+0000 7f844bfff640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 0x7f845006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:30.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.880+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8458088d50 con 0x7f84640b2160 2023-09-30T13:57:30.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.880+0000 7f84637fe640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 0x7f845006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:30.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.880+0000 7f84637fe640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 0x7f845006cff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f846406da30 tx=0x7f8454008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:30.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:30.884+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f846415b730 con 0x7f84640b2160 2023-09-30T13:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.058+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f846415b730 con 0x7f84640b2160 2023-09-30T13:57:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.058+0000 7f844bfff640 1 -- 172.21.15.62:0/1307081113 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f846415b730 con 0x7f84640b2160 2023-09-30T13:57:31.059 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:57:31.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 msgr2=0x7f845006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 0x7f845006cff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f846406da30 tx=0x7f8454008030 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 msgr2=0x7f8464158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f845800c450 tx=0x7f845800c910 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 shutdown_connections 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f845006ab30 0x7f845006cff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84640b4400 0x7f84641594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84640b2160 0x7f8464158f80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 --2- 172.21.15.62:0/1307081113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84640b0a70 0x7f8464142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 >> 172.21.15.62:0/1307081113 conn(0x7f84640cb720 msgr2=0x7f8464070540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:31.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 shutdown_connections 2023-09-30T13:57:31.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.060+0000 7f8469fa5640 1 -- 172.21.15.62:0/1307081113 wait complete. 2023-09-30T13:57:31.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.177+0000 7f4d812d7640 1 Processor -- start 2023-09-30T13:57:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.177+0000 7f4d812d7640 1 -- start start 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d812d7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4d7c0cac00 0x7f4d7c065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d812d7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0cafe0 con 0x7f4d7c06d570 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d812d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0cb510 con 0x7f4d7c0ce700 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d812d7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c06d150 con 0x7f4d7c0cac00 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4d7c0cac00 0x7f4d7c065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7a7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4d7c06d570 0x7f4d7c0cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39246/0 (socket says 172.21.15.62:39246) 2023-09-30T13:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7a7fc640 1 -- 172.21.15.62:0/1214222135 learned_addr learned my addr 172.21.15.62:0/1214222135 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7affd640 1 -- 172.21.15.62:0/1214222135 >> v1:172.21.15.135:6789/0 conn(0x7f4d7c0ce700 legacy=0x7f4d7c069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7affd640 1 -- 172.21.15.62:0/1214222135 >> v1:172.21.15.62:6789/0 conn(0x7f4d7c06d570 legacy=0x7f4d7c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d79ffb640 1 -- 172.21.15.62:0/1214222135 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152103664 0 0) 0x7f4d64001110 con 0x7f4d7c06d570 2023-09-30T13:57:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.178+0000 7f4d7affd640 1 -- 172.21.15.62:0/1214222135 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c06cb20 con 0x7f4d7c0cac00 2023-09-30T13:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.179+0000 7f4d7affd640 1 --2- 172.21.15.62:0/1214222135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c065a20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b269a9b3a7b01b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.179+0000 7f4d79ffb640 1 -- 172.21.15.62:0/1214222135 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c02cbd0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.179+0000 7f4d79ffb640 1 -- 172.21.15.62:0/1214222135 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f4d6c02cd30 con 0x7f4d7c0cac00 2023-09-30T13:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.179+0000 7f4d79ffb640 1 -- 172.21.15.62:0/1214222135 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c02cea0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 -- 172.21.15.62:0/1214222135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 msgr2=0x7f4d7c065a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1214222135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c065a20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c02be20 comp rx=0 tx=0).stop 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 -- 172.21.15.62:0/1214222135 shutdown_connections 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1214222135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c065a20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 -- 172.21.15.62:0/1214222135 >> 172.21.15.62:0/1214222135 conn(0x7f4d7c0b0850 msgr2=0x7f4d7c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 -- 172.21.15.62:0/1214222135 shutdown_connections 2023-09-30T13:57:31.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.180+0000 7f4d812d7640 1 -- 172.21.15.62:0/1214222135 wait complete. 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.181+0000 7f4d812d7640 1 Processor -- start 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.181+0000 7f4d812d7640 1 -- start start 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d7c06d570 0x7f4d7c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 0x7f4d7c0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1e7440 con 0x7f4d7c0cac00 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1e67f0 con 0x7f4d7c0ce700 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d812d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c6370 con 0x7f4d7c06d570 2023-09-30T13:57:31.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58570/0 (socket says 172.21.15.62:58570) 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 -- 172.21.15.62:0/1525028949 learned_addr learned my addr 172.21.15.62:0/1525028949 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7affd640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d7c06d570 0x7f4d7c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7b7fe640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 0x7f4d7c0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 -- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d7c06d570 msgr2=0x7f4d7c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d7c06d570 0x7f4d7c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 -- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 msgr2=0x7f4d7c0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 0x7f4d7c0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7a7fc640 1 -- 172.21.15.62:0/1525028949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009a70 con 0x7f4d7c0cac00 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.182+0000 7f4d7b7fe640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 0x7f4d7c0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:57:31.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d7a7fc640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c780 tx=0x7f4d6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640072d0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f4d64007450 con 0x7f4d7c0cac00 2023-09-30T13:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c1e76d0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64001d10 con 0x7f4d7c0cac00 2023-09-30T13:57:31.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.183+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c1e6270 con 0x7f4d7c0cac00 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.184+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c1e7860 con 0x7f4d7c0cac00 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.184+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4d640047e0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.184+0000 7f4d737fe640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 0x7f4d5c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.185+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d64088450 con 0x7f4d7c0cac00 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.185+0000 7f4d7affd640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 0x7f4d5c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.185+0000 7f4d7affd640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 0x7f4d5c06d020 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.189+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4d64056f90 con 0x7f4d7c0cac00 2023-09-30T13:57:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.376+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4d7c0cafe0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.377+0000 7f4d737fe640 1 -- 172.21.15.62:0/1525028949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4d7c0cafe0 con 0x7f4d7c0cac00 2023-09-30T13:57:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:57:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 msgr2=0x7f4d5c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 0x7f4d5c06d020 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c030000 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 msgr2=0x7f4d7c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c780 tx=0x7f4d6400cc40 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 shutdown_connections 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4d5c06ab60 0x7f4d5c06d020 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d7c0ce700 0x7f4d7c0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d7c0cac00 0x7f4d7c0afa80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 --2- 172.21.15.62:0/1525028949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d7c06d570 0x7f4d7c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 >> 172.21.15.62:0/1525028949 conn(0x7f4d7c0b0850 msgr2=0x7f4d7c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 shutdown_connections 2023-09-30T13:57:31.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.379+0000 7f4d812d7640 1 -- 172.21.15.62:0/1525028949 wait complete. 2023-09-30T13:57:31.390 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:57:31.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:31.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:31.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[107808]: fuse finished with error 0 and tester_r 0 2023-09-30T13:57:31.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:57:31.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:31.421 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T13:57:31.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T13:57:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.663+0000 7faac3661640 1 Processor -- start 2023-09-30T13:57:31.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.664+0000 7faac3661640 1 -- start start 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.664+0000 7faac3661640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faabc0d0080 0x7faabc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.664+0000 7faac3661640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cae70 con 0x7faabc15cd90 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.664+0000 7faac3661640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cb110 con 0x7faabc0cc690 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.664+0000 7faac3661640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0cb3f0 con 0x7faabc0d0080 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac13fd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faabc15cd90 0x7faabc0cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39248/0 (socket says 172.21.15.62:39248) 2023-09-30T13:57:31.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac13fd640 1 -- 172.21.15.62:0/179256253 learned_addr learned my addr 172.21.15.62:0/179256253 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957135550 0 0) 0x7faabc0cae70 con 0x7faabc15cd90 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac1bfe640 1 --2- 172.21.15.62:0/179256253 >> v2:172.21.15.135:3300/0 conn(0x7faabc0d0080 0x7faabc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa4003520 con 0x7faabc15cd90 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348832461 0 0) 0x7faaa4003520 con 0x7faabc15cd90 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 >> v2:172.21.15.135:3300/0 conn(0x7faabc0d0080 msgr2=0x7faabc0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 --2- 172.21.15.62:0/179256253 >> v2:172.21.15.135:3300/0 conn(0x7faabc0d0080 0x7faabc0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 >> v1:172.21.15.135:6789/0 conn(0x7faabc0cc690 legacy=0x7faabc0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0d05f0 con 0x7faabc15cd90 2023-09-30T13:57:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7faab40017f0 con 0x7faabc15cd90 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 >> v1:172.21.15.62:6789/0 conn(0x7faabc15cd90 legacy=0x7faabc0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0cb3f0 con 0x7faaa4005180 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa400c120 con 0x7faaa4003970 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa400c2e0 con 0x7faaa40047c0 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac1bfe640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac13fd640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.665+0000 7faac0bfc640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 -- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa40047c0 msgr2=0x7faaa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 -- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4003970 msgr2=0x7faaa4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 -- 172.21.15.62:0/179256253 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4003520 con 0x7faaa4005180 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.666+0000 7faac1bfe640 1 -- 172.21.15.62:0/179256253 reap_dead start 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac1bfe640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 0x7faaa400b980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faaac009fc0 tx=0x7faaa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ac192914a101cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac02cc60 con 0x7faaa4005180 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7faaac00f040 con 0x7faaa4005180 2023-09-30T13:57:31.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faabbfff640 1 -- 172.21.15.62:0/179256253 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac003990 con 0x7faaa4005180 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 -- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 msgr2=0x7faaa400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 0x7faaa400b980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7faaac009fc0 tx=0x7faaa40057f0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 -- 172.21.15.62:0/179256253 shutdown_connections 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 --2- 172.21.15.62:0/179256253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 -- 172.21.15.62:0/179256253 >> 172.21.15.62:0/179256253 conn(0x7faabc098a50 msgr2=0x7faabc0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 -- 172.21.15.62:0/179256253 shutdown_connections 2023-09-30T13:57:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.667+0000 7faac3661640 1 -- 172.21.15.62:0/179256253 wait complete. 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 Processor -- start 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 -- start start 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4005180 0x7faabc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc152ab0 0x7faabc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1f23b0 con 0x7faabc156620 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0c8820 con 0x7faaa4005180 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac3661640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc154180 con 0x7faabc152ab0 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac1bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.669+0000 7faac1bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58588/0 (socket says 172.21.15.62:58588) 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 -- 172.21.15.62:0/1661492609 learned_addr learned my addr 172.21.15.62:0/1661492609 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac13fd640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4005180 0x7faabc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac0bfc640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc152ab0 0x7faabc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 -- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc152ab0 msgr2=0x7faabc0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc152ab0 0x7faabc0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 -- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4005180 msgr2=0x7faabc153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4005180 0x7faabc153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 -- 172.21.15.62:0/1661492609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc155b40 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac1bfe640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faaac02c6d0 tx=0x7faaac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac02cc60 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7faaac02de80 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc155e20 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac003bb0 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.670+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc1557f0 con 0x7faabc156620 2023-09-30T13:57:31.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.671+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc156340 con 0x7faabc156620 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.672+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7faaac003d10 con 0x7faabc156620 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.672+0000 7faab9ffb640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 0x7faaa806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.672+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faaac0ac090 con 0x7faabc156620 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.672+0000 7faac13fd640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 0x7faaa806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.673+0000 7faac13fd640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 0x7faaa806cff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c2f80 tx=0x7faab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:31.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.676+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7faabc156340 con 0x7faabc156620 2023-09-30T13:57:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.894+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faabc156340 con 0x7faabc156620 2023-09-30T13:57:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.894+0000 7faab9ffb640 1 -- 172.21.15.62:0/1661492609 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7faabc156340 con 0x7faabc156620 2023-09-30T13:57:31.895 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T13:57:31.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 msgr2=0x7faaa806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 0x7faaa806cff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c2f80 tx=0x7faab4009040 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 msgr2=0x7faabc156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7faaac02c6d0 tx=0x7faaac009750 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 shutdown_connections 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7faaa806ab30 0x7faaa806cff0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faabc156620 0x7faabc156ad0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faabc152ab0 0x7faabc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 --2- 172.21.15.62:0/1661492609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa4005180 0x7faabc153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 >> 172.21.15.62:0/1661492609 conn(0x7faabc098a50 msgr2=0x7faabc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 shutdown_connections 2023-09-30T13:57:31.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:31.896+0000 7faac3661640 1 -- 172.21.15.62:0/1661492609 wait complete. 2023-09-30T13:57:31.907 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T13:57:31.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T13:57:31.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:31.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:31.908 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-09-30T13:57:31.924 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T13:57:31.924 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T13:57:31.924 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T13:57:31.924 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.925 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-09-30T13:57:31.925 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.925 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:31.925 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:31.925 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-09-30T13:57:31.926 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:31.926 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:31.926 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-09-30T13:57:31.926 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T13:57:31.927 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:31.927 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T13:57:31.927 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:31.927 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T13:57:31.927 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42542sec preferred_lft 42542sec 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1036:68ff:fe6f:69f4/64 scope link 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 76:90:4c:92:44:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:31.928 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::7490:4cff:fe92:4462/64 scope link 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run.smithi062.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:19:42:a1:ef:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::19:42ff:fea1:ef3d/64 scope link 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-09-30T13:57:31.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:31.929 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T13:57:31.993 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-09-30T13:57:31.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:31.995 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-09-30T13:57:32.051 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-09-30T13:57:32.051 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T13:57:32.051 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T13:57:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T13:57:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T13:57:32.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T13:57:32.052 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-09-30T13:57:32.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.157 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:57:32.172 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T13:57:32.172 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T13:57:32.172 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:32.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-09-30T13:57:32.243 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T13:57:32.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:32.243 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:32.298 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T13:57:32.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T13:57:32.298 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:32.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:57:32.424 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:32.480 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:57:32.480 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:57:32.480 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:57:32.480 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:57:32.481 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:57:32.482 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:32.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.483 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:57:32.535 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T13:57:32.536 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T13:57:32.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-09-30T13:57:32.608 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2023-09-30T13:57:32.664 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2023-09-30T13:57:32.665 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-0 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-1 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-2 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph/osd/ceph-3 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:57:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:32.667 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:57:32.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.667 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-09-30T13:57:32.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:2023-09-30T13:57:32.669+0000 7f77917f8480 -1 init, newargv = 0x55ab0a4845a0 newargc=15 2023-09-30T13:57:32.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[108569]: starting ceph client 2023-09-30T13:57:32.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[108569]: starting fuse 2023-09-30T13:57:32.685 INFO:teuthology.orchestra.run.smithi062.stdout:41 2023-09-30T13:57:32.685 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-09-30T13:57:32.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2023-09-30T13:57:32.685 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-09-30T13:57:32.685 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-09-30T13:57:32.685 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:57:32.685 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:32.686 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.0")) 2023-09-30T13:57:32.687 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:57:32.814 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.0.108569.asok 2023-09-30T13:57:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:57:32.825 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.108569.asok 2023-09-30T13:57:32.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.108569.asok status 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "0", 2023-09-30T13:57:32.967 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "108569", 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 6249, 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 6249 2023-09-30T13:57:32.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1086885303 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1086885303 2023-09-30T13:57:32.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.6249 192.168.0.1:0/1086885303", 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/1086885303", 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 22, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 53, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-09-30T13:57:32.970 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:57:32.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.975 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-09-30T13:57:32.975 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:32.991 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-09-30T13:57:32.991 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:32.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:57:32.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T13:57:33.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_completed_requests 10000 2023-09-30T13:57:33.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.210+0000 7f61e3875640 1 Processor -- start 2023-09-30T13:57:33.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.210+0000 7f61e3875640 1 -- start start 2023-09-30T13:57:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e3875640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61dc15d2e0 0x7f61dc15d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e3875640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 0x7f61dc06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e3875640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc06c540 con 0x7f61dc153d20 2023-09-30T13:57:33.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e3875640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc15dc90 con 0x7f61dc15d2e0 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e3875640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0b29c0 con 0x7f61dc06c9d0 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e0e10640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61dc15d2e0 0x7f61dc15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e1611640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61dc153d20 0x7f61dc0ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39260/0 (socket says 172.21.15.62:39260) 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e0e10640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61dc15d2e0 0x7f61dc15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58590/0 (socket says 172.21.15.62:58590) 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.211+0000 7f61e1611640 1 -- 172.21.15.62:0/756563671 learned_addr learned my addr 172.21.15.62:0/756563671 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e1e12640 1 --2- 172.21.15.62:0/756563671 >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 0x7f61dc06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e0e10640 1 -- 172.21.15.62:0/756563671 >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 msgr2=0x7f61dc06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e0e10640 1 --2- 172.21.15.62:0/756563671 >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 0x7f61dc06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e0e10640 1 -- 172.21.15.62:0/756563671 >> v1:172.21.15.62:6789/0 conn(0x7f61dc153d20 legacy=0x7f61dc0ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e0e10640 1 -- 172.21.15.62:0/756563671 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0aecd0 con 0x7f61dc15d2e0 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61dbfff640 1 -- 172.21.15.62:0/756563671 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041282053 0 0) 0x7f61dc06c540 con 0x7f61dc153d20 2023-09-30T13:57:33.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e1e12640 1 --2- 172.21.15.62:0/756563671 >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 0x7f61dc06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61e0e10640 1 --2- 172.21.15.62:0/756563671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc15d2e0 0x7f61dc15d750 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f61dc15d220 tx=0x7f61d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbffbaf0b4d15a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.212+0000 7f61dbfff640 1 -- 172.21.15.62:0/756563671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0031830 con 0x7f61dc15d2e0 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61dbfff640 1 -- 172.21.15.62:0/756563671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f61d0031990 con 0x7f61dc15d2e0 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61dbfff640 1 -- 172.21.15.62:0/756563671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0031d20 con 0x7f61dc15d2e0 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 -- 172.21.15.62:0/756563671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc15d2e0 msgr2=0x7f61dc15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 --2- 172.21.15.62:0/756563671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc15d2e0 0x7f61dc15d750 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f61dc15d220 tx=0x7f61d002b8d0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 -- 172.21.15.62:0/756563671 shutdown_connections 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 --2- 172.21.15.62:0/756563671 >> v2:172.21.15.135:3300/0 conn(0x7f61dc06c9d0 0x7f61dc06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 --2- 172.21.15.62:0/756563671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc15d2e0 0x7f61dc15d750 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 -- 172.21.15.62:0/756563671 >> 172.21.15.62:0/756563671 conn(0x7f61dc0cb720 msgr2=0x7f61dc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 -- 172.21.15.62:0/756563671 shutdown_connections 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.213+0000 7f61e3875640 1 -- 172.21.15.62:0/756563671 wait complete. 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.214+0000 7f61e3875640 1 Processor -- start 2023-09-30T13:57:33.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.214+0000 7f61e3875640 1 -- start start 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61dc153d20 0x7f61dc06d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc15d2e0 0x7f61dc14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14be70 con 0x7f61dc06c9d0 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14cee0 con 0x7f61dc15d2e0 2023-09-30T13:57:33.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e3875640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14b7f0 con 0x7f61dc153d20 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58594/0 (socket says 172.21.15.62:58594) 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 -- 172.21.15.62:0/1736321293 learned_addr learned my addr 172.21.15.62:0/1736321293 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 -- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61dc153d20 msgr2=0x7f61dc06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61dc153d20 0x7f61dc06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 -- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc15d2e0 msgr2=0x7f61dc14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc15d2e0 0x7f61dc14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.215+0000 7f61e1611640 1 -- 172.21.15.62:0/1736321293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009400 con 0x7f61dc06c9d0 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61e1611640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c460 tx=0x7f61d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40074e0 con 0x7f61dc06c9d0 2023-09-30T13:57:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f61d4007660 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4004a20 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc14cc00 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.216+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc148cc0 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.217+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc14b650 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.217+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f61d4004b80 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.218+0000 7f61d9ffb640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 0x7f61c806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.218+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f61d40885f0 con 0x7f61dc06c9d0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.218+0000 7f61e0e10640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 0x7f61c806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:57:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.218+0000 7f61e0e10640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 0x7f61c806cff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61dc15d220 tx=0x7f61d0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:57:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.222+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f61dc14b650 con 0x7f61dc06c9d0 2023-09-30T13:57:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.400+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_max_completed_requests}] v 0) v1 -- 0x7f61dc14b650 con 0x7f61dc06c9d0 2023-09-30T13:57:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.403+0000 7f61d9ffb640 1 -- 172.21.15.62:0/1736321293 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_completed_requests}]=0 v18)=0 v18) v1 ==== 128+0+0 (secure 0 0 0) 0x7f61dc14b650 con 0x7f61dc06c9d0 2023-09-30T13:57:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.405+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 msgr2=0x7f61c806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.405+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 0x7f61c806cff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61dc15d220 tx=0x7f61d0030000 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.405+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 msgr2=0x7f61dc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.405+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c460 tx=0x7f61d400c920 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 shutdown_connections 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f61c806ab30 0x7f61c806cff0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61dc15d2e0 0x7f61dc14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f61dc153d20 0x7f61dc06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 --2- 172.21.15.62:0/1736321293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61dc06c9d0 0x7f61dc14eee0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 >> 172.21.15.62:0/1736321293 conn(0x7f61dc0cb720 msgr2=0x7f61dc0ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 shutdown_connections 2023-09-30T13:57:33.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:57:33.406+0000 7f61e3875640 1 -- 172.21.15.62:0/1736321293 wait complete. 2023-09-30T13:57:33.417 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:57:33.418 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> n = 10100 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:57:33.435 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file1" 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:33.436 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:57:33.437 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:57:33.438 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:57:33.439 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:57:49.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:57:49.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:01.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:58:01.965 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:01.965 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:01.981 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:58:01.981 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:58:01.981 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:58:01.981 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:01.981 DEBUG:teuthology.orchestra.run.smithi062:> n = 5 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file2" 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:01.982 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:58:01.983 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:58:01.984 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:01.984 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:58:01.984 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:58:01.984 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:58:01.984 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:58:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:58:02.597 INFO:tasks.ceph_test_case:waiting 1000s for health warning matching MDS_CLIENT_OLDEST_TID 2023-09-30T13:58:02.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health detail --format=json 2023-09-30T13:58:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.746+0000 7f82a8644640 1 Processor -- start 2023-09-30T13:58:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.746+0000 7f82a8644640 1 -- start start 2023-09-30T13:58:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a01598c0 0x7f82a00ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82a00cea30 0x7f82a00cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82a015d520 0x7f82a015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a00b1e20 con 0x7f82a015d520 2023-09-30T13:58:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a00cf3b0 con 0x7f82a00cea30 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a8644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a00b1530 con 0x7f82a01598c0 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a6be1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82a015d520 0x7f82a015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a6be1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82a015d520 0x7f82a015d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52894/0 (socket says 172.21.15.62:52894) 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a6be1640 1 -- 172.21.15.62:0/1053828950 learned_addr learned my addr 172.21.15.62:0/1053828950 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a5bdf640 1 --2- 172.21.15.62:0/1053828950 >> v2:172.21.15.135:3300/0 conn(0x7f82a00cea30 0x7f82a00cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.747+0000 7f82a63e0640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a01598c0 0x7f82a00ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 -- 172.21.15.62:0/1053828950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a01598c0 msgr2=0x7f82a00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a01598c0 0x7f82a00ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 -- 172.21.15.62:0/1053828950 >> v2:172.21.15.135:3300/0 conn(0x7f82a00cea30 msgr2=0x7f82a00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 --2- 172.21.15.62:0/1053828950 >> v2:172.21.15.135:3300/0 conn(0x7f82a00cea30 0x7f82a00cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 -- 172.21.15.62:0/1053828950 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a00b17d0 con 0x7f82a015d520 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a6be1640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a015d520 0x7f82a015d9b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f82a00cf6a0 tx=0x7f829002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498826266ce20ca7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.748+0000 7f82a53de640 1 -- 172.21.15.62:0/1053828950 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290031870 con 0x7f82a015d520 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a53de640 1 -- 172.21.15.62:0/1053828950 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f82900319d0 con 0x7f82a015d520 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a53de640 1 -- 172.21.15.62:0/1053828950 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290031d60 con 0x7f82a015d520 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 -- 172.21.15.62:0/1053828950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a015d520 msgr2=0x7f82a015d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a015d520 0x7f82a015d9b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f82a00cf6a0 tx=0x7f829002b910 comp rx=0 tx=0).stop 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 -- 172.21.15.62:0/1053828950 shutdown_connections 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a015d520 0x7f82a015d9b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 --2- 172.21.15.62:0/1053828950 >> v2:172.21.15.135:3300/0 conn(0x7f82a00cea30 0x7f82a00cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 --2- 172.21.15.62:0/1053828950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a01598c0 0x7f82a00ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 -- 172.21.15.62:0/1053828950 >> 172.21.15.62:0/1053828950 conn(0x7f82a006a170 msgr2=0x7f82a006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 -- 172.21.15.62:0/1053828950 shutdown_connections 2023-09-30T13:58:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.749+0000 7f82a8644640 1 -- 172.21.15.62:0/1053828950 wait complete. 2023-09-30T13:58:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.750+0000 7f82a8644640 1 Processor -- start 2023-09-30T13:58:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.750+0000 7f82a8644640 1 -- start start 2023-09-30T13:58:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 0x7f82a01547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a015d520 0x7f82a00cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01e3020 con 0x7f82a01598c0 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01e3300 con 0x7f82a00cea30 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a8644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01e35e0 con 0x7f82a015d520 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52910/0 (socket says 172.21.15.62:52910) 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 -- 172.21.15.62:0/3800126144 learned_addr learned my addr 172.21.15.62:0/3800126144 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a6be1640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a015d520 0x7f82a00cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a63e0640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 0x7f82a01547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 -- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a015d520 msgr2=0x7f82a00cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a015d520 0x7f82a00cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 -- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 msgr2=0x7f82a01547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.751+0000 7f82a5bdf640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 0x7f82a01547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f82a5bdf640 1 -- 172.21.15.62:0/3800126144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900094d0 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f82a63e0640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 0x7f82a01547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f82a5bdf640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f829400e9b0 tx=0x7f829400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294009670 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f829400c9a0 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a01e38c0 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400cd50 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.752+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a0154d00 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.753+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a004e0d0 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.753+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8294013470 con 0x7f82a01598c0 2023-09-30T13:58:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.754+0000 7f829effd640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 0x7f828c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.754+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f82940895e0 con 0x7f82a01598c0 2023-09-30T13:58:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.754+0000 7f82a63e0640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 0x7f828c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.754+0000 7f82a63e0640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 0x7f828c06cff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8298007500 tx=0x7f829800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.758+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f82940546d0 con 0x7f82a01598c0 2023-09-30T13:58:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.999+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f82a00b3410 con 0x7f82a01598c0 2023-09-30T13:58:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:02.999+0000 7f829effd640 1 -- 172.21.15.62:0/3800126144 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail", "format": "json"}]=0 v0) v1 ==== 92+0+46 (secure 0 0 0) 0x7f8294057cf0 con 0x7f82a01598c0 2023-09-30T13:58:02.999 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:02.999 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T13:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 msgr2=0x7f828c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 0x7f828c06cff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8298007500 tx=0x7f829800b040 comp rx=0 tx=0).stop 2023-09-30T13:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 msgr2=0x7f82a01e2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f829400e9b0 tx=0x7f829400ee70 comp rx=0 tx=0).stop 2023-09-30T13:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 shutdown_connections 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f828c06ab30 0x7f828c06cff0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82a015d520 0x7f82a00cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82a01598c0 0x7f82a01e2640 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 --2- 172.21.15.62:0/3800126144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82a00cea30 0x7f82a01547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 >> 172.21.15.62:0/3800126144 conn(0x7f82a006a170 msgr2=0x7f82a01550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 shutdown_connections 2023-09-30T13:58:03.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:03.001+0000 7f82a8644640 1 -- 172.21.15.62:0/3800126144 wait complete. 2023-09-30T13:58:03.011 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2023-09-30T13:58:03.011 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=1000 retry_count=0)... 2023-09-30T13:58:08.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health detail --format=json 2023-09-30T13:58:08.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.132+0000 7efe77bf5640 1 Processor -- start 2023-09-30T13:58:08.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.132+0000 7efe77bf5640 1 -- start start 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe77bf5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 0x7efe700b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe77bf5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe700b2940 0x7efe700cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe77bf5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe700b2e50 con 0x7efe700cef70 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe77bf5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe700cf400 con 0x7efe700b2940 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe77bf5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700ac2d0 con 0x7efe700cdc20 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe75190640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe700b2940 0x7efe700cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe75991640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 0x7efe700b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe76192640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7efe700cef70 0x7efe700ab250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:45394/0 (socket says 172.21.15.62:45394) 2023-09-30T13:58:08.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.133+0000 7efe76192640 1 -- 172.21.15.62:0/2799086777 learned_addr learned my addr 172.21.15.62:0/2799086777 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:08.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe7498f640 1 -- 172.21.15.62:0/2799086777 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999935866 0 0) 0x7efe700b2e50 con 0x7efe700cef70 2023-09-30T13:58:08.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe7498f640 1 -- 172.21.15.62:0/2799086777 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c003520 con 0x7efe700cef70 2023-09-30T13:58:08.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe75991640 1 -- 172.21.15.62:0/2799086777 >> v2:172.21.15.135:3300/0 conn(0x7efe700b2940 msgr2=0x7efe700cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:08.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe75991640 1 --2- 172.21.15.62:0/2799086777 >> v2:172.21.15.135:3300/0 conn(0x7efe700b2940 0x7efe700cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe75991640 1 -- 172.21.15.62:0/2799086777 >> v1:172.21.15.135:6789/0 conn(0x7efe700cef70 legacy=0x7efe700ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.134+0000 7efe75991640 1 -- 172.21.15.62:0/2799086777 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700cc340 con 0x7efe700cdc20 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe75991640 1 --2- 172.21.15.62:0/2799086777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 0x7efe700b2400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009790 tx=0x7efe6c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a193595d1b756e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe7498f640 1 -- 172.21.15.62:0/2799086777 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c031770 con 0x7efe700cdc20 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe7498f640 1 -- 172.21.15.62:0/2799086777 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7efe6c0318d0 con 0x7efe700cdc20 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe7498f640 1 -- 172.21.15.62:0/2799086777 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c031c40 con 0x7efe700cdc20 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 -- 172.21.15.62:0/2799086777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 msgr2=0x7efe700b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 --2- 172.21.15.62:0/2799086777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 0x7efe700b2400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009790 tx=0x7efe6c02b810 comp rx=0 tx=0).stop 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 -- 172.21.15.62:0/2799086777 shutdown_connections 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 --2- 172.21.15.62:0/2799086777 >> v2:172.21.15.135:3300/0 conn(0x7efe700b2940 0x7efe700cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 --2- 172.21.15.62:0/2799086777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700cdc20 0x7efe700b2400 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 -- 172.21.15.62:0/2799086777 >> 172.21.15.62:0/2799086777 conn(0x7efe7006a170 msgr2=0x7efe7006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:08.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 -- 172.21.15.62:0/2799086777 shutdown_connections 2023-09-30T13:58:08.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.135+0000 7efe77bf5640 1 -- 172.21.15.62:0/2799086777 wait complete. 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 Processor -- start 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 -- start start 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 0x7efe701f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe700cdc20 0x7efe70154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe700af5a0 con 0x7efe700cef70 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe701f5010 con 0x7efe700cdc20 2023-09-30T13:58:08.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.137+0000 7efe77bf5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700ae9b0 con 0x7efe700b2940 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe76192640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe76192640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52032/0 (socket says 172.21.15.62:52032) 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe76192640 1 -- 172.21.15.62:0/3169109225 learned_addr learned my addr 172.21.15.62:0/3169109225 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 0x7efe701f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75190640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe700cdc20 0x7efe70154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 -- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe700cdc20 msgr2=0x7efe70154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe700cdc20 0x7efe70154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 -- 172.21.15.62:0/3169109225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 msgr2=0x7efe700c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 -- 172.21.15.62:0/3169109225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c0093a0 con 0x7efe700b2940 2023-09-30T13:58:08.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe76192640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.138+0000 7efe75991640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 0x7efe701f4ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe700cf740 tx=0x7efe6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c005b90 con 0x7efe700b2940 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7efe6c005cf0 con 0x7efe700b2940 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe700aec00 con 0x7efe700b2940 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c006270 con 0x7efe700b2940 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe700af1c0 con 0x7efe700b2940 2023-09-30T13:58:08.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.139+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7004e0d0 con 0x7efe700b2940 2023-09-30T13:58:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.140+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7efe6c0063d0 con 0x7efe700b2940 2023-09-30T13:58:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.141+0000 7efe667fc640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 0x7efe5406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.141+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7efe6c042030 con 0x7efe700b2940 2023-09-30T13:58:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.141+0000 7efe75190640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 0x7efe5406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.141+0000 7efe75190640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 0x7efe5406cff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efe7006dd60 tx=0x7efe60009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.145+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7efe6c076e20 con 0x7efe700b2940 2023-09-30T13:58:08.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.394+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "health", "detail": "detail", "format": "json"} v 0) v1 -- 0x7efe700b21e0 con 0x7efe700b2940 2023-09-30T13:58:08.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.395+0000 7efe667fc640 1 -- 172.21.15.62:0/3169109225 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail", "format": "json"}]=0 v0) v1 ==== 92+0+322 (secure 0 0 0) 0x7efe6c04c020 con 0x7efe700b2940 2023-09-30T13:58:08.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:08.394 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CLIENT_OLDEST_TID":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to advance oldest client/flush tid","count":1},"detail":[{"message":"mds.b(mds.0): Client smithi062:0 failing to advance its oldest client/flush tid. client_id: 6249"}],"muted":false}},"mutes":[]} 2023-09-30T13:58:08.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.396+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 msgr2=0x7efe5406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.396+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 0x7efe5406cff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efe7006dd60 tx=0x7efe60009190 comp rx=0 tx=0).stop 2023-09-30T13:58:08.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.396+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 msgr2=0x7efe701f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.396+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 0x7efe701f4ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe700cf740 tx=0x7efe6c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.396+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 shutdown_connections 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7efe5406ab30 0x7efe5406cff0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe700cef70 0x7efe700c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe700cdc20 0x7efe70154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 --2- 172.21.15.62:0/3169109225 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe700b2940 0x7efe701f4ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 >> 172.21.15.62:0/3169109225 conn(0x7efe7006a170 msgr2=0x7efe70070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 shutdown_connections 2023-09-30T13:58:08.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.397+0000 7efe77bf5640 1 -- 172.21.15.62:0/3169109225 wait complete. 2023-09-30T13:58:08.406 DEBUG:tasks.ceph_test_case:detail_strings: ['mds.b(mds.0): Client smithi062:0 failing to advance its oldest client/flush tid. client_id: 6249'] 2023-09-30T13:58:08.407 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-09-30T13:58:08.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_metadata_threshold 200000 2023-09-30T13:58:08.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.515+0000 7f3291f33640 1 Processor -- start 2023-09-30T13:58:08.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.515+0000 7f3291f33640 1 -- start start 2023-09-30T13:58:08.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f3291f33640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f328c15e1e0 0x7f328c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f3291f33640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c15f570 con 0x7f328c0cd660 2023-09-30T13:58:08.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f3291f33640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c0b1350 con 0x7f328c0b15e0 2023-09-30T13:58:08.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f3291f33640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c0ce2d0 con 0x7f328c15e1e0 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f328b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f328c15e1e0 0x7f328c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f328bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f328c0cd660 0x7f328c15ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56754/0 (socket says 172.21.15.62:56754) 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.516+0000 7f328bfff640 1 -- 172.21.15.62:0/2228019452 learned_addr learned my addr 172.21.15.62:0/2228019452 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.517+0000 7f328b7fe640 1 -- 172.21.15.62:0/2228019452 >> v1:172.21.15.135:6789/0 conn(0x7f328c0b15e0 legacy=0x7f328c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.517+0000 7f328b7fe640 1 -- 172.21.15.62:0/2228019452 >> v1:172.21.15.62:6789/0 conn(0x7f328c0cd660 legacy=0x7f328c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.517+0000 7f328b7fe640 1 -- 172.21.15.62:0/2228019452 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0d17c0 con 0x7f328c15e1e0 2023-09-30T13:58:08.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.517+0000 7f328a7fc640 1 -- 172.21.15.62:0/2228019452 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621561208 0 0) 0x7f328c15f570 con 0x7f328c0cd660 2023-09-30T13:58:08.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.517+0000 7f328b7fe640 1 --2- 172.21.15.62:0/2228019452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c15e1e0 0x7f328c0cd120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910fb681f8f1a7eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f328a7fc640 1 -- 172.21.15.62:0/2228019452 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c030610 con 0x7f328c15e1e0 2023-09-30T13:58:08.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f328a7fc640 1 -- 172.21.15.62:0/2228019452 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f327c030770 con 0x7f328c15e1e0 2023-09-30T13:58:08.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f328a7fc640 1 -- 172.21.15.62:0/2228019452 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c030b00 con 0x7f328c15e1e0 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 -- 172.21.15.62:0/2228019452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c15e1e0 msgr2=0x7f328c0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 --2- 172.21.15.62:0/2228019452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c15e1e0 0x7f328c0cd120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02b960 comp rx=0 tx=0).stop 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 -- 172.21.15.62:0/2228019452 shutdown_connections 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 --2- 172.21.15.62:0/2228019452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c15e1e0 0x7f328c0cd120 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 -- 172.21.15.62:0/2228019452 >> 172.21.15.62:0/2228019452 conn(0x7f328c0d08e0 msgr2=0x7f328c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 -- 172.21.15.62:0/2228019452 shutdown_connections 2023-09-30T13:58:08.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.518+0000 7f3291f33640 1 -- 172.21.15.62:0/2228019452 wait complete. 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.519+0000 7f3291f33640 1 Processor -- start 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 -- start start 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f328c0b15e0 0x7f328c158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328c15e1e0 0x7f328c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c06bc10 con 0x7f328c0cd660 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c06af90 con 0x7f328c15e1e0 2023-09-30T13:58:08.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f3291f33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c06b270 con 0x7f328c0b15e0 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f328affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f328affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52056/0 (socket says 172.21.15.62:52056) 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.520+0000 7f328affd640 1 -- 172.21.15.62:0/803267827 learned_addr learned my addr 172.21.15.62:0/803267827 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328bfff640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328c15e1e0 0x7f328c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328b7fe640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f328c0b15e0 0x7f328c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 -- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f328c0b15e0 msgr2=0x7f328c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f328c0b15e0 0x7f328c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 -- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328c15e1e0 msgr2=0x7f328c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328c15e1e0 0x7f328c0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 -- 172.21.15.62:0/803267827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009400 con 0x7f328c0cd660 2023-09-30T13:58:08.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f328affd640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f328000c450 tx=0x7f328000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800052d0 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f3280005430 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280012870 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c06b550 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.521+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0c60d0 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.522+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c06bd50 con 0x7f328c0cd660 2023-09-30T13:58:08.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.523+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f32800129d0 con 0x7f328c0cd660 2023-09-30T13:58:08.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.523+0000 7f3273fff640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 0x7f327806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:08.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.523+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f3280088ef0 con 0x7f328c0cd660 2023-09-30T13:58:08.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.523+0000 7f328b7fe640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 0x7f327806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:08.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.524+0000 7f328b7fe640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 0x7f327806cff0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:08.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.527+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3280053fc0 con 0x7f328c0cd660 2023-09-30T13:58:08.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.702+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mds_session_metadata_threshold}] v 0) v1 -- 0x7f328c04e0d0 con 0x7f328c0cd660 2023-09-30T13:58:08.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.705+0000 7f3273fff640 1 -- 172.21.15.62:0/803267827 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_metadata_threshold}]=0 v19)=0 v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f32800575e0 con 0x7f328c0cd660 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 msgr2=0x7f327806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 0x7f327806cff0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c03b040 comp rx=0 tx=0).stop 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 msgr2=0x7f328c0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f328000c450 tx=0x7f328000c910 comp rx=0 tx=0).stop 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 shutdown_connections 2023-09-30T13:58:08.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f327806ab30 0x7f327806cff0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328c15e1e0 0x7f328c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f328c0cd660 0x7f328c0c9140 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 --2- 172.21.15.62:0/803267827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f328c0b15e0 0x7f328c158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 >> 172.21.15.62:0/803267827 conn(0x7f328c0d08e0 msgr2=0x7f328c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 shutdown_connections 2023-09-30T13:58:08.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08.707+0000 7f3291f33640 1 -- 172.21.15.62:0/803267827 wait complete. 2023-09-30T13:58:08.718 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:08.718 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:08.734 DEBUG:teuthology.orchestra.run.smithi062:> stdin-killer -- python3 -c ' 2023-09-30T13:58:08.734 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-09-30T13:58:08.734 DEBUG:teuthology.orchestra.run.smithi062:> import uuid 2023-09-30T13:58:08.734 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:08.734 DEBUG:teuthology.orchestra.run.smithi062:> n = 20 2023-09-30T13:58:08.735 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = False 2023-09-30T13:58:08.735 DEBUG:teuthology.orchestra.run.smithi062:> if 0 > 0: 2023-09-30T13:58:08.735 DEBUG:teuthology.orchestra.run.smithi062:> create_hard_links = True 2023-09-30T13:58:08.735 DEBUG:teuthology.orchestra.run.smithi062:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file2" 2023-09-30T13:58:08.735 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:08.736 DEBUG:teuthology.orchestra.run.smithi062:> dpath = os.path.dirname(path) 2023-09-30T13:58:08.736 DEBUG:teuthology.orchestra.run.smithi062:> fnameprefix = os.path.basename(path) 2023-09-30T13:58:08.736 DEBUG:teuthology.orchestra.run.smithi062:> os.makedirs(dpath, exist_ok=True) 2023-09-30T13:58:08.736 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:08.736 DEBUG:teuthology.orchestra.run.smithi062:> try: 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> for i in range(n): 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> with open(fpath, '"'"'w'"'"') as f: 2023-09-30T13:58:08.737 DEBUG:teuthology.orchestra.run.smithi062:> f.write(f"{i}") 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> if True: 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> f.flush() 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(f.fileno()) 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> os.unlink(fpath) 2023-09-30T13:58:08.738 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> if create_hard_links: 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> for j in range(0): 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> if False: 2023-09-30T13:58:08.739 DEBUG:teuthology.orchestra.run.smithi062:> os.fsync(dirfd) 2023-09-30T13:58:08.740 DEBUG:teuthology.orchestra.run.smithi062:> finally: 2023-09-30T13:58:08.740 DEBUG:teuthology.orchestra.run.smithi062:> os.close(dirfd) 2023-09-30T13:58:08.740 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-09-30T13:58:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T13:58:08.997 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-30T13:58:08.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:58:09.085 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-30T13:58:09.123 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-30T13:58:09.123 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:09.123 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:09.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:09.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.285+0000 7fd550f33640 1 Processor -- start 2023-09-30T13:58:09.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.285+0000 7fd550f33640 1 -- start start 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd550f33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd54c0cc210 0x7fd54c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd550f33640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c06ddf0 con 0x7fd54c0caea0 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd550f33640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0cdf30 con 0x7fd54c158c20 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd550f33640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0b1ea0 con 0x7fd54c0cc210 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd54ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd54c0caea0 0x7fd54c06be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56766/0 (socket says 172.21.15.62:56766) 2023-09-30T13:58:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd54ad9d640 1 -- 172.21.15.62:0/1536191684 learned_addr learned my addr 172.21.15.62:0/1536191684 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd543fff640 1 --2- 172.21.15.62:0/1536191684 >> v2:172.21.15.135:3300/0 conn(0x7fd54c0cc210 0x7fd54c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500483115 0 0) 0x7fd54c06ddf0 con 0x7fd54c0caea0 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd538003520 con 0x7fd54c0caea0 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219963867 0 0) 0x7fd54c0cdf30 con 0x7fd54c158c20 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c06ddf0 con 0x7fd54c158c20 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581776751 0 0) 0x7fd538003520 con 0x7fd54c0caea0 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 >> v2:172.21.15.135:3300/0 conn(0x7fd54c0cc210 msgr2=0x7fd54c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 --2- 172.21.15.62:0/1536191684 >> v2:172.21.15.135:3300/0 conn(0x7fd54c0cc210 0x7fd54c0b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 >> v1:172.21.15.135:6789/0 conn(0x7fd54c158c20 legacy=0x7fd54c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0ce210 con 0x7fd54c0caea0 2023-09-30T13:58:09.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fd5440019f0 con 0x7fd54c0caea0 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.286+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 >> v1:172.21.15.62:6789/0 conn(0x7fd54c0caea0 legacy=0x7fd54c06be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538003b00 0x7fd538003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5380047c0 0x7fd538004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 0x7fd53800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0b1ea0 con 0x7fd538005180 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800c020 con 0x7fd538003b00 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800c1e0 con 0x7fd5380047c0 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 0x7fd53800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54a59c640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538003b00 0x7fd538003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd543fff640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5380047c0 0x7fd538004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 -- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5380047c0 msgr2=0x7fd538004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5380047c0 0x7fd538004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 -- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538003b00 msgr2=0x7fd538003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538003b00 0x7fd538003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.287+0000 7fd54ad9d640 1 -- 172.21.15.62:0/1536191684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538003520 con 0x7fd538005180 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd54ad9d640 1 -- 172.21.15.62:0/1536191684 reap_dead start 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 0x7fd53800b980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd54400a7b0 tx=0x7fd5380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2c7e63dd8d18e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544034630 con 0x7fd538005180 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fd54402f070 con 0x7fd538005180 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd549d9b640 1 -- 172.21.15.62:0/1536191684 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544034a10 con 0x7fd538005180 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 -- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 msgr2=0x7fd53800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 0x7fd53800b980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd54400a7b0 tx=0x7fd5380057f0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 -- 172.21.15.62:0/1536191684 shutdown_connections 2023-09-30T13:58:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 --2- 172.21.15.62:0/1536191684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd538005180 0x7fd53800b980 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 -- 172.21.15.62:0/1536191684 >> 172.21.15.62:0/1536191684 conn(0x7fd54c06a170 msgr2=0x7fd54c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 -- 172.21.15.62:0/1536191684 shutdown_connections 2023-09-30T13:58:09.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.288+0000 7fd550f33640 1 -- 172.21.15.62:0/1536191684 wait complete. 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 Processor -- start 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 -- start start 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538005180 0x7fd54c1f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c0afd60 0x7fd54c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c06d320 con 0x7fd54c06c960 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0c71c0 con 0x7fd538005180 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.290+0000 7fd550f33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1f1d70 con 0x7fd54c0afd60 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52074/0 (socket says 172.21.15.62:52074) 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 -- 172.21.15.62:0/3883764428 learned_addr learned my addr 172.21.15.62:0/3883764428 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 -- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c0afd60 msgr2=0x7fd54c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c0afd60 0x7fd54c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 -- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538005180 msgr2=0x7fd54c1f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538005180 0x7fd54c1f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 -- 172.21.15.62:0/3883764428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c155a20 con 0x7fd54c06c960 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd54ad9d640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd54400a8d0 tx=0x7fd54c0b2830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544004b60 con 0x7fd54c06c960 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fd544004cc0 con 0x7fd54c06c960 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0c6890 con 0x7fd54c06c960 2023-09-30T13:58:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440349f0 con 0x7fd54c06c960 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.291+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0c6e50 con 0x7fd54c06c960 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.292+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c04e0d0 con 0x7fd54c06c960 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.293+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fd544031030 con 0x7fd54c06c960 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.293+0000 7fd542ffd640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 0x7fd52c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.293+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd5440aa5a0 con 0x7fd54c06c960 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.293+0000 7fd54a59c640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 0x7fd52c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.294+0000 7fd54a59c640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 0x7fd52c06cff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09c520 tx=0x7fd53c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.297+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fd544075720 con 0x7fd54c06c960 2023-09-30T13:58:09.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.472+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd54c0b08d0 con 0x7fd54c06c960 2023-09-30T13:58:09.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.473+0000 7fd542ffd640 1 -- 172.21.15.62:0/3883764428 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16789 (secure 0 0 0) 0x7fd544078d40 con 0x7fd54c06c960 2023-09-30T13:58:09.473 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:09.473 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":54,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:32.771192+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:09.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 msgr2=0x7fd52c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 0x7fd52c06cff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09c520 tx=0x7fd53c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 msgr2=0x7fd54c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd54400a8d0 tx=0x7fd54c0b2830 comp rx=0 tx=0).stop 2023-09-30T13:58:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 shutdown_connections 2023-09-30T13:58:09.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fd52c06ab30 0x7fd52c06cff0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd54c06c960 0x7fd54c06cde0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd54c0afd60 0x7fd54c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 --2- 172.21.15.62:0/3883764428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd538005180 0x7fd54c1f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 >> 172.21.15.62:0/3883764428 conn(0x7fd54c06a170 msgr2=0x7fd54c0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 shutdown_connections 2023-09-30T13:58:09.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.475+0000 7fd550f33640 1 -- 172.21.15.62:0/3883764428 wait complete. 2023-09-30T13:58:09.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:57:19.089309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:57:20.102791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:58:09.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:58:09.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.596+0000 7ff2381e9640 1 Processor -- start 2023-09-30T13:58:09.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.596+0000 7ff2381e9640 1 -- start start 2023-09-30T13:58:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff2381e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 0x7ff2300b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff2381e9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23015b190 con 0x7ff2300b2160 2023-09-30T13:58:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff2381e9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23015b470 con 0x7ff2300b4230 2023-09-30T13:58:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff2381e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23015afa0 con 0x7ff2300b0c40 2023-09-30T13:58:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff235f85640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff2300b2160 0x7ff2300b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56776/0 (socket says 172.21.15.62:56776) 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff235f85640 1 -- 172.21.15.62:0/1867159707 learned_addr learned my addr 172.21.15.62:0/1867159707 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff235784640 1 --2- 172.21.15.62:0/1867159707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 0x7ff2300b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325193132 0 0) 0x7ff23015b190 con 0x7ff2300b2160 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff218003520 con 0x7ff2300b2160 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.597+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331297254 0 0) 0x7ff23015b470 con 0x7ff2300b4230 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff23015b190 con 0x7ff2300b4230 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712397634 0 0) 0x7ff218003520 con 0x7ff2300b2160 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff235784640 1 -- 172.21.15.62:0/1867159707 >> v1:172.21.15.135:6789/0 conn(0x7ff2300b4230 legacy=0x7ff230070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff235784640 1 -- 172.21.15.62:0/1867159707 >> v1:172.21.15.62:6789/0 conn(0x7ff2300b2160 legacy=0x7ff2300b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff235784640 1 -- 172.21.15.62:0/1867159707 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23015b750 con 0x7ff2300b0c40 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.598+0000 7ff235784640 1 --2- 172.21.15.62:0/1867159707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 0x7ff2300b3cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097d0 tx=0x7ff22402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c184704b35c22dab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228001670 con 0x7ff2300b0c40 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ff22402e050 con 0x7ff2300b0c40 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff234f83640 1 -- 172.21.15.62:0/1867159707 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224030730 con 0x7ff2300b0c40 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 -- 172.21.15.62:0/1867159707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 msgr2=0x7ff2300b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1867159707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 0x7ff2300b3cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097d0 tx=0x7ff22402b800 comp rx=0 tx=0).stop 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 -- 172.21.15.62:0/1867159707 shutdown_connections 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1867159707 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b0c40 0x7ff2300b3cf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 -- 172.21.15.62:0/1867159707 >> 172.21.15.62:0/1867159707 conn(0x7ff2300cb720 msgr2=0x7ff2300ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 -- 172.21.15.62:0/1867159707 shutdown_connections 2023-09-30T13:58:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.599+0000 7ff2381e9640 1 -- 172.21.15.62:0/1867159707 wait complete. 2023-09-30T13:58:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.600+0000 7ff2381e9640 1 Processor -- start 2023-09-30T13:58:09.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.600+0000 7ff2381e9640 1 -- start start 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 0x7ff2300aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b2160 0x7ff2300ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300ac590 con 0x7ff2300b4230 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300af3a0 con 0x7ff2300b0c40 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff2381e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300af680 con 0x7ff2300b2160 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52090/0 (socket says 172.21.15.62:52090) 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 -- 172.21.15.62:0/1520593632 learned_addr learned my addr 172.21.15.62:0/1520593632 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff235f85640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 0x7ff2300aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff235784640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b2160 0x7ff2300ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 -- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b2160 msgr2=0x7ff2300ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b2160 0x7ff2300ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 -- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 msgr2=0x7ff2300aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 0x7ff2300aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff236786640 1 -- 172.21.15.62:0/1520593632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009400 con 0x7ff2300b4230 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.601+0000 7ff235f85640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 0x7ff2300aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff236786640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c6e0 tx=0x7ff22000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220003b70 con 0x7ff2300b4230 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ff220003cd0 con 0x7ff2300b4230 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2300af960 con 0x7ff2300b4230 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2200052d0 con 0x7ff2300b4230 2023-09-30T13:58:09.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.602+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2301f50e0 con 0x7ff2300b4230 2023-09-30T13:58:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.603+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23004e0d0 con 0x7ff2300b4230 2023-09-30T13:58:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.603+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff220005430 con 0x7ff2300b4230 2023-09-30T13:58:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.604+0000 7ff22e7fc640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 0x7ff21c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.604+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff220089280 con 0x7ff2300b4230 2023-09-30T13:58:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.604+0000 7ff235f85640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 0x7ff21c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.605+0000 7ff235f85640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 0x7ff21c06cff0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff228000f60 tx=0x7ff228009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.608+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff2200542d0 con 0x7ff2300b4230 2023-09-30T13:58:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.783+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2300cf110 con 0x7ff2300b4230 2023-09-30T13:58:09.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.784+0000 7ff22e7fc640 1 -- 172.21.15.62:0/1520593632 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2200578f0 con 0x7ff2300b4230 2023-09-30T13:58:09.783 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:58:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 msgr2=0x7ff21c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 0x7ff21c06cff0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff228000f60 tx=0x7ff228009040 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 msgr2=0x7ff2301f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c6e0 tx=0x7ff22000cba0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 shutdown_connections 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff21c06ab30 0x7ff21c06cff0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2300b4230 0x7ff2301f4ba0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2300b2160 0x7ff2300ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 --2- 172.21.15.62:0/1520593632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2300b0c40 0x7ff2300aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 >> 172.21.15.62:0/1520593632 conn(0x7ff2300cb720 msgr2=0x7ff2300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 shutdown_connections 2023-09-30T13:58:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.786+0000 7ff2381e9640 1 -- 172.21.15.62:0/1520593632 wait complete. 2023-09-30T13:58:09.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:58:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.905+0000 7fa34d009640 1 Processor -- start 2023-09-30T13:58:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.905+0000 7fa34d009640 1 -- start start 2023-09-30T13:58:09.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34d009640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3480ca390 0x7fa348159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34d009640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34815abd0 con 0x7fa3480cc670 2023-09-30T13:58:09.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34d009640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34815a330 con 0x7fa3480cdab0 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34d009640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34815a120 con 0x7fa3480ca390 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34759e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa3480cc670 0x7fa3480cca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56790/0 (socket says 172.21.15.62:56790) 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34759e640 1 -- 172.21.15.62:0/3271112548 learned_addr learned my addr 172.21.15.62:0/3271112548 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4423343 0 0) 0x7fa34815abd0 con 0x7fa3480cc670 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa334005730 con 0x7fa3480cc670 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa346d9d640 1 --2- 172.21.15.62:0/3271112548 >> v2:172.21.15.135:3300/0 conn(0x7fa3480ca390 0x7fa348159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138649649 0 0) 0x7fa334005730 con 0x7fa3480cc670 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 >> v2:172.21.15.135:3300/0 conn(0x7fa3480ca390 msgr2=0x7fa348159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 --2- 172.21.15.62:0/3271112548 >> v2:172.21.15.135:3300/0 conn(0x7fa3480ca390 0x7fa348159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 >> v1:172.21.15.135:6789/0 conn(0x7fa3480cdab0 legacy=0x7fa348070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34815a610 con 0x7fa3480cc670 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fa3400019f0 con 0x7fa3480cc670 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 >> v1:172.21.15.62:6789/0 conn(0x7fa3480cc670 legacy=0x7fa3480cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa334005b80 0x7fa334005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340069d0 0x7fa334006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 0x7fa33400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815a120 con 0x7fa3340074b0 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33400e380 con 0x7fa3340069d0 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.906+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33400e540 con 0x7fa334005b80 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 0x7fa33400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa33ffff640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340069d0 0x7fa334006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa346d9d640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa334005b80 0x7fa334005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 -- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa334005b80 msgr2=0x7fa334005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa334005b80 0x7fa334005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 -- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340069d0 msgr2=0x7fa334006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340069d0 0x7fa334006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 -- 172.21.15.62:0/3271112548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334005730 con 0x7fa3340074b0 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa346d9d640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa334005b80 0x7fa334005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.907+0000 7fa34759e640 1 -- 172.21.15.62:0/3271112548 reap_dead start 2023-09-30T13:58:09.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34759e640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 0x7fa33400db90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa3400013d0 tx=0x7fa334007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38e3a250ee1793f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340034630 con 0x7fa3340074b0 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fa34002f070 con 0x7fa3340074b0 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34659c640 1 -- 172.21.15.62:0/3271112548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400349f0 con 0x7fa3340074b0 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 -- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 msgr2=0x7fa33400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 0x7fa33400db90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa3400013d0 tx=0x7fa334007a00 comp rx=0 tx=0).stop 2023-09-30T13:58:09.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 -- 172.21.15.62:0/3271112548 shutdown_connections 2023-09-30T13:58:09.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 --2- 172.21.15.62:0/3271112548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3340074b0 0x7fa33400db90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 -- 172.21.15.62:0/3271112548 >> 172.21.15.62:0/3271112548 conn(0x7fa34806a380 msgr2=0x7fa3480affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:09.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 -- 172.21.15.62:0/3271112548 shutdown_connections 2023-09-30T13:58:09.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.908+0000 7fa34d009640 1 -- 172.21.15.62:0/3271112548 wait complete. 2023-09-30T13:58:09.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 Processor -- start 2023-09-30T13:58:09.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 -- start start 2023-09-30T13:58:09.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3340074b0 0x7fa3481554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa348150020 0x7fa3480c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481f22e0 con 0x7fa3480c44d0 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480c4950 con 0x7fa348150020 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.910+0000 7fa34d009640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480c7d80 con 0x7fa3340074b0 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52104/0 (socket says 172.21.15.62:52104) 2023-09-30T13:58:09.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 -- 172.21.15.62:0/2650261462 learned_addr learned my addr 172.21.15.62:0/2650261462 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa33ffff640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa348150020 0x7fa3480c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 -- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3340074b0 msgr2=0x7fa3481554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3340074b0 0x7fa3481554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 -- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa348150020 msgr2=0x7fa3480c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa348150020 0x7fa3480c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 -- 172.21.15.62:0/2650261462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3481f2000 con 0x7fa3480c44d0 2023-09-30T13:58:09.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34759e640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa340000f80 tx=0x7fa348070880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340004de0 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fa34003f470 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3480c8020 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34003f7e0 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.911+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3480c85e0 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.912+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3480c8800 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.913+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa340031030 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.913+0000 7fa33f7fe640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 0x7fa32806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.913+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fa34002ce40 con 0x7fa3480c44d0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.913+0000 7fa346d9d640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 0x7fa32806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:09.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.914+0000 7fa346d9d640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 0x7fa32806d020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa338006f00 tx=0x7fa338006e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:09.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:09.917+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa340075bf0 con 0x7fa3480c44d0 2023-09-30T13:58:10.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.093+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3480b09a0 con 0x7fa3480c44d0 2023-09-30T13:58:10.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.093+0000 7fa33f7fe640 1 -- 172.21.15.62:0/2650261462 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa340079210 con 0x7fa3480c44d0 2023-09-30T13:58:10.093 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:58:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 msgr2=0x7fa32806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 0x7fa32806d020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa338006f00 tx=0x7fa338006e90 comp rx=0 tx=0).stop 2023-09-30T13:58:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 msgr2=0x7fa3481f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa340000f80 tx=0x7fa348070880 comp rx=0 tx=0).stop 2023-09-30T13:58:10.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 shutdown_connections 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa32806ab60 0x7fa32806d020 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3480c44d0 0x7fa3481f1310 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa348150020 0x7fa3480c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 --2- 172.21.15.62:0/2650261462 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3340074b0 0x7fa3481554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 >> 172.21.15.62:0/2650261462 conn(0x7fa34806a380 msgr2=0x7fa34815b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 shutdown_connections 2023-09-30T13:58:10.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.095+0000 7fa34d009640 1 -- 172.21.15.62:0/2650261462 wait complete. 2023-09-30T13:58:10.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:58:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.215+0000 7ff61f1e7640 1 Processor -- start 2023-09-30T13:58:10.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.215+0000 7ff61f1e7640 1 -- start start 2023-09-30T13:58:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61f1e7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6180b2160 0x7ff6180b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61f1e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b4400 0x7ff618070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61f1e7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61815b190 con 0x7ff6180b0a70 2023-09-30T13:58:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61f1e7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6180b0f20 con 0x7ff6180b2160 2023-09-30T13:58:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61f1e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61815afa0 con 0x7ff6180b4400 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61cf83640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6180b2160 0x7ff6180b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61cf83640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6180b2160 0x7ff6180b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52118/0 (socket says 172.21.15.62:52118) 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.216+0000 7ff61cf83640 1 -- 172.21.15.62:0/1746138860 learned_addr learned my addr 172.21.15.62:0/1746138860 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61d784640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b4400 0x7ff618070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61cf83640 1 -- 172.21.15.62:0/1746138860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b4400 msgr2=0x7ff618070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61cf83640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b4400 0x7ff618070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61cf83640 1 -- 172.21.15.62:0/1746138860 >> v1:172.21.15.135:6789/0 conn(0x7ff6180b0a70 legacy=0x7ff6180b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61cf83640 1 -- 172.21.15.62:0/1746138860 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61815b470 con 0x7ff6180b2160 2023-09-30T13:58:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff61cf83640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b2160 0x7ff6180b0530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff6180cbeb0 tx=0x7ff61002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea9e882ef18f208 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.217+0000 7ff6177fe640 1 -- 172.21.15.62:0/1746138860 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61002ca30 con 0x7ff6180b2160 2023-09-30T13:58:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff6177fe640 1 -- 172.21.15.62:0/1746138860 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ff61002cb90 con 0x7ff6180b2160 2023-09-30T13:58:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff6177fe640 1 -- 172.21.15.62:0/1746138860 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100343f0 con 0x7ff6180b2160 2023-09-30T13:58:10.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 -- 172.21.15.62:0/1746138860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b2160 msgr2=0x7ff6180b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b2160 0x7ff6180b0530 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff6180cbeb0 tx=0x7ff61002be90 comp rx=0 tx=0).stop 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 -- 172.21.15.62:0/1746138860 shutdown_connections 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b4400 0x7ff618070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/1746138860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b2160 0x7ff6180b0530 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 -- 172.21.15.62:0/1746138860 >> 172.21.15.62:0/1746138860 conn(0x7ff6180cb720 msgr2=0x7ff6180ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 -- 172.21.15.62:0/1746138860 shutdown_connections 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.218+0000 7ff61f1e7640 1 -- 172.21.15.62:0/1746138860 wait complete. 2023-09-30T13:58:10.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.219+0000 7ff61f1e7640 1 Processor -- start 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.219+0000 7ff61f1e7640 1 -- start start 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b2160 0x7ff61813bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6180b4400 0x7ff618070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180aea40 con 0x7ff6180b0a70 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61813e110 con 0x7ff6180b4400 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61f1e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61813f660 con 0x7ff6180b2160 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61cf83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61cf83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52132/0 (socket says 172.21.15.62:52132) 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.220+0000 7ff61cf83640 1 -- 172.21.15.62:0/851170986 learned_addr learned my addr 172.21.15.62:0/851170986 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:10.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61d784640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6180b4400 0x7ff618070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff617fff640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b2160 0x7ff61813bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 -- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b2160 msgr2=0x7ff61813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b2160 0x7ff61813bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 -- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6180b4400 msgr2=0x7ff618070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6180b4400 0x7ff618070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 -- 172.21.15.62:0/851170986 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009b30 con 0x7ff6180b0a70 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61cf83640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff61002bed0 tx=0x7ff610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610009510 con 0x7ff6180b0a70 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ff61003e450 con 0x7ff6180b0a70 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61813f900 con 0x7ff6180b0a70 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61003e800 con 0x7ff6180b0a70 2023-09-30T13:58:10.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.221+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6180aec90 con 0x7ff6180b0a70 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.222+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61804e0d0 con 0x7ff6180b0a70 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.223+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff61003e960 con 0x7ff6180b0a70 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.223+0000 7ff6157fa640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 0x7ff5f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.223+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff6100ac720 con 0x7ff6180b0a70 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.223+0000 7ff617fff640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 0x7ff5f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.224+0000 7ff617fff640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 0x7ff5f806cff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff608006fd0 tx=0x7ff608008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.227+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff610077880 con 0x7ff6180b0a70 2023-09-30T13:58:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.401+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6180cf110 con 0x7ff6180b0a70 2023-09-30T13:58:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.401+0000 7ff6157fa640 1 -- 172.21.15.62:0/851170986 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff61007aea0 con 0x7ff6180b0a70 2023-09-30T13:58:10.401 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:58:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.403+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 msgr2=0x7ff5f806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.403+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 0x7ff5f806cff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff608006fd0 tx=0x7ff608008040 comp rx=0 tx=0).stop 2023-09-30T13:58:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.403+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 msgr2=0x7ff61813b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.403+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff61002bed0 tx=0x7ff610004a40 comp rx=0 tx=0).stop 2023-09-30T13:58:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 shutdown_connections 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff5f806ab30 0x7ff5f806cff0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6180b4400 0x7ff618070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6180b2160 0x7ff61813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 --2- 172.21.15.62:0/851170986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6180b0a70 0x7ff61813b4f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 >> 172.21.15.62:0/851170986 conn(0x7ff6180cb720 msgr2=0x7ff61806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 shutdown_connections 2023-09-30T13:58:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.404+0000 7ff61f1e7640 1 -- 172.21.15.62:0/851170986 wait complete. 2023-09-30T13:58:10.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:58:10.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.523+0000 7f4679a09640 1 Processor -- start 2023-09-30T13:58:10.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.523+0000 7f4679a09640 1 -- start start 2023-09-30T13:58:10.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4679a09640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f46740cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4679a09640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f46740b5bf0 0x7f46740ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4679a09640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740cda60 con 0x7f4674160160 2023-09-30T13:58:10.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4679a09640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740d18a0 con 0x7f46740b5bf0 2023-09-30T13:58:10.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4679a09640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4674160540 con 0x7f46740b5790 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4672ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4674160160 0x7f46740d30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56794/0 (socket says 172.21.15.62:56794) 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4672ffd640 1 -- 172.21.15.62:0/4275106539 learned_addr learned my addr 172.21.15.62:0/4275106539 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f46737fe640 1 --2- 172.21.15.62:0/4275106539 >> v2:172.21.15.135:3300/0 conn(0x7f46740b5bf0 0x7f46740ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f46727fc640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f46740cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178869129 0 0) 0x7f46740cda60 con 0x7f4674160160 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.524+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4660003520 con 0x7f4674160160 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668505627 0 0) 0x7f4660003520 con 0x7f4674160160 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 msgr2=0x7f46740cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f46740cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 >> v2:172.21.15.135:3300/0 conn(0x7f46740b5bf0 msgr2=0x7f46740ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 --2- 172.21.15.62:0/4275106539 >> v2:172.21.15.135:3300/0 conn(0x7f46740b5bf0 0x7f46740ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740cd450 con 0x7f4674160160 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f466c001670 con 0x7f4674160160 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 >> v1:172.21.15.62:6789/0 conn(0x7f4674160160 legacy=0x7f46740d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4660003970 0x7f4660003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f4660004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f4660005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740d18a0 con 0x7f46600047c0 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674160540 con 0x7f4660003970 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466000b980 con 0x7f46740b5790 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f4660004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f4672ffd640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4660003970 0x7f4660003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46737fe640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f4660005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 -- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 msgr2=0x7f4660005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46740b5790 0x7f4660005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 -- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4660003970 msgr2=0x7f4660003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4660003970 0x7f4660003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.525+0000 7f46727fc640 1 -- 172.21.15.62:0/4275106539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660003520 con 0x7f46600047c0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f46727fc640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f4660004c40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ac0 tx=0x7f46600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d873fd21ec23ed3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c02c6b0 con 0x7f46600047c0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f465c02c810 con 0x7f46600047c0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f4671ffb640 1 -- 172.21.15.62:0/4275106539 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c02cba0 con 0x7f46600047c0 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f4679a09640 1 -- 172.21.15.62:0/4275106539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 msgr2=0x7f4660004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f4679a09640 1 --2- 172.21.15.62:0/4275106539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f4660004c40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ac0 tx=0x7f46600057f0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.526+0000 7f46737fe640 1 -- 172.21.15.62:0/4275106539 reap_dead start 2023-09-30T13:58:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.527+0000 7f4679a09640 1 -- 172.21.15.62:0/4275106539 shutdown_connections 2023-09-30T13:58:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.527+0000 7f4679a09640 1 -- 172.21.15.62:0/4275106539 >> 172.21.15.62:0/4275106539 conn(0x7f4674089fe0 msgr2=0x7f46740d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.527+0000 7f4679a09640 1 -- 172.21.15.62:0/4275106539 shutdown_connections 2023-09-30T13:58:10.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.527+0000 7f4679a09640 1 -- 172.21.15.62:0/4275106539 wait complete. 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.528+0000 7f4679a09640 1 Processor -- start 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.528+0000 7f4679a09640 1 -- start start 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467415de80 0x7f467415e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4674147b20 0x7f4674147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415e8f0 con 0x7f46600047c0 2023-09-30T13:58:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415ebd0 con 0x7f4674147b20 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467415eeb0 con 0x7f467415de80 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52150/0 (socket says 172.21.15.62:52150) 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 -- 172.21.15.62:0/3237395690 learned_addr learned my addr 172.21.15.62:0/3237395690 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f46737fe640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4674147b20 0x7f4674147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f46727fc640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467415de80 0x7f467415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 -- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467415de80 msgr2=0x7f467415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467415de80 0x7f467415e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 -- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4674147b20 msgr2=0x7f4674147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4674147b20 0x7f4674147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 -- 172.21.15.62:0/3237395690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467415f190 con 0x7f46600047c0 2023-09-30T13:58:10.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4672ffd640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f466c007290 tx=0x7f466c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c001450 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f466c00f9c0 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467415f470 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.529+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00fd90 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.530+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467415c620 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.531+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467415f6b0 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.531+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f466c01d460 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.531+0000 7f466bfff640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 0x7f465406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.532+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f466c0892d0 con 0x7f46600047c0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.532+0000 7f46727fc640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 0x7f465406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:10.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.532+0000 7f46727fc640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 0x7f465406cff0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ac0 tx=0x7f465c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:10.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.536+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f467415f6b0 con 0x7f46600047c0 2023-09-30T13:58:10.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.724+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f467415c620 con 0x7f46600047c0 2023-09-30T13:58:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.724+0000 7f466bfff640 1 -- 172.21.15.62:0/3237395690 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f467415c620 con 0x7f46600047c0 2023-09-30T13:58:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:58:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 msgr2=0x7f465406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 0x7f465406cff0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f465c009ac0 tx=0x7f465c030000 comp rx=0 tx=0).stop 2023-09-30T13:58:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 msgr2=0x7f467415bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f466c007290 tx=0x7f466c007750 comp rx=0 tx=0).stop 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 shutdown_connections 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f465406ab30 0x7f465406cff0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4674147b20 0x7f4674147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467415de80 0x7f467415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 --2- 172.21.15.62:0/3237395690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46600047c0 0x7f467415bf00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 >> 172.21.15.62:0/3237395690 conn(0x7f4674089fe0 msgr2=0x7f46740b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 shutdown_connections 2023-09-30T13:58:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:10.726+0000 7f4679a09640 1 -- 172.21.15.62:0/3237395690 wait complete. 2023-09-30T13:58:10.736 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-09-30T13:58:10.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:10.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T13:58:10.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi062.stderr:ceph-fuse[108569]: fuse finished with error 0 and tester_r 0 2023-09-30T13:58:10.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:10.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:10.786 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T13:58:10.956 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:58:10.956 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:10.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.102+0000 7f75b1d0f640 1 Processor -- start 2023-09-30T13:58:11.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.102+0000 7f75b1d0f640 1 -- start start 2023-09-30T13:58:11.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75b1d0f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 0x7f75ac0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75b1d0f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac06b650 0x7f75ac06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75b1d0f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0cf450 con 0x7f75ac15cbe0 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75b1d0f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cfcf0 con 0x7f75ac06b650 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75b1d0f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cf730 con 0x7f75ac0d1410 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75abfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac06b650 0x7f75ac06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75abfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ac06b650 0x7f75ac06bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52154/0 (socket says 172.21.15.62:52154) 2023-09-30T13:58:11.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.103+0000 7f75abfff640 1 -- 172.21.15.62:0/3644132500 learned_addr learned my addr 172.21.15.62:0/3644132500 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75aaffd640 1 --2- 172.21.15.62:0/3644132500 >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 0x7f75ac0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75abfff640 1 -- 172.21.15.62:0/3644132500 >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 msgr2=0x7f75ac0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75abfff640 1 --2- 172.21.15.62:0/3644132500 >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 0x7f75ac0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75abfff640 1 -- 172.21.15.62:0/3644132500 >> v1:172.21.15.135:6789/0 conn(0x7f75ac15cbe0 legacy=0x7f75ac0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75abfff640 1 -- 172.21.15.62:0/3644132500 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0cfa10 con 0x7f75ac06b650 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75aaffd640 1 --2- 172.21.15.62:0/3644132500 >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 0x7f75ac0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.104+0000 7f75abfff640 1 --2- 172.21.15.62:0/3644132500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac06b650 0x7f75ac06bac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f75ac08c140 tx=0x7f75a402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ddb6af70a8707 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75aa7fc640 1 -- 172.21.15.62:0/3644132500 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a402cbb0 con 0x7f75ac06b650 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75aa7fc640 1 -- 172.21.15.62:0/3644132500 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f75a402cd10 con 0x7f75ac06b650 2023-09-30T13:58:11.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75aa7fc640 1 -- 172.21.15.62:0/3644132500 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4034610 con 0x7f75ac06b650 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3644132500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac06b650 msgr2=0x7f75ac06bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3644132500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac06b650 0x7f75ac06bac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f75ac08c140 tx=0x7f75a402c010 comp rx=0 tx=0).stop 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3644132500 shutdown_connections 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3644132500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac06b650 0x7f75ac06bac0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3644132500 >> v2:172.21.15.135:3300/0 conn(0x7f75ac0d1410 0x7f75ac0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3644132500 >> 172.21.15.62:0/3644132500 conn(0x7f75ac089fe0 msgr2=0x7f75ac0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3644132500 shutdown_connections 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.105+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3644132500 wait complete. 2023-09-30T13:58:11.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.106+0000 7f75b1d0f640 1 Processor -- start 2023-09-30T13:58:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 -- start start 2023-09-30T13:58:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ac06b650 0x7f75ac150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75ac15cbe0 0x7f75ac0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0c60f0 con 0x7f75ac0d1410 2023-09-30T13:58:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0cb2a0 con 0x7f75ac06b650 2023-09-30T13:58:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75b1d0f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0ca3b0 con 0x7f75ac15cbe0 2023-09-30T13:58:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75aaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75aaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52156/0 (socket says 172.21.15.62:52156) 2023-09-30T13:58:11.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.107+0000 7f75aaffd640 1 -- 172.21.15.62:0/3419434630 learned_addr learned my addr 172.21.15.62:0/3419434630 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75abfff640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75ac15cbe0 0x7f75ac0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75ab7fe640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ac06b650 0x7f75ac150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 -- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75ac15cbe0 msgr2=0x7f75ac0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75ac15cbe0 0x7f75ac0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 -- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ac06b650 msgr2=0x7f75ac150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ac06b650 0x7f75ac150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 -- 172.21.15.62:0/3419434630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009b30 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75aaffd640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e730 tx=0x7f75a000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0004230 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f75a0004390 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000c8f0 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0ca690 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.108+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0cac50 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.109+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0b1a20 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.109+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f75a000ca50 con 0x7f75ac0d1410 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.110+0000 7f7593fff640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 0x7f759806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.110+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f75a0089060 con 0x7f75ac0d1410 2023-09-30T13:58:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.110+0000 7f75ab7fe640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 0x7f759806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.111+0000 7f75ab7fe640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 0x7f759806cff0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f759c000fb0 tx=0x7f759c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.114+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f75a00540a0 con 0x7f75ac0d1410 2023-09-30T13:58:11.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.292+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75ac04e0d0 con 0x7f75ac0d1410 2023-09-30T13:58:11.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.293+0000 7f7593fff640 1 -- 172.21.15.62:0/3419434630 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f75a0020090 con 0x7f75ac0d1410 2023-09-30T13:58:11.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:11.293 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":54,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:32.771192+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 msgr2=0x7f759806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 0x7f759806cff0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f759c000fb0 tx=0x7f759c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 msgr2=0x7f75ac0b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e730 tx=0x7f75a000ebf0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 shutdown_connections 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f759806ab30 0x7f759806cff0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75ac15cbe0 0x7f75ac0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ac0d1410 0x7f75ac0b6f60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 --2- 172.21.15.62:0/3419434630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ac06b650 0x7f75ac150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 >> 172.21.15.62:0/3419434630 conn(0x7f75ac089fe0 msgr2=0x7f75ac15d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 shutdown_connections 2023-09-30T13:58:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.295+0000 7f75b1d0f640 1 -- 172.21.15.62:0/3419434630 wait complete. 2023-09-30T13:58:11.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:57:19.089309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:57:20.102791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:58:11.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:58:11.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.417+0000 7fb770348640 1 Processor -- start 2023-09-30T13:58:11.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.417+0000 7fb770348640 1 -- start start 2023-09-30T13:58:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb770348640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7681599f0 0x7fb7680b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb770348640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 0x7fb7680b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb770348640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7680af960 con 0x7fb768159610 2023-09-30T13:58:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb770348640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76806c390 con 0x7fb7681599f0 2023-09-30T13:58:11.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb770348640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76806c670 con 0x7fb7680b0e60 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76e0e4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb768159610 0x7fb7680af110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56802/0 (socket says 172.21.15.62:56802) 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76e0e4640 1 -- 172.21.15.62:0/2859976153 learned_addr learned my addr 172.21.15.62:0/2859976153 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2859976153 >> v2:172.21.15.62:3300/0 conn(0x7fb7681599f0 0x7fb7680b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76e8e5640 1 --2- 172.21.15.62:0/2859976153 >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 0x7fb7680b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d8e3640 1 -- 172.21.15.62:0/2859976153 >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 msgr2=0x7fb7680b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2859976153 >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 0x7fb7680b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d8e3640 1 -- 172.21.15.62:0/2859976153 >> v1:172.21.15.62:6789/0 conn(0x7fb768159610 legacy=0x7fb7680af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d0e2640 1 -- 172.21.15.62:0/2859976153 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963992948 0 0) 0x7fb7680af960 con 0x7fb768159610 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76d8e3640 1 -- 172.21.15.62:0/2859976153 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76806c950 con 0x7fb7681599f0 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.418+0000 7fb76e8e5640 1 --2- 172.21.15.62:0/2859976153 >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 0x7fb7680b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:11.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.419+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2859976153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7681599f0 0x7fb7680b29a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb7680b0210 tx=0x7fb75802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7338ca045dcc713c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.419+0000 7fb76d0e2640 1 -- 172.21.15.62:0/2859976153 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75802e070 con 0x7fb7681599f0 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.419+0000 7fb76d0e2640 1 -- 172.21.15.62:0/2859976153 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb7580315a0 con 0x7fb7681599f0 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.419+0000 7fb76d0e2640 1 -- 172.21.15.62:0/2859976153 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758031930 con 0x7fb7681599f0 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 -- 172.21.15.62:0/2859976153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7681599f0 msgr2=0x7fb7680b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 --2- 172.21.15.62:0/2859976153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7681599f0 0x7fb7680b29a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb7680b0210 tx=0x7fb75802b840 comp rx=0 tx=0).stop 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 -- 172.21.15.62:0/2859976153 shutdown_connections 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 --2- 172.21.15.62:0/2859976153 >> v2:172.21.15.135:3300/0 conn(0x7fb7680b0e60 0x7fb7680b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 --2- 172.21.15.62:0/2859976153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7681599f0 0x7fb7680b29a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 -- 172.21.15.62:0/2859976153 >> 172.21.15.62:0/2859976153 conn(0x7fb7680cb720 msgr2=0x7fb7680ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 -- 172.21.15.62:0/2859976153 shutdown_connections 2023-09-30T13:58:11.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.420+0000 7fb770348640 1 -- 172.21.15.62:0/2859976153 wait complete. 2023-09-30T13:58:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.421+0000 7fb770348640 1 Processor -- start 2023-09-30T13:58:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.421+0000 7fb770348640 1 -- start start 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 0x7fb7680b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7681599f0 0x7fb7680b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680ab9f0 con 0x7fb7680b0e60 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76815b370 con 0x7fb768159610 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb770348640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76815c7d0 con 0x7fb7681599f0 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52180/0 (socket says 172.21.15.62:52180) 2023-09-30T13:58:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 -- 172.21.15.62:0/2772102204 learned_addr learned my addr 172.21.15.62:0/2772102204 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e8e5640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7681599f0 0x7fb7680b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 0x7fb7680b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 -- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7681599f0 msgr2=0x7fb7680b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7681599f0 0x7fb7680b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 -- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 msgr2=0x7fb7680b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 0x7fb7680b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76e0e4640 1 -- 172.21.15.62:0/2772102204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009400 con 0x7fb7680b0e60 2023-09-30T13:58:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.422+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 0x7fb7680b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb76e0e4640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c500 tx=0x7fb76400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764007560 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb7640047e0 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764004b90 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76815ca70 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.423+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76815d030 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.424+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76804e0d0 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.424+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb764004cf0 con 0x7fb7680b0e60 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.425+0000 7fb75effd640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 0x7fb74c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.425+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb764088430 con 0x7fb7680b0e60 2023-09-30T13:58:11.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.425+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 0x7fb74c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.426+0000 7fb76d8e3640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 0x7fb74c06cff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb7680b0210 tx=0x7fb758008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.429+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb764053640 con 0x7fb7680b0e60 2023-09-30T13:58:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.604+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7680cf170 con 0x7fb7680b0e60 2023-09-30T13:58:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.604+0000 7fb75effd640 1 -- 172.21.15.62:0/2772102204 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb764018020 con 0x7fb7680b0e60 2023-09-30T13:58:11.604 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:58:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 msgr2=0x7fb74c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 0x7fb74c06cff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb7680b0210 tx=0x7fb758008030 comp rx=0 tx=0).stop 2023-09-30T13:58:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 msgr2=0x7fb76814f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c500 tx=0x7fb76400c9c0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 shutdown_connections 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb74c06ab30 0x7fb74c06cff0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7681599f0 0x7fb7680b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb768159610 0x7fb7680b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 --2- 172.21.15.62:0/2772102204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7680b0e60 0x7fb76814f760 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 >> 172.21.15.62:0/2772102204 conn(0x7fb7680cb720 msgr2=0x7fb76815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 shutdown_connections 2023-09-30T13:58:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.606+0000 7fb770348640 1 -- 172.21.15.62:0/2772102204 wait complete. 2023-09-30T13:58:11.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:58:11.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.726+0000 7ffb82fdc640 1 Processor -- start 2023-09-30T13:58:11.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.726+0000 7ffb82fdc640 1 -- start start 2023-09-30T13:58:11.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb82fdc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb82fdc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb7c0ae300 0x7ffb7c06ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb82fdc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c06d740 con 0x7ffb7c15cee0 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb82fdc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c06da20 con 0x7ffb7c0ae300 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb82fdc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c06dd00 con 0x7ffb7c15cb00 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb7c0ae300 0x7ffb7c06ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb7c0ae300 0x7ffb7c06ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52188/0 (socket says 172.21.15.62:52188) 2023-09-30T13:58:11.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 -- 172.21.15.62:0/3075969384 learned_addr learned my addr 172.21.15.62:0/3075969384 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb80d78640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 -- 172.21.15.62:0/3075969384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 msgr2=0x7ffb7c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 -- 172.21.15.62:0/3075969384 >> v1:172.21.15.135:6789/0 conn(0x7ffb7c15cee0 legacy=0x7ffb7c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb81579640 1 -- 172.21.15.62:0/3075969384 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c06dfe0 con 0x7ffb7c0ae300 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.727+0000 7ffb80d78640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.728+0000 7ffb81579640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c06ad60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009870 tx=0x7ffb6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d2afedd2f12314 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.728+0000 7ffb7b7fe640 1 -- 172.21.15.62:0/3075969384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64030840 con 0x7ffb7c0ae300 2023-09-30T13:58:11.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.728+0000 7ffb7b7fe640 1 -- 172.21.15.62:0/3075969384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ffb640309a0 con 0x7ffb7c0ae300 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.728+0000 7ffb7b7fe640 1 -- 172.21.15.62:0/3075969384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64030d30 con 0x7ffb7c0ae300 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 -- 172.21.15.62:0/3075969384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c0ae300 msgr2=0x7ffb7c06ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c06ad60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009870 tx=0x7ffb6402b980 comp rx=0 tx=0).stop 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 -- 172.21.15.62:0/3075969384 shutdown_connections 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c06ad60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/3075969384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 -- 172.21.15.62:0/3075969384 >> 172.21.15.62:0/3075969384 conn(0x7ffb7c070970 msgr2=0x7ffb7c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 -- 172.21.15.62:0/3075969384 shutdown_connections 2023-09-30T13:58:11.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.729+0000 7ffb82fdc640 1 -- 172.21.15.62:0/3075969384 wait complete. 2023-09-30T13:58:11.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.730+0000 7ffb82fdc640 1 Processor -- start 2023-09-30T13:58:11.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.730+0000 7ffb82fdc640 1 -- start start 2023-09-30T13:58:11.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c15e5e0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1f60f0 con 0x7ffb7c0ae300 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb82fdc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1f6390 con 0x7ffb7c15cb00 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52192/0 (socket says 172.21.15.62:52192) 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 -- 172.21.15.62:0/269075521 learned_addr learned my addr 172.21.15.62:0/269075521 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb80d78640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb7bfff640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 -- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 msgr2=0x7ffb7c1f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c1f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 -- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c0ae300 msgr2=0x7ffb7c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.731+0000 7ffb81579640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb81579640 1 -- 172.21.15.62:0/269075521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640094d0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb81579640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffb6402b9c0 tx=0x7ffb64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640307d0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7ffb64043400 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c1f6670 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640437b0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.732+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c15e7f0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.733+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c0666d0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.733+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ffb64043910 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.734+0000 7ffb797fa640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 0x7ffb5c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.734+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ffb6403e070 con 0x7ffb7c15cee0 2023-09-30T13:58:11.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.734+0000 7ffb80d78640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 0x7ffb5c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:11.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.734+0000 7ffb80d78640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 0x7ffb5c06cff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb740075b0 tx=0x7ffb74007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:11.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.738+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ffb64077800 con 0x7ffb7c15cee0 2023-09-30T13:58:11.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.913+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb7c06e2a0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.913+0000 7ffb797fa640 1 -- 172.21.15.62:0/269075521 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb7c06e2a0 con 0x7ffb7c15cee0 2023-09-30T13:58:11.913 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:58:11.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 msgr2=0x7ffb5c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 0x7ffb5c06cff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb740075b0 tx=0x7ffb74007540 comp rx=0 tx=0).stop 2023-09-30T13:58:11.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 msgr2=0x7ffb7c14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:11.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffb6402b9c0 tx=0x7ffb64004730 comp rx=0 tx=0).stop 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 shutdown_connections 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ffb5c06ab30 0x7ffb5c06cff0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb7c15cee0 0x7ffb7c14fbf0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb7c15cb00 0x7ffb7c1f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.915+0000 7ffb82fdc640 1 --2- 172.21.15.62:0/269075521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb7c0ae300 0x7ffb7c0b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.916+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 >> 172.21.15.62:0/269075521 conn(0x7ffb7c070970 msgr2=0x7ffb7c0c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.916+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 shutdown_connections 2023-09-30T13:58:11.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:11.916+0000 7ffb82fdc640 1 -- 172.21.15.62:0/269075521 wait complete. 2023-09-30T13:58:11.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:58:12.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.035+0000 7fddff6b4640 1 Processor -- start 2023-09-30T13:58:12.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.035+0000 7fddff6b4640 1 -- start start 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddff6b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf80cd960 0x7fddf806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddff6b4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf80b18a0 0x7fddf806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddff6b4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80d0050 con 0x7fddf806b070 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddff6b4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80cdd40 con 0x7fddf80b18a0 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddff6b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf806b500 con 0x7fddf80cd960 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf80b18a0 0x7fddf806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fddf80b18a0 0x7fddf806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52208/0 (socket says 172.21.15.62:52208) 2023-09-30T13:58:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 -- 172.21.15.62:0/2020245021 learned_addr learned my addr 172.21.15.62:0/2020245021 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfd450640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf80cd960 0x7fddf806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 -- 172.21.15.62:0/2020245021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf80cd960 msgr2=0x7fddf806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf80cd960 0x7fddf806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 -- 172.21.15.62:0/2020245021 >> v1:172.21.15.135:6789/0 conn(0x7fddf806b070 legacy=0x7fddf81609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.036+0000 7fddfdc51640 1 -- 172.21.15.62:0/2020245021 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80cf720 con 0x7fddf80b18a0 2023-09-30T13:58:12.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.037+0000 7fddfdc51640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf806bdb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03f2374c167e0cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.037+0000 7fddeffff640 1 -- 172.21.15.62:0/2020245021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf002ca70 con 0x7fddf80b18a0 2023-09-30T13:58:12.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.037+0000 7fddeffff640 1 -- 172.21.15.62:0/2020245021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fddf002cbd0 con 0x7fddf80b18a0 2023-09-30T13:58:12.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.037+0000 7fddeffff640 1 -- 172.21.15.62:0/2020245021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00343f0 con 0x7fddf80b18a0 2023-09-30T13:58:12.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 -- 172.21.15.62:0/2020245021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 msgr2=0x7fddf806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf806bdb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf002bed0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 -- 172.21.15.62:0/2020245021 shutdown_connections 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf806bdb0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 --2- 172.21.15.62:0/2020245021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf80cd960 0x7fddf806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 -- 172.21.15.62:0/2020245021 >> 172.21.15.62:0/2020245021 conn(0x7fddf80d08e0 msgr2=0x7fddf80d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 -- 172.21.15.62:0/2020245021 shutdown_connections 2023-09-30T13:58:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.038+0000 7fddff6b4640 1 -- 172.21.15.62:0/2020245021 wait complete. 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.039+0000 7fddff6b4640 1 Processor -- start 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.039+0000 7fddff6b4640 1 -- start start 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 0x7fddf809b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf809b920 0x7fddf80b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf809afc0 con 0x7fddf80b18a0 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c63e0 con 0x7fddf80cd960 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddff6b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf809a620 con 0x7fddf809b920 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52212/0 (socket says 172.21.15.62:52212) 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 -- 172.21.15.62:0/1586562435 learned_addr learned my addr 172.21.15.62:0/1586562435 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfdc51640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf809b920 0x7fddf80b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfcc4f640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 0x7fddf809b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 -- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf809b920 msgr2=0x7fddf80b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf809b920 0x7fddf80b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 -- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 msgr2=0x7fddf809b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 0x7fddf809b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfd450640 1 -- 172.21.15.62:0/1586562435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009b30 con 0x7fddf80b18a0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.040+0000 7fddfcc4f640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 0x7fddf809b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddfd450640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fddf400d800 tx=0x7fddf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400b6c0 con 0x7fddf80b18a0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fddf400b820 con 0x7fddf80b18a0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf809a900 con 0x7fddf80b18a0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400bbb0 con 0x7fddf80b18a0 2023-09-30T13:58:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.041+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf815b4f0 con 0x7fddf80b18a0 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.042+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf815b6b0 con 0x7fddf80b18a0 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.042+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fddf400bd10 con 0x7fddf80b18a0 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.043+0000 7fddedffb640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 0x7fdddc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.043+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fddf40898a0 con 0x7fddf80b18a0 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.043+0000 7fddfcc4f640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 0x7fdddc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.043+0000 7fddfcc4f640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 0x7fdddc06cff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.047+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fddf40548e0 con 0x7fddf80b18a0 2023-09-30T13:58:12.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.222+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddf804e0d0 con 0x7fddf80b18a0 2023-09-30T13:58:12.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.222+0000 7fddedffb640 1 -- 172.21.15.62:0/1586562435 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddf4057f00 con 0x7fddf80b18a0 2023-09-30T13:58:12.222 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:58:12.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 msgr2=0x7fdddc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 0x7fdddc06cff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8008040 comp rx=0 tx=0).stop 2023-09-30T13:58:12.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 msgr2=0x7fddf815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fddf400d800 tx=0x7fddf400dcc0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 shutdown_connections 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdddc06ab30 0x7fdddc06cff0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fddf809b920 0x7fddf80b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddf80cd960 0x7fddf809b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 --2- 172.21.15.62:0/1586562435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fddf80b18a0 0x7fddf815afb0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 >> 172.21.15.62:0/1586562435 conn(0x7fddf80d08e0 msgr2=0x7fddf806b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 shutdown_connections 2023-09-30T13:58:12.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.224+0000 7fddff6b4640 1 -- 172.21.15.62:0/1586562435 wait complete. 2023-09-30T13:58:12.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T13:58:12.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.343+0000 7f0b3d4ec640 1 Processor -- start 2023-09-30T13:58:12.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.343+0000 7f0b3d4ec640 1 -- start start 2023-09-30T13:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.343+0000 7f0b3d4ec640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 0x7f0b380b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.343+0000 7f0b3d4ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.343+0000 7f0b3d4ec640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b381608f0 con 0x7f0b380cfb00 2023-09-30T13:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b3d4ec640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b38161570 con 0x7f0b3815cb80 2023-09-30T13:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b3d4ec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380d04d0 con 0x7f0b380b3650 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b36ffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 0x7f0b380b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:50772/0 (socket says 172.21.15.62:50772) 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b36ffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 0x7f0b380b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:44814/0 (socket says 172.21.15.62:44814) 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 -- 172.21.15.62:0/2027962002 learned_addr learned my addr 172.21.15.62:0/2027962002 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 -- 172.21.15.62:0/2027962002 >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 msgr2=0x7f0b380b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 --2- 172.21.15.62:0/2027962002 >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 0x7f0b380b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 -- 172.21.15.62:0/2027962002 >> v1:172.21.15.135:6789/0 conn(0x7f0b380cfb00 legacy=0x7f0b38071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.344+0000 7f0b377fe640 1 -- 172.21.15.62:0/2027962002 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38160bd0 con 0x7f0b380b3650 2023-09-30T13:58:12.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.345+0000 7f0b377fe640 1 --2- 172.21.15.62:0/2027962002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009e50 tx=0x7f0b3002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530817942468e88c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.345+0000 7f0b35ffb640 1 -- 172.21.15.62:0/2027962002 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3002cb00 con 0x7f0b380b3650 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.345+0000 7f0b35ffb640 1 -- 172.21.15.62:0/2027962002 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0b3002cc60 con 0x7f0b380b3650 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.345+0000 7f0b35ffb640 1 -- 172.21.15.62:0/2027962002 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300343f0 con 0x7f0b380b3650 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/2027962002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 msgr2=0x7f0b380cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/2027962002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009e50 tx=0x7f0b3002bf60 comp rx=0 tx=0).stop 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/2027962002 shutdown_connections 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/2027962002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380b3650 0x7f0b380cff90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/2027962002 >> v2:172.21.15.135:3300/0 conn(0x7f0b3815cb80 0x7f0b380b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/2027962002 >> 172.21.15.62:0/2027962002 conn(0x7f0b3806b250 msgr2=0x7f0b3806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/2027962002 shutdown_connections 2023-09-30T13:58:12.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.346+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/2027962002 wait complete. 2023-09-30T13:58:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.347+0000 7f0b3d4ec640 1 Processor -- start 2023-09-30T13:58:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.347+0000 7f0b3d4ec640 1 -- start start 2023-09-30T13:58:12.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380cfb00 0x7f0b381f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3815cb80 0x7f0b3814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3815d4b0 con 0x7f0b380b3650 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380ae790 con 0x7f0b3815cb80 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b3d4ec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380ae4b0 con 0x7f0b380cfb00 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52226/0 (socket says 172.21.15.62:52226) 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 -- 172.21.15.62:0/257798373 learned_addr learned my addr 172.21.15.62:0/257798373 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b377fe640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3815cb80 0x7f0b3814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b367fc640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380cfb00 0x7f0b381f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 -- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380cfb00 msgr2=0x7f0b381f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380cfb00 0x7f0b381f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 -- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3815cb80 msgr2=0x7f0b3814db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3815cb80 0x7f0b3814db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.348+0000 7f0b36ffd640 1 -- 172.21.15.62:0/257798373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30009b30 con 0x7f0b380b3650 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b36ffd640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e870 tx=0x7f0b2800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280094f0 con 0x7f0b380b3650 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0b2800c940 con 0x7f0b380b3650 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380ac380 con 0x7f0b380b3650 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800ccf0 con 0x7f0b380b3650 2023-09-30T13:58:12.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.349+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b380ac940 con 0x7f0b380b3650 2023-09-30T13:58:12.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.350+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38073e70 con 0x7f0b380b3650 2023-09-30T13:58:12.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.350+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0b28013470 con 0x7f0b380b3650 2023-09-30T13:58:12.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.351+0000 7f0b1f7fe640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 0x7f0b2406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.351+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0b28089520 con 0x7f0b380b3650 2023-09-30T13:58:12.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.351+0000 7f0b367fc640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 0x7f0b2406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.351+0000 7f0b367fc640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 0x7f0b2406cff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b380c9730 tx=0x7f0b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.355+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0b28054560 con 0x7f0b380b3650 2023-09-30T13:58:12.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.544+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b380ce740 con 0x7f0b380b3650 2023-09-30T13:58:12.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.544+0000 7f0b1f7fe640 1 -- 172.21.15.62:0/257798373 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0b28057b80 con 0x7f0b380b3650 2023-09-30T13:58:12.544 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-09-30T13:58:12.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 msgr2=0x7f0b2406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 0x7f0b2406cff0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b380c9730 tx=0x7f0b2c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:12.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 msgr2=0x7f0b380ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e870 tx=0x7f0b2800ed30 comp rx=0 tx=0).stop 2023-09-30T13:58:12.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 shutdown_connections 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b2406ab30 0x7f0b2406cff0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3815cb80 0x7f0b3814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b380cfb00 0x7f0b381f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 --2- 172.21.15.62:0/257798373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b380b3650 0x7f0b380ace60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 >> 172.21.15.62:0/257798373 conn(0x7f0b3806b250 msgr2=0x7f0b380b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 shutdown_connections 2023-09-30T13:58:12.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.546+0000 7f0b3d4ec640 1 -- 172.21.15.62:0/257798373 wait complete. 2023-09-30T13:58:12.557 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2023-09-30T13:58:12.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:12.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-09-30T13:58:12.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi135.stderr:ceph-fuse[95424]: fuse finished with error 0 and tester_r 0 2023-09-30T13:58:12.589 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:12.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:12.590 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-30T13:58:12.725 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:12.726 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:12.742 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:58:12.742 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:12.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:12.742 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-30T13:58:12.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:58:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-30T13:58:12.798 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:58:12.798 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:12.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:58:12.815 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:12.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:12.816 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-30T13:58:12.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:58:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-30T13:58:12.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:58:12.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.979+0000 7f0d43f90640 1 Processor -- start 2023-09-30T13:58:12.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.979+0000 7f0d43f90640 1 -- start start 2023-09-30T13:58:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d43f90640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 0x7f0d3c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d43f90640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d43f90640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0b1e20 con 0x7f0d3c1598c0 2023-09-30T13:58:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d43f90640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b1530 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d43f90640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b17d0 con 0x7f0d3c0cf140 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d4252d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d4252d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52230/0 (socket says 172.21.15.62:52230) 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.980+0000 7f0d4252d640 1 -- 172.21.15.62:0/766956463 learned_addr learned my addr 172.21.15.62:0/766956463 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4252d640 1 -- 172.21.15.62:0/766956463 >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 msgr2=0x7f0d3c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4152b640 1 --2- 172.21.15.62:0/766956463 >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 0x7f0d3c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4252d640 1 --2- 172.21.15.62:0/766956463 >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 0x7f0d3c0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4252d640 1 -- 172.21.15.62:0/766956463 >> v1:172.21.15.135:6789/0 conn(0x7f0d3c1598c0 legacy=0x7f0d3c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4252d640 1 -- 172.21.15.62:0/766956463 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0b1ab0 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4152b640 1 --2- 172.21.15.62:0/766956463 >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 0x7f0d3c0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.981+0000 7f0d4252d640 1 --2- 172.21.15.62:0/766956463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009e50 tx=0x7f0d2c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fbe01a947f0d95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d40d2a640 1 -- 172.21.15.62:0/766956463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c02ca80 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d40d2a640 1 -- 172.21.15.62:0/766956463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0d2c02cbe0 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d40d2a640 1 -- 172.21.15.62:0/766956463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0343f0 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 -- 172.21.15.62:0/766956463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0c8c90 msgr2=0x7f0d3c0c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 --2- 172.21.15.62:0/766956463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009e50 tx=0x7f0d2c02bee0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 -- 172.21.15.62:0/766956463 shutdown_connections 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 --2- 172.21.15.62:0/766956463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c9100 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 --2- 172.21.15.62:0/766956463 >> v2:172.21.15.135:3300/0 conn(0x7f0d3c0cf140 0x7f0d3c0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 -- 172.21.15.62:0/766956463 >> 172.21.15.62:0/766956463 conn(0x7f0d3c06a170 msgr2=0x7f0d3c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 -- 172.21.15.62:0/766956463 shutdown_connections 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.982+0000 7f0d43f90640 1 -- 172.21.15.62:0/766956463 wait complete. 2023-09-30T13:58:12.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.983+0000 7f0d43f90640 1 Processor -- start 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.983+0000 7f0d43f90640 1 -- start start 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 0x7f0d3c0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0c86b0 con 0x7f0d3c0cf140 2023-09-30T13:58:12.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0adfa0 con 0x7f0d3c0c8c90 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d43f90640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0978c0 con 0x7f0d3c1598c0 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d4152b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d4152b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52232/0 (socket says 172.21.15.62:52232) 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d4152b640 1 -- 172.21.15.62:0/1099101239 learned_addr learned my addr 172.21.15.62:0/1099101239 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d41d2c640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.984+0000 7f0d4252d640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 0x7f0d3c0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 -- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 msgr2=0x7f0d3c0aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 0x7f0d3c0aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 -- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c0c8c90 msgr2=0x7f0d3c0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 -- 172.21.15.62:0/1099101239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c009b30 con 0x7f0d3c0cf140 2023-09-30T13:58:12.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4252d640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 0x7f0d3c0aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d4152b640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c7f0 tx=0x7f0d3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30007a30 con 0x7f0d3c0cf140 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0d30007b90 con 0x7f0d3c0cf140 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c0c3b20 con 0x7f0d3c0cf140 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000ce40 con 0x7f0d3c0cf140 2023-09-30T13:58:12.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.985+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c0c80f0 con 0x7f0d3c0cf140 2023-09-30T13:58:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.986+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c0b2290 con 0x7f0d3c0cf140 2023-09-30T13:58:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.986+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0d300113f0 con 0x7f0d3c0cf140 2023-09-30T13:58:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.987+0000 7f0d3a7fc640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 0x7f0d2806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.987+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0d300895e0 con 0x7f0d3c0cf140 2023-09-30T13:58:12.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.987+0000 7f0d41d2c640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 0x7f0d2806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.988+0000 7f0d41d2c640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 0x7f0d2806cff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c164f50 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:12.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:12.991+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0d3c0b2290 con 0x7f0d3c0cf140 2023-09-30T13:58:13.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.202+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d3c0b2290 con 0x7f0d3c0cf140 2023-09-30T13:58:13.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.202+0000 7f0d3a7fc640 1 -- 172.21.15.62:0/1099101239 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f0d3c0b2290 con 0x7f0d3c0cf140 2023-09-30T13:58:13.202 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:13.202 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:58:05.796912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:58:13.203 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 msgr2=0x7f0d2806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 0x7f0d2806cff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c164f50 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 msgr2=0x7f0d3c0c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c7f0 tx=0x7f0d3000cbf0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 shutdown_connections 2023-09-30T13:58:13.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0d2806ab30 0x7f0d2806cff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d3c1598c0 0x7f0d3c0aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d3c0cf140 0x7f0d3c0c1100 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 --2- 172.21.15.62:0/1099101239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c0c8c90 0x7f0d3c0c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.204+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 >> 172.21.15.62:0/1099101239 conn(0x7f0d3c06a170 msgr2=0x7f0d3c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.205+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 shutdown_connections 2023-09-30T13:58:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.205+0000 7f0d43f90640 1 -- 172.21.15.62:0/1099101239 wait complete. 2023-09-30T13:58:13.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.321+0000 7f7dec990640 1 Processor -- start 2023-09-30T13:58:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.321+0000 7f7dec990640 1 -- start start 2023-09-30T13:58:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7dec990640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de80d0040 0x7f7de80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7dec990640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7de80ca200 0x7f7de80ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7dec990640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de815d190 con 0x7f7de815cdb0 2023-09-30T13:58:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7dec990640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80d05e0 con 0x7f7de80ca200 2023-09-30T13:58:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7dec990640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b0900 con 0x7f7de80d0040 2023-09-30T13:58:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7de80ca200 0x7f7de80ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7de80ca200 0x7f7de80ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52234/0 (socket says 172.21.15.62:52234) 2023-09-30T13:58:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 -- 172.21.15.62:0/2601998590 learned_addr learned my addr 172.21.15.62:0/2601998590 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7ddffff640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de80d0040 0x7f7de80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 -- 172.21.15.62:0/2601998590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de80d0040 msgr2=0x7f7de80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de80d0040 0x7f7de80cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 -- 172.21.15.62:0/2601998590 >> v1:172.21.15.135:6789/0 conn(0x7f7de815cdb0 legacy=0x7f7de80cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.322+0000 7f7de6d9d640 1 -- 172.21.15.62:0/2601998590 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80b0be0 con 0x7f7de80ca200 2023-09-30T13:58:13.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.323+0000 7f7de6d9d640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80ca200 0x7f7de80ca660 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009e50 tx=0x7f7de002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64b71c8ad0c3bd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.323+0000 7f7de5d9b640 1 -- 172.21.15.62:0/2601998590 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de002cb00 con 0x7f7de80ca200 2023-09-30T13:58:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.323+0000 7f7de5d9b640 1 -- 172.21.15.62:0/2601998590 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f7de002cc60 con 0x7f7de80ca200 2023-09-30T13:58:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.323+0000 7f7de5d9b640 1 -- 172.21.15.62:0/2601998590 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00343f0 con 0x7f7de80ca200 2023-09-30T13:58:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 -- 172.21.15.62:0/2601998590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80ca200 msgr2=0x7f7de80ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80ca200 0x7f7de80ca660 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009e50 tx=0x7f7de002bf60 comp rx=0 tx=0).stop 2023-09-30T13:58:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 -- 172.21.15.62:0/2601998590 shutdown_connections 2023-09-30T13:58:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80ca200 0x7f7de80ca660 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 --2- 172.21.15.62:0/2601998590 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de80d0040 0x7f7de80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 -- 172.21.15.62:0/2601998590 >> 172.21.15.62:0/2601998590 conn(0x7f7de8098a50 msgr2=0x7f7de80cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 -- 172.21.15.62:0/2601998590 shutdown_connections 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.324+0000 7f7dec990640 1 -- 172.21.15.62:0/2601998590 wait complete. 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.325+0000 7f7dec990640 1 Processor -- start 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.325+0000 7f7dec990640 1 -- start start 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7de80ca200 0x7f7de8158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de815cdb0 0x7f7de815e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de815e130 con 0x7f7de80d0040 2023-09-30T13:58:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8158f80 con 0x7f7de80ca200 2023-09-30T13:58:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7dec990640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8160030 con 0x7f7de815cdb0 2023-09-30T13:58:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52238/0 (socket says 172.21.15.62:52238) 2023-09-30T13:58:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7ddffff640 1 -- 172.21.15.62:0/1366473103 learned_addr learned my addr 172.21.15.62:0/1366473103 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7de6d9d640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de815cdb0 0x7f7de815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.326+0000 7f7de659c640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7de80ca200 0x7f7de8158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 -- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de815cdb0 msgr2=0x7f7de815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de815cdb0 0x7f7de815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 -- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7de80ca200 msgr2=0x7f7de8158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7de80ca200 0x7f7de8158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 -- 172.21.15.62:0/1366473103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de0009b30 con 0x7f7de80d0040 2023-09-30T13:58:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddffff640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d800 tx=0x7f7dd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000b6c0 con 0x7f7de80d0040 2023-09-30T13:58:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f7dd000b840 con 0x7f7de80d0040 2023-09-30T13:58:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de815d4b0 con 0x7f7de80d0040 2023-09-30T13:58:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bbf0 con 0x7f7de80d0040 2023-09-30T13:58:13.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.327+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de815da70 con 0x7f7de80d0040 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.328+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804e0d0 con 0x7f7de80d0040 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.328+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f7dd000bd50 con 0x7f7de80d0040 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.329+0000 7f7ddeffd640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 0x7f7dc806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.329+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f7dd00897b0 con 0x7f7de80d0040 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.329+0000 7f7de659c640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 0x7f7dc806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.329+0000 7f7de659c640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 0x7f7dc806cff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7de80cc920 tx=0x7f7dd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.333+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f7dd0054920 con 0x7f7de80d0040 2023-09-30T13:58:13.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.509+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de806d940 con 0x7f7de80d0040 2023-09-30T13:58:13.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.510+0000 7f7ddeffd640 1 -- 172.21.15.62:0/1366473103 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f7dd0057f40 con 0x7f7de80d0040 2023-09-30T13:58:13.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:13.510 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":54,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:32.771192+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:13.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 msgr2=0x7f7dc806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 0x7f7dc806cff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7de80cc920 tx=0x7f7dd8009040 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 msgr2=0x7f7de80c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d800 tx=0x7f7dd000dcc0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 shutdown_connections 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f7dc806ab30 0x7f7dc806cff0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7de815cdb0 0x7f7de815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d0040 0x7f7de80c3c60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 --2- 172.21.15.62:0/1366473103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7de80ca200 0x7f7de8158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 >> 172.21.15.62:0/1366473103 conn(0x7f7de8098a50 msgr2=0x7f7de80ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 shutdown_connections 2023-09-30T13:58:13.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.512+0000 7f7dec990640 1 -- 172.21.15.62:0/1366473103 wait complete. 2023-09-30T13:58:13.523 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T13:54:37.728674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T13:57:19.089309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T13:57:20.102791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T13:58:13.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T13:58:13.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.632+0000 7f887764b640 1 Processor -- start 2023-09-30T13:58:13.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.632+0000 7f887764b640 1 -- start start 2023-09-30T13:58:13.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f887764b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f887015cbc0 0x7f88700d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f887764b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88700b8760 0x7f88700d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f887764b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700d1410 con 0x7f88700cd8c0 2023-09-30T13:58:13.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f88753e7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f887015cbc0 0x7f88700d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f887764b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700d16f0 con 0x7f887015cbc0 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f887764b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700d19d0 con 0x7f88700b8760 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f88753e7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f887015cbc0 0x7f88700d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52248/0 (socket says 172.21.15.62:52248) 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.633+0000 7f88753e7640 1 -- 172.21.15.62:0/2960342078 learned_addr learned my addr 172.21.15.62:0/2960342078 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.634+0000 7f88753e7640 1 -- 172.21.15.62:0/2960342078 >> v2:172.21.15.135:3300/0 conn(0x7f88700b8760 msgr2=0x7f88700d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.634+0000 7f88753e7640 1 --2- 172.21.15.62:0/2960342078 >> v2:172.21.15.135:3300/0 conn(0x7f88700b8760 0x7f88700d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.634+0000 7f88753e7640 1 -- 172.21.15.62:0/2960342078 >> v1:172.21.15.62:6789/0 conn(0x7f88700cd8c0 legacy=0x7f88700b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.634+0000 7f88753e7640 1 -- 172.21.15.62:0/2960342078 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700d1cb0 con 0x7f887015cbc0 2023-09-30T13:58:13.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.634+0000 7f886ffff640 1 -- 172.21.15.62:0/2960342078 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746694400 0 0) 0x7f88700d1410 con 0x7f88700cd8c0 2023-09-30T13:58:13.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f88753e7640 1 --2- 172.21.15.62:0/2960342078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f88700d24b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f88700b56e0 tx=0x7f886802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1834fff82225b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f886ffff640 1 -- 172.21.15.62:0/2960342078 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868030860 con 0x7f887015cbc0 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f886ffff640 1 -- 172.21.15.62:0/2960342078 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f88680309c0 con 0x7f887015cbc0 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f886ffff640 1 -- 172.21.15.62:0/2960342078 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868030d50 con 0x7f887015cbc0 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 -- 172.21.15.62:0/2960342078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 msgr2=0x7f88700d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 --2- 172.21.15.62:0/2960342078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f88700d24b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f88700b56e0 tx=0x7f886802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 -- 172.21.15.62:0/2960342078 shutdown_connections 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 --2- 172.21.15.62:0/2960342078 >> v2:172.21.15.135:3300/0 conn(0x7f88700b8760 0x7f88700d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 --2- 172.21.15.62:0/2960342078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f88700d24b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 -- 172.21.15.62:0/2960342078 >> 172.21.15.62:0/2960342078 conn(0x7f88700718a0 msgr2=0x7f8870071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 -- 172.21.15.62:0/2960342078 shutdown_connections 2023-09-30T13:58:13.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.635+0000 7f887764b640 1 -- 172.21.15.62:0/2960342078 wait complete. 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 Processor -- start 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 -- start start 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88700b8760 0x7f88700c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 0x7f88700c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c5ba0 con 0x7f887015cbc0 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c7f80 con 0x7f88700cd8c0 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.637+0000 7f887764b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c8260 con 0x7f88700b8760 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52256/0 (socket says 172.21.15.62:52256) 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 -- 172.21.15.62:0/163701993 learned_addr learned my addr 172.21.15.62:0/163701993 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8874be6640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 0x7f88700c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f88753e7640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88700b8760 0x7f88700c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 -- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88700b8760 msgr2=0x7f88700c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88700b8760 0x7f88700c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 -- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 msgr2=0x7f88700c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 0x7f88700c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 -- 172.21.15.62:0/163701993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680094d0 con 0x7f887015cbc0 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8874be6640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 0x7f88700c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f8875be8640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8860001560 tx=0x7f886000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860003da0 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8860005070 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88700c8540 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860005420 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.638+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88700c8b00 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.639+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887004e0d0 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.640+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8860005580 con 0x7f887015cbc0 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.640+0000 7f886dffb640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 0x7f885c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.640+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f8860088d40 con 0x7f887015cbc0 2023-09-30T13:58:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.641+0000 7f88753e7640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 0x7f885c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.641+0000 7f88753e7640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 0x7f885c06cff0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88700b56e0 tx=0x7f886803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.645+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8860053d80 con 0x7f887015cbc0 2023-09-30T13:58:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.819+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88700d2550 con 0x7f887015cbc0 2023-09-30T13:58:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.820+0000 7f886dffb640 1 -- 172.21.15.62:0/163701993 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8860017030 con 0x7f887015cbc0 2023-09-30T13:58:13.820 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-09-30T13:58:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 msgr2=0x7f885c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 0x7f885c06cff0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88700b56e0 tx=0x7f886803b040 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 msgr2=0x7f887015d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8860001560 tx=0x7f886000cc70 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 shutdown_connections 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f885c06ab30 0x7f885c06cff0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f887015cbc0 0x7f887015d4d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88700cd8c0 0x7f88700c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 --2- 172.21.15.62:0/163701993 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88700b8760 0x7f88700c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 >> 172.21.15.62:0/163701993 conn(0x7f88700718a0 msgr2=0x7f88700b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 shutdown_connections 2023-09-30T13:58:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.822+0000 7f887764b640 1 -- 172.21.15.62:0/163701993 wait complete. 2023-09-30T13:58:13.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T13:58:13.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.942+0000 7f0b4157c640 1 Processor -- start 2023-09-30T13:58:13.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.942+0000 7f0b4157c640 1 -- start start 2023-09-30T13:58:13.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b4157c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b3c0cd960 0x7f0b3c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b4157c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0b18a0 0x7f0b3c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b4157c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0d0050 con 0x7f0b3c06b070 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b4157c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c0cdd40 con 0x7f0b3c0cd960 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b4157c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c06b500 con 0x7f0b3c0b18a0 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b3c0cd960 0x7f0b3c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0b3c0cd960 0x7f0b3c06b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52266/0 (socket says 172.21.15.62:52266) 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 -- 172.21.15.62:0/1113763186 learned_addr learned my addr 172.21.15.62:0/1113763186 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3b7fe640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0b18a0 0x7f0b3c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 -- 172.21.15.62:0/1113763186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0b18a0 msgr2=0x7f0b3c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:13.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0b18a0 0x7f0b3c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 -- 172.21.15.62:0/1113763186 >> v1:172.21.15.135:6789/0 conn(0x7f0b3c06b070 legacy=0x7f0b3c1609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.943+0000 7f0b3affd640 1 -- 172.21.15.62:0/1113763186 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0cf720 con 0x7f0b3c0cd960 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b3affd640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c0cd960 0x7f0b3c06b870 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daab3d65d5ee6246 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b3a7fc640 1 -- 172.21.15.62:0/1113763186 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c030840 con 0x7f0b3c0cd960 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b3a7fc640 1 -- 172.21.15.62:0/1113763186 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0b2c0309a0 con 0x7f0b3c0cd960 2023-09-30T13:58:13.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b3a7fc640 1 -- 172.21.15.62:0/1113763186 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c030d30 con 0x7f0b3c0cd960 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b4157c640 1 -- 172.21.15.62:0/1113763186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c0cd960 msgr2=0x7f0b3c06b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.944+0000 7f0b4157c640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c0cd960 0x7f0b3c06b870 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c02b980 comp rx=0 tx=0).stop 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 -- 172.21.15.62:0/1113763186 shutdown_connections 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0b18a0 0x7f0b3c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 --2- 172.21.15.62:0/1113763186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c0cd960 0x7f0b3c06b870 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 -- 172.21.15.62:0/1113763186 >> 172.21.15.62:0/1113763186 conn(0x7f0b3c0d08e0 msgr2=0x7f0b3c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 -- 172.21.15.62:0/1113763186 shutdown_connections 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.945+0000 7f0b4157c640 1 -- 172.21.15.62:0/1113763186 wait complete. 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.946+0000 7f0b4157c640 1 Processor -- start 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.946+0000 7f0b4157c640 1 -- start start 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 0x7f0b3c1f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0cd960 0x7f0b3c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c15b520 con 0x7f0b3c1577b0 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c1f2e50 con 0x7f0b3c0b18a0 2023-09-30T13:58:13.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c158d00 con 0x7f0b3c0cd960 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52270/0 (socket says 172.21.15.62:52270) 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 -- 172.21.15.62:0/919170705 learned_addr learned my addr 172.21.15.62:0/919170705 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3affd640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 0x7f0b3c1f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b327fc640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0cd960 0x7f0b3c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 -- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0cd960 msgr2=0x7f0b3c1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0cd960 0x7f0b3c1598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 -- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 msgr2=0x7f0b3c1f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:13.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 0x7f0b3c1f2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 -- 172.21.15.62:0/919170705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0094d0 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3affd640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 0x7f0b3c1f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b3b7fe640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007e40 tx=0x7f0b3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34014620 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0b3400ee90 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b340149e0 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c158a20 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.947+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c15b140 con 0x7f0b3c1577b0 2023-09-30T13:58:13.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.948+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c15b660 con 0x7f0b3c1577b0 2023-09-30T13:58:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.949+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0b34014b40 con 0x7f0b3c1577b0 2023-09-30T13:58:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.949+0000 7f0b33fff640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 0x7f0b1c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:13.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.949+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0b34089ce0 con 0x7f0b3c1577b0 2023-09-30T13:58:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.950+0000 7f0b3affd640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 0x7f0b1c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.950+0000 7f0b3affd640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 0x7f0b1c06cff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:13.954+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0b34054e40 con 0x7f0b3c1577b0 2023-09-30T13:58:14.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.128+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b3c04e0d0 con 0x7f0b3c1577b0 2023-09-30T13:58:14.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.129+0000 7f0b33fff640 1 -- 172.21.15.62:0/919170705 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b34058460 con 0x7f0b3c1577b0 2023-09-30T13:58:14.129 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-09-30T13:58:14.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 msgr2=0x7f0b1c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 0x7f0b1c06cff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c008030 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 msgr2=0x7f0b3c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007e40 tx=0x7f0b3400e4b0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 shutdown_connections 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0b1c06ab30 0x7f0b1c06cff0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b3c1577b0 0x7f0b3c159e30 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b3c0cd960 0x7f0b3c1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 --2- 172.21.15.62:0/919170705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3c0b18a0 0x7f0b3c1f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 >> 172.21.15.62:0/919170705 conn(0x7f0b3c0d08e0 msgr2=0x7f0b3c0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 shutdown_connections 2023-09-30T13:58:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.131+0000 7f0b4157c640 1 -- 172.21.15.62:0/919170705 wait complete. 2023-09-30T13:58:14.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T13:58:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.250+0000 7f8d2c990640 1 Processor -- start 2023-09-30T13:58:14.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.250+0000 7f8d2c990640 1 -- start start 2023-09-30T13:58:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d280b2160 0x7f8d280b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d280b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8d280b4230 0x7f8d2815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2815afa0 con 0x7f8d280b2160 2023-09-30T13:58:14.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d280b0ef0 con 0x7f8d280b4230 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2c990640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2815b190 con 0x7f8d280b0a70 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d280b2160 0x7f8d280b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d280b2160 0x7f8d280b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52278/0 (socket says 172.21.15.62:52278) 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 -- 172.21.15.62:0/2441271883 learned_addr learned my addr 172.21.15.62:0/2441271883 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d26d9d640 1 --2- 172.21.15.62:0/2441271883 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b4230 0x7f8d2815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d25d9b640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d280b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 -- 172.21.15.62:0/2441271883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 msgr2=0x7f8d280b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d280b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 -- 172.21.15.62:0/2441271883 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b4230 msgr2=0x7f8d2815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 --2- 172.21.15.62:0/2441271883 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b4230 0x7f8d2815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d2659c640 1 -- 172.21.15.62:0/2441271883 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2815b470 con 0x7f8d280b2160 2023-09-30T13:58:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.251+0000 7f8d25d9b640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d280b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.252+0000 7f8d2659c640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280b0530 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ae2d0 tx=0x7f8d2002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab41969c110a1a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.252+0000 7f8d2559a640 1 -- 172.21.15.62:0/2441271883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2002ca80 con 0x7f8d280b2160 2023-09-30T13:58:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.252+0000 7f8d2559a640 1 -- 172.21.15.62:0/2441271883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8d2002cbe0 con 0x7f8d280b2160 2023-09-30T13:58:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.252+0000 7f8d2559a640 1 -- 172.21.15.62:0/2441271883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200343f0 con 0x7f8d280b2160 2023-09-30T13:58:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 -- 172.21.15.62:0/2441271883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 msgr2=0x7f8d280b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280b0530 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ae2d0 tx=0x7f8d2002bee0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 -- 172.21.15.62:0/2441271883 shutdown_connections 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 --2- 172.21.15.62:0/2441271883 >> v2:172.21.15.135:3300/0 conn(0x7f8d280b4230 0x7f8d2815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d280b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 --2- 172.21.15.62:0/2441271883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280b0530 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 -- 172.21.15.62:0/2441271883 >> 172.21.15.62:0/2441271883 conn(0x7f8d280cb720 msgr2=0x7f8d280ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 -- 172.21.15.62:0/2441271883 shutdown_connections 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.253+0000 7f8d2c990640 1 -- 172.21.15.62:0/2441271883 wait complete. 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.254+0000 7f8d2c990640 1 Processor -- start 2023-09-30T13:58:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.254+0000 7f8d2c990640 1 -- start start 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d281f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d280b4230 0x7f8d280af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280aceb0 con 0x7f8d280b2160 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280ac2a0 con 0x7f8d280b4230 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2c990640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280ac580 con 0x7f8d280b0a70 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52282/0 (socket says 172.21.15.62:52282) 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d25d9b640 1 -- 172.21.15.62:0/924820725 learned_addr learned my addr 172.21.15.62:0/924820725 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:14.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d26d9d640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d280b4230 0x7f8d280af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.255+0000 7f8d2659c640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d281f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 -- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 msgr2=0x7f8d281f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d281f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 -- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d280b4230 msgr2=0x7f8d280af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d280b4230 0x7f8d280af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 -- 172.21.15.62:0/924820725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009b30 con 0x7f8d280b2160 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d25d9b640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c7c0 tx=0x7f8d1c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c007a30 con 0x7f8d280b2160 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f8d1c007b90 con 0x7f8d280b2160 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d280ac860 con 0x7f8d280b2160 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00ce70 con 0x7f8d280b2160 2023-09-30T13:58:14.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.256+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d281f30c0 con 0x7f8d280b2160 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.257+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d280ad060 con 0x7f8d280b2160 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.257+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8d1c0113f0 con 0x7f8d280b2160 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.258+0000 7f8d16ffd640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 0x7f8d0806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.258+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f8d1c0894d0 con 0x7f8d280b2160 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.258+0000 7f8d2659c640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 0x7f8d0806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.258+0000 7f8d2659c640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 0x7f8d0806cff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ae2d0 tx=0x7f8d20030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.262+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8d280ad060 con 0x7f8d280b2160 2023-09-30T13:58:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.436+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d280ad060 con 0x7f8d280b2160 2023-09-30T13:58:14.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.436+0000 7f8d16ffd640 1 -- 172.21.15.62:0/924820725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d280ad060 con 0x7f8d280b2160 2023-09-30T13:58:14.436 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-09-30T13:58:14.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 msgr2=0x7f8d0806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 0x7f8d0806cff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ae2d0 tx=0x7f8d20030000 comp rx=0 tx=0).stop 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 msgr2=0x7f8d280ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00c7c0 tx=0x7f8d1c00cc80 comp rx=0 tx=0).stop 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 shutdown_connections 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8d0806ab30 0x7f8d0806cff0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d280b4230 0x7f8d280af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d280b2160 0x7f8d280ab8c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 --2- 172.21.15.62:0/924820725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8d280b0a70 0x7f8d281f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 >> 172.21.15.62:0/924820725 conn(0x7f8d280cb720 msgr2=0x7f8d280ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 shutdown_connections 2023-09-30T13:58:14.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.439+0000 7f8d2c990640 1 -- 172.21.15.62:0/924820725 wait complete. 2023-09-30T13:58:14.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:58:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.556+0000 7f467d7e2640 1 Processor -- start 2023-09-30T13:58:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.556+0000 7f467d7e2640 1 -- start start 2023-09-30T13:58:14.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f467d7e2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467815cbe0 0x7f46780d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f467d7e2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f46780d0d00 0x7f46780d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f467d7e2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46780d16a0 con 0x7f46780cd4e0 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f467d7e2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46780cfcf0 con 0x7f46780d0d00 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f467d7e2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780cf450 con 0x7f467815cbe0 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f46767fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f46780d0d00 0x7f46780d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f46777fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f46780cd4e0 0x7f46780cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56828/0 (socket says 172.21.15.62:56828) 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.557+0000 7f46777fe640 1 -- 172.21.15.62:0/2548093165 learned_addr learned my addr 172.21.15.62:0/2548093165 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f4676ffd640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467815cbe0 0x7f46780d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f46767fc640 1 -- 172.21.15.62:0/2548093165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467815cbe0 msgr2=0x7f46780d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f46767fc640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467815cbe0 0x7f46780d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f46767fc640 1 -- 172.21.15.62:0/2548093165 >> v1:172.21.15.62:6789/0 conn(0x7f46780cd4e0 legacy=0x7f46780cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f46767fc640 1 -- 172.21.15.62:0/2548093165 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46780cf730 con 0x7f46780d0d00 2023-09-30T13:58:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f4675ffb640 1 -- 172.21.15.62:0/2548093165 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972323197 0 0) 0x7f46780d16a0 con 0x7f46780cd4e0 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.558+0000 7f46767fc640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46780d0d00 0x7f46780d1160 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097a0 tx=0x7f466c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa2d8f1c81a5f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f4675ffb640 1 -- 172.21.15.62:0/2548093165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c030610 con 0x7f46780d0d00 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f4675ffb640 1 -- 172.21.15.62:0/2548093165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f466c030770 con 0x7f46780d0d00 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f4675ffb640 1 -- 172.21.15.62:0/2548093165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c030b00 con 0x7f46780d0d00 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 -- 172.21.15.62:0/2548093165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46780d0d00 msgr2=0x7f46780d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46780d0d00 0x7f46780d1160 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097a0 tx=0x7f466c02b960 comp rx=0 tx=0).stop 2023-09-30T13:58:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 -- 172.21.15.62:0/2548093165 shutdown_connections 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46780d0d00 0x7f46780d1160 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 --2- 172.21.15.62:0/2548093165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467815cbe0 0x7f46780d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 -- 172.21.15.62:0/2548093165 >> 172.21.15.62:0/2548093165 conn(0x7f4678089fe0 msgr2=0x7f46780d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 -- 172.21.15.62:0/2548093165 shutdown_connections 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.559+0000 7f467d7e2640 1 -- 172.21.15.62:0/2548093165 wait complete. 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.560+0000 7f467d7e2640 1 Processor -- start 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 -- start start 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 0x7f46780c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 0x7f46780b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b5890 con 0x7f467815cbe0 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b6290 con 0x7f46780cd4e0 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f467d7e2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b6570 con 0x7f46780d0d00 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f46777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f46777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52296/0 (socket says 172.21.15.62:52296) 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f46777fe640 1 -- 172.21.15.62:0/1408687003 learned_addr learned my addr 172.21.15.62:0/1408687003 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f46767fc640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 0x7f46780b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.561+0000 7f4676ffd640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 0x7f46780c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 -- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 msgr2=0x7f46780b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 0x7f46780b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 -- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 msgr2=0x7f46780c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 0x7f46780c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 -- 172.21.15.62:0/1408687003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009400 con 0x7f467815cbe0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46767fc640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 0x7f46780b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f4676ffd640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 0x7f46780c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f46777fe640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f466800c7e0 tx=0x7f466800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800a640 con 0x7f467815cbe0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f466800a7c0 con 0x7f467815cbe0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46780b6850 con 0x7f467815cbe0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800ab70 con 0x7f467815cbe0 2023-09-30T13:58:14.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.562+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46780c7370 con 0x7f467815cbe0 2023-09-30T13:58:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.563+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780c7560 con 0x7f467815cbe0 2023-09-30T13:58:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.563+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f466800acd0 con 0x7f467815cbe0 2023-09-30T13:58:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.564+0000 7f465f7fe640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 0x7f466406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.564+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f4668088be0 con 0x7f467815cbe0 2023-09-30T13:58:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.564+0000 7f4676ffd640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 0x7f466406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.565+0000 7f4676ffd640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 0x7f466406d020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.568+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4668053cb0 con 0x7f467815cbe0 2023-09-30T13:58:14.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.782+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467804e0d0 con 0x7f467815cbe0 2023-09-30T13:58:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.782+0000 7f465f7fe640 1 -- 172.21.15.62:0/1408687003 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f4668018020 con 0x7f467815cbe0 2023-09-30T13:58:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:14.782 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:58:05.796912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:58:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 msgr2=0x7f466406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 0x7f466406d020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670008040 comp rx=0 tx=0).stop 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 msgr2=0x7f4678159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f466800c7e0 tx=0x7f466800cca0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 shutdown_connections 2023-09-30T13:58:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f466406ab60 0x7f466406d020 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f467815cbe0 0x7f4678159840 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46780d0d00 0x7f46780b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 --2- 172.21.15.62:0/1408687003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46780cd4e0 0x7f46780c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 >> 172.21.15.62:0/1408687003 conn(0x7f4678089fe0 msgr2=0x7f467806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 shutdown_connections 2023-09-30T13:58:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.784+0000 7f467d7e2640 1 -- 172.21.15.62:0/1408687003 wait complete. 2023-09-30T13:58:14.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:14.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.901+0000 7f1409a09640 1 Processor -- start 2023-09-30T13:58:14.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.901+0000 7f1409a09640 1 -- start start 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1409a09640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14040cdc20 0x7f14040b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1409a09640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f14040cf140 0x7f14040ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1409a09640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040b2e50 con 0x7f14040b2940 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1409a09640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040ac2d0 con 0x7f14040cdc20 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1409a09640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040cc340 con 0x7f14040cf140 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14040cdc20 0x7f14040b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14040cdc20 0x7f14040b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52310/0 (socket says 172.21.15.62:52310) 2023-09-30T13:58:14.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 -- 172.21.15.62:0/2232322796 learned_addr learned my addr 172.21.15.62:0/2232322796 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:14.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 -- 172.21.15.62:0/2232322796 >> v2:172.21.15.135:3300/0 conn(0x7f14040cf140 msgr2=0x7f14040ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:14.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 --2- 172.21.15.62:0/2232322796 >> v2:172.21.15.135:3300/0 conn(0x7f14040cf140 0x7f14040ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 -- 172.21.15.62:0/2232322796 >> v1:172.21.15.135:6789/0 conn(0x7f14040b2940 legacy=0x7f14040cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:14.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.902+0000 7f1402ffd640 1 -- 172.21.15.62:0/2232322796 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040cc620 con 0x7f14040cdc20 2023-09-30T13:58:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.903+0000 7f1402ffd640 1 --2- 172.21.15.62:0/2232322796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040cdc20 0x7f14040b2400 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009ea0 tx=0x7f13fc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781ee85e09d908a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.903+0000 7f1401ffb640 1 -- 172.21.15.62:0/2232322796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc02ca30 con 0x7f14040cdc20 2023-09-30T13:58:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.903+0000 7f1401ffb640 1 -- 172.21.15.62:0/2232322796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f13fc02cb90 con 0x7f14040cdc20 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.903+0000 7f1401ffb640 1 -- 172.21.15.62:0/2232322796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0343f0 con 0x7f14040cdc20 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 -- 172.21.15.62:0/2232322796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040cdc20 msgr2=0x7f14040b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 --2- 172.21.15.62:0/2232322796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040cdc20 0x7f14040b2400 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009ea0 tx=0x7f13fc02be90 comp rx=0 tx=0).stop 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 -- 172.21.15.62:0/2232322796 shutdown_connections 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 --2- 172.21.15.62:0/2232322796 >> v2:172.21.15.135:3300/0 conn(0x7f14040cf140 0x7f14040ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 --2- 172.21.15.62:0/2232322796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040cdc20 0x7f14040b2400 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 -- 172.21.15.62:0/2232322796 >> 172.21.15.62:0/2232322796 conn(0x7f140406a170 msgr2=0x7f140406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 -- 172.21.15.62:0/2232322796 shutdown_connections 2023-09-30T13:58:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.904+0000 7f1409a09640 1 -- 172.21.15.62:0/2232322796 wait complete. 2023-09-30T13:58:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.905+0000 7f1409a09640 1 Processor -- start 2023-09-30T13:58:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.905+0000 7f1409a09640 1 -- start start 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14040cdc20 0x7f140415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 0x7f1404159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140415c3e0 con 0x7f14040b2940 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140415b860 con 0x7f14040cf140 2023-09-30T13:58:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140415bb40 con 0x7f14040cdc20 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52312/0 (socket says 172.21.15.62:52312) 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 -- 172.21.15.62:0/388302844 learned_addr learned my addr 172.21.15.62:0/388302844 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 -- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14040cdc20 msgr2=0x7f140415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14040cdc20 0x7f140415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f14037fe640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 0x7f1404159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 -- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 msgr2=0x7f1404159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 0x7f1404159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 -- 172.21.15.62:0/388302844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc009b30 con 0x7f14040b2940 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f14037fe640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 0x7f1404159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1402ffd640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f13fc02bed0 tx=0x7f13fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc03e450 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f13fc03e5f0 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc03e9a0 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.906+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140415be20 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.907+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140415b570 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.907+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140404e0d0 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.908+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f13fc03eb00 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.908+0000 7f13ebfff640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 0x7f13f006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.908+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f13fc0ac480 con 0x7f14040b2940 2023-09-30T13:58:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.909+0000 7f14027fc640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 0x7f13f006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.909+0000 7f14027fc640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 0x7f13f006cff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14041f1180 tx=0x7f13f8006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:14.913+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f13fc077570 con 0x7f14040b2940 2023-09-30T13:58:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.088+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14040b21e0 con 0x7f14040b2940 2023-09-30T13:58:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.089+0000 7f13ebfff640 1 -- 172.21.15.62:0/388302844 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f13fc03edb0 con 0x7f14040b2940 2023-09-30T13:58:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:15.090 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":54,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:32.771192+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.091+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 msgr2=0x7f13f006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.091+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 0x7f13f006cff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14041f1180 tx=0x7f13f8006ba0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.091+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 msgr2=0x7f14041f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.091+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f13fc02bed0 tx=0x7f13fc004a40 comp rx=0 tx=0).stop 2023-09-30T13:58:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 shutdown_connections 2023-09-30T13:58:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f13f006ab30 0x7f13f006cff0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14040cf140 0x7f1404159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f14040cdc20 0x7f140415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 --2- 172.21.15.62:0/388302844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14040b2940 0x7f14041f0c40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 >> 172.21.15.62:0/388302844 conn(0x7f140406a170 msgr2=0x7f1404070100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 shutdown_connections 2023-09-30T13:58:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.092+0000 7f1409a09640 1 -- 172.21.15.62:0/388302844 wait complete. 2023-09-30T13:58:15.102 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T13:58:15.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:58:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.209+0000 7f3a8e733640 1 Processor -- start 2023-09-30T13:58:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.209+0000 7f3a8e733640 1 -- start start 2023-09-30T13:58:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a880cea30 0x7f3a880cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a880b2730 0x7f3a880cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a8806be20 0x7f3a8806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880b23a0 con 0x7f3a880cea30 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880ce440 con 0x7f3a880b2730 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8e733640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88070260 con 0x7f3a8806be20 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a880cea30 0x7f3a880cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a880cea30 0x7f3a880cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52324/0 (socket says 172.21.15.62:52324) 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 -- 172.21.15.62:0/2232923878 learned_addr learned my addr 172.21.15.62:0/2232923878 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a8ccd0640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a8806be20 0x7f3a8806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a877fe640 1 --2- 172.21.15.62:0/2232923878 >> v2:172.21.15.135:3300/0 conn(0x7f3a880b2730 0x7f3a880cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 -- 172.21.15.62:0/2232923878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a8806be20 msgr2=0x7f3a8806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a8806be20 0x7f3a8806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.210+0000 7f3a87fff640 1 -- 172.21.15.62:0/2232923878 >> v2:172.21.15.135:3300/0 conn(0x7f3a880b2730 msgr2=0x7f3a880cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a87fff640 1 --2- 172.21.15.62:0/2232923878 >> v2:172.21.15.135:3300/0 conn(0x7f3a880b2730 0x7f3a880cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a87fff640 1 -- 172.21.15.62:0/2232923878 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880cf350 con 0x7f3a880cea30 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a87fff640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a880cea30 0x7f3a880cee10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b2df0 tx=0x7f3a7c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31afb94bc89e2a3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a86ffd640 1 -- 172.21.15.62:0/2232923878 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c004230 con 0x7f3a880cea30 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a86ffd640 1 -- 172.21.15.62:0/2232923878 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f3a7c004390 con 0x7f3a880cea30 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.211+0000 7f3a86ffd640 1 -- 172.21.15.62:0/2232923878 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c003810 con 0x7f3a880cea30 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 -- 172.21.15.62:0/2232923878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a880cea30 msgr2=0x7f3a880cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a880cea30 0x7f3a880cee10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b2df0 tx=0x7f3a7c02b860 comp rx=0 tx=0).stop 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 -- 172.21.15.62:0/2232923878 shutdown_connections 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a8806be20 0x7f3a8806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 --2- 172.21.15.62:0/2232923878 >> v2:172.21.15.135:3300/0 conn(0x7f3a880b2730 0x7f3a880cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 --2- 172.21.15.62:0/2232923878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a880cea30 0x7f3a880cee10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 -- 172.21.15.62:0/2232923878 >> 172.21.15.62:0/2232923878 conn(0x7f3a8806a170 msgr2=0x7f3a8806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 -- 172.21.15.62:0/2232923878 shutdown_connections 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.212+0000 7f3a8e733640 1 -- 172.21.15.62:0/2232923878 wait complete. 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.213+0000 7f3a8e733640 1 Processor -- start 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.213+0000 7f3a8e733640 1 -- start start 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a880b2730 0x7f3a881f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a880cea30 0x7f3a88157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881f1c50 con 0x7f3a8806be20 2023-09-30T13:58:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881f61e0 con 0x7f3a880cea30 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8e733640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88157aa0 con 0x7f3a880b2730 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52336/0 (socket says 172.21.15.62:52336) 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a87fff640 1 -- 172.21.15.62:0/4260469725 learned_addr learned my addr 172.21.15.62:0/4260469725 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a87fff640 1 -- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a880b2730 msgr2=0x7f3a881f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a8ccd0640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a880cea30 0x7f3a88157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.214+0000 7f3a87fff640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a880b2730 0x7f3a881f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a87fff640 1 -- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a880cea30 msgr2=0x7f3a88157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a87fff640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a880cea30 0x7f3a88157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a87fff640 1 -- 172.21.15.62:0/4260469725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009460 con 0x7f3a8806be20 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a87fff640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c02b8a0 tx=0x7f3a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c003e50 con 0x7f3a8806be20 2023-09-30T13:58:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f3a7c004500 con 0x7f3a8806be20 2023-09-30T13:58:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a881f5940 con 0x7f3a8806be20 2023-09-30T13:58:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c006280 con 0x7f3a8806be20 2023-09-30T13:58:15.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.215+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a881f5f00 con 0x7f3a8806be20 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.216+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8804e0d0 con 0x7f3a8806be20 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.216+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3a7c0063e0 con 0x7f3a8806be20 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.217+0000 7f3a84ff9640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 0x7f3a7406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.217+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f3a7c0ab830 con 0x7f3a8806be20 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.217+0000 7f3a877fe640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 0x7f3a7406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.218+0000 7f3a877fe640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 0x7f3a7406cff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a881f51a0 tx=0x7f3a78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.221+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3a7c076990 con 0x7f3a8806be20 2023-09-30T13:58:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.436+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a880add80 con 0x7f3a8806be20 2023-09-30T13:58:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.437+0000 7f3a84ff9640 1 -- 172.21.15.62:0/4260469725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f3a7c042090 con 0x7f3a8806be20 2023-09-30T13:58:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:15.436 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:58:05.796912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:58:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 msgr2=0x7f3a7406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 0x7f3a7406cff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3a881f51a0 tx=0x7f3a78008040 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 msgr2=0x7f3a88097a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c02b8a0 tx=0x7f3a7c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 shutdown_connections 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3a7406ab30 0x7f3a7406cff0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a880cea30 0x7f3a88157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a880b2730 0x7f3a881f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 --2- 172.21.15.62:0/4260469725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a8806be20 0x7f3a88097a90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 >> 172.21.15.62:0/4260469725 conn(0x7f3a8806a170 msgr2=0x7f3a88070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 shutdown_connections 2023-09-30T13:58:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.439+0000 7f3a8e733640 1 -- 172.21.15.62:0/4260469725 wait complete. 2023-09-30T13:58:15.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.557+0000 7f36b09b0640 1 Processor -- start 2023-09-30T13:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.557+0000 7f36b09b0640 1 -- start start 2023-09-30T13:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36b09b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36ac0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36b09b0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac06ca80 con 0x7f36ac15dfe0 2023-09-30T13:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36b09b0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac06cd60 con 0x7f36ac0ad730 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36b09b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac06d700 con 0x7f36ac0adbc0 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36aa59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f36ac15dfe0 0x7f36ac0b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56842/0 (socket says 172.21.15.62:56842) 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36aa59c640 1 -- 172.21.15.62:0/4261802879 learned_addr learned my addr 172.21.15.62:0/4261802879 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600788534 0 0) 0x7f36ac06ca80 con 0x7f36ac15dfe0 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36aad9d640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36ac0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.558+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3694003520 con 0x7f36ac15dfe0 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233970344 0 0) 0x7f3694003520 con 0x7f36ac15dfe0 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 msgr2=0x7f36ac0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36ac0b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 >> v1:172.21.15.135:6789/0 conn(0x7f36ac0ad730 legacy=0x7f36ac0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac06d040 con 0x7f36ac15dfe0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f369c001690 con 0x7f36ac15dfe0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 >> v1:172.21.15.62:6789/0 conn(0x7f36ac15dfe0 legacy=0x7f36ac0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940039a0 0x7f3694003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3694004d00 0x7f3694005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac06d700 con 0x7f36940039a0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369400ba30 con 0x7f3694004d00 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369400bbf0 con 0x7f36ac0adbc0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940039a0 0x7f3694003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aad9d640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3694004d00 0x7f3694005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a9d9b640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 -- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 msgr2=0x7f36940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 -- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3694004d00 msgr2=0x7f3694005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3694004d00 0x7f3694005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36aa59c640 1 -- 172.21.15.62:0/4261802879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694003520 con 0x7f36940039a0 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.559+0000 7f36a9d9b640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36ac0adbc0 0x7f36940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36aa59c640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940039a0 0x7f3694003dc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f369c001eb0 tx=0x7f36940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9658f0d8f920dc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c005ad0 con 0x7f36940039a0 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f369c005c30 con 0x7f36940039a0 2023-09-30T13:58:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36a959a640 1 -- 172.21.15.62:0/4261802879 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c02c890 con 0x7f36940039a0 2023-09-30T13:58:15.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36b09b0640 1 -- 172.21.15.62:0/4261802879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940039a0 msgr2=0x7f3694003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36b09b0640 1 --2- 172.21.15.62:0/4261802879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36940039a0 0x7f3694003dc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f369c001eb0 tx=0x7f36940057f0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.560+0000 7f36aad9d640 1 -- 172.21.15.62:0/4261802879 reap_dead start 2023-09-30T13:58:15.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.561+0000 7f36b09b0640 1 -- 172.21.15.62:0/4261802879 shutdown_connections 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.561+0000 7f36b09b0640 1 -- 172.21.15.62:0/4261802879 >> 172.21.15.62:0/4261802879 conn(0x7f36ac0cb3d0 msgr2=0x7f36ac0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.561+0000 7f36b09b0640 1 -- 172.21.15.62:0/4261802879 shutdown_connections 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.561+0000 7f36b09b0640 1 -- 172.21.15.62:0/4261802879 wait complete. 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.562+0000 7f36b09b0640 1 Processor -- start 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.562+0000 7f36b09b0640 1 -- start start 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36940039a0 0x7f36ac1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ac15be20 0x7f36ac15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac15c7e0 con 0x7f36ac0b2820 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0b3940 con 0x7f36ac15be20 2023-09-30T13:58:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac153f70 con 0x7f36940039a0 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52362/0 (socket says 172.21.15.62:52362) 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 -- 172.21.15.62:0/2688003656 learned_addr learned my addr 172.21.15.62:0/2688003656 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 -- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36940039a0 msgr2=0x7f36ac1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36940039a0 0x7f36ac1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36aad9d640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ac15be20 0x7f36ac15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 -- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ac15be20 msgr2=0x7f36ac15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ac15be20 0x7f36ac15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 -- 172.21.15.62:0/2688003656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac155620 con 0x7f36ac0b2820 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36a9d9b640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e580 tx=0x7f36a000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00052e0 con 0x7f36ac0b2820 2023-09-30T13:58:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f36a0005440 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0b3b90 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0003830 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.563+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac0b4150 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.564+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac04e0d0 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.565+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f36a0003990 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.565+0000 7f369affd640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 0x7f368c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.565+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f36a0089140 con 0x7f36ac0b2820 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.566+0000 7f36aa59c640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 0x7f368c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.566+0000 7f36aa59c640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 0x7f368c06cff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f369c001eb0 tx=0x7f369c039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.570+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f36a0054220 con 0x7f36ac0b2820 2023-09-30T13:58:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.785+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36ac15d3b0 con 0x7f36ac0b2820 2023-09-30T13:58:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.786+0000 7f369affd640 1 -- 172.21.15.62:0/2688003656 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4914 (secure 0 0 0) 0x7f36a0057840 con 0x7f36ac0b2820 2023-09-30T13:58:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:15.786 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T13:57:21.122438+0000","modified":"2023-09-30T13:58:05.796912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6836/126973186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":126973186},{"type":"v1","addr":"172.21.15.135:6836","nonce":126973186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-09-30T13:58:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2023-09-30T13:58:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 msgr2=0x7f368c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 0x7f368c06cff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f369c001eb0 tx=0x7f369c039040 comp rx=0 tx=0).stop 2023-09-30T13:58:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 msgr2=0x7f36ac0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e580 tx=0x7f36a000ea40 comp rx=0 tx=0).stop 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 shutdown_connections 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f368c06ab30 0x7f368c06cff0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36ac15be20 0x7f36ac15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36ac0b2820 0x7f36ac0b2ca0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 --2- 172.21.15.62:0/2688003656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36940039a0 0x7f36ac1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.787+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 >> 172.21.15.62:0/2688003656 conn(0x7f36ac0cb3d0 msgr2=0x7f36ac0c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.788+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 shutdown_connections 2023-09-30T13:58:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.788+0000 7f36b09b0640 1 -- 172.21.15.62:0/2688003656 wait complete. 2023-09-30T13:58:15.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:15.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.904+0000 7f675f901640 1 Processor -- start 2023-09-30T13:58:15.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.904+0000 7f675f901640 1 -- start start 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675f901640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67581598c0 0x7f67580ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675f901640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f67580ceea0 0x7f675815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675f901640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67580b1e20 con 0x7f67580cea30 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675f901640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67580b1530 con 0x7f67581598c0 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675f901640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67580b17d0 con 0x7f67580ceea0 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67581598c0 0x7f67580ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67581598c0 0x7f67580ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52364/0 (socket says 172.21.15.62:52364) 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 -- 172.21.15.62:0/2503176697 learned_addr learned my addr 172.21.15.62:0/2503176697 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675de9e640 1 --2- 172.21.15.62:0/2503176697 >> v2:172.21.15.135:3300/0 conn(0x7f67580ceea0 0x7f675815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 -- 172.21.15.62:0/2503176697 >> v2:172.21.15.135:3300/0 conn(0x7f67580ceea0 msgr2=0x7f675815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 --2- 172.21.15.62:0/2503176697 >> v2:172.21.15.135:3300/0 conn(0x7f67580ceea0 0x7f675815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 -- 172.21.15.62:0/2503176697 >> v1:172.21.15.135:6789/0 conn(0x7f67580cea30 legacy=0x7f675815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.905+0000 7f675d69d640 1 -- 172.21.15.62:0/2503176697 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580b1ab0 con 0x7f67581598c0 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.906+0000 7f675d69d640 1 --2- 172.21.15.62:0/2503176697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67581598c0 0x7f67580ccc20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6750009850 tx=0x7f675002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a1c63773357140 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.906+0000 7f6757fff640 1 -- 172.21.15.62:0/2503176697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750004230 con 0x7f67581598c0 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.906+0000 7f6757fff640 1 -- 172.21.15.62:0/2503176697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f6750004390 con 0x7f67581598c0 2023-09-30T13:58:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.906+0000 7f6757fff640 1 -- 172.21.15.62:0/2503176697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750030840 con 0x7f67581598c0 2023-09-30T13:58:15.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 -- 172.21.15.62:0/2503176697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67581598c0 msgr2=0x7f67580ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 --2- 172.21.15.62:0/2503176697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67581598c0 0x7f67580ccc20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6750009850 tx=0x7f675002b980 comp rx=0 tx=0).stop 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 -- 172.21.15.62:0/2503176697 shutdown_connections 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 --2- 172.21.15.62:0/2503176697 >> v2:172.21.15.135:3300/0 conn(0x7f67580ceea0 0x7f675815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 --2- 172.21.15.62:0/2503176697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67581598c0 0x7f67580ccc20 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 -- 172.21.15.62:0/2503176697 >> 172.21.15.62:0/2503176697 conn(0x7f675806a170 msgr2=0x7f675806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 -- 172.21.15.62:0/2503176697 shutdown_connections 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.907+0000 7f675f901640 1 -- 172.21.15.62:0/2503176697 wait complete. 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.908+0000 7f675f901640 1 Processor -- start 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.908+0000 7f675f901640 1 -- start start 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 0x7f6758155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67581598c0 0x7f67581efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581562d0 con 0x7f67580cea30 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580cb700 con 0x7f67581598c0 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675f901640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67580cb9e0 con 0x7f67580ceea0 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52372/0 (socket says 172.21.15.62:52372) 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 -- 172.21.15.62:0/2392623488 learned_addr learned my addr 172.21.15.62:0/2392623488 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675de9e640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67581598c0 0x7f67581efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675ce9c640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 0x7f6758155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 -- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 msgr2=0x7f6758155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 0x7f6758155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 -- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67581598c0 msgr2=0x7f67581efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67581598c0 0x7f67581efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675d69d640 1 -- 172.21.15.62:0/2392623488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009460 con 0x7f67580cea30 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.909+0000 7f675ce9c640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 0x7f6758155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f675d69d640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f675002b9c0 tx=0x7f67500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675003e070 con 0x7f67580cea30 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f6750004500 con 0x7f67580cea30 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67580cbcc0 con 0x7f67580cea30 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750030e60 con 0x7f67580cea30 2023-09-30T13:58:15.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.910+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67581f0290 con 0x7f67580cea30 2023-09-30T13:58:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.911+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675804e0d0 con 0x7f67580cea30 2023-09-30T13:58:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.911+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6750003610 con 0x7f67580cea30 2023-09-30T13:58:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.912+0000 7f6755ffb640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 0x7f674406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.912+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f67500ab230 con 0x7f67580cea30 2023-09-30T13:58:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.912+0000 7f675ce9c640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 0x7f674406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.912+0000 7f675ce9c640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 0x7f674406cff0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f674c007fd0 tx=0x7f674c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:15.916+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6750076320 con 0x7f67580cea30 2023-09-30T13:58:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.091+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67580b3410 con 0x7f67580cea30 2023-09-30T13:58:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.092+0000 7f6755ffb640 1 -- 172.21.15.62:0/2392623488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f6750079940 con 0x7f67580cea30 2023-09-30T13:58:16.092 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:16.092 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":54,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:57:32.771192+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-09-30T13:57:19.089309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-09-30T13:57:20.102791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 msgr2=0x7f674406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 0x7f674406cff0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f674c007fd0 tx=0x7f674c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 msgr2=0x7f67580c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f675002b9c0 tx=0x7f67500046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 shutdown_connections 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f674406ab30 0x7f674406cff0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67581598c0 0x7f67581efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67580ceea0 0x7f6758155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 --2- 172.21.15.62:0/2392623488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67580cea30 0x7f67580c4b80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.094+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 >> 172.21.15.62:0/2392623488 conn(0x7f675806a170 msgr2=0x7f67580b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.095+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 shutdown_connections 2023-09-30T13:58:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.095+0000 7f675f901640 1 -- 172.21.15.62:0/2392623488 wait complete. 2023-09-30T13:58:16.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T13:58:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.213+0000 7fb8bbc34640 1 Processor -- start 2023-09-30T13:58:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.213+0000 7fb8bbc34640 1 -- start start 2023-09-30T13:58:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8bbc34640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb8b4071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8bbc34640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8b40ca9d0 0x7fb8b40aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8bbc34640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4159c50 con 0x7fb8b40b04a0 2023-09-30T13:58:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8bbc34640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b40b0930 con 0x7fb8b40ca9d0 2023-09-30T13:58:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8bbc34640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40cc0b0 con 0x7fb8b4159870 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8ba1d1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8b40b04a0 0x7fb8b40c8b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56848/0 (socket says 172.21.15.62:56848) 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8ba1d1640 1 -- 172.21.15.62:0/1647443839 learned_addr learned my addr 172.21.15.62:0/1647443839 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8b91cf640 1 --2- 172.21.15.62:0/1647443839 >> v2:172.21.15.135:3300/0 conn(0x7fb8b40ca9d0 0x7fb8b40aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568551202 0 0) 0x7fb8b4159c50 con 0x7fb8b40b04a0 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c003520 con 0x7fb8b40b04a0 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.214+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb8b4071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554911725 0 0) 0x7fb89c003520 con 0x7fb8b40b04a0 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 msgr2=0x7fb8b4071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb8b4071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 >> v2:172.21.15.135:3300/0 conn(0x7fb8b40ca9d0 msgr2=0x7fb8b40aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 --2- 172.21.15.62:0/1647443839 >> v2:172.21.15.135:3300/0 conn(0x7fb8b40ca9d0 0x7fb8b40aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4071c40 con 0x7fb8b40b04a0 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7fb8a40019f0 con 0x7fb8b40b04a0 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 >> v1:172.21.15.62:6789/0 conn(0x7fb8b40b04a0 legacy=0x7fb8b40c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb89c003970 0x7fb89c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb89c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb89c004d00 0x7fb89c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b0930 con 0x7fb89c003970 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40cc0b0 con 0x7fb89c004d00 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c00b980 con 0x7fb8b4159870 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb89c003970 0x7fb89c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b91cf640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb89c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8ba1d1640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb89c004d00 0x7fb89c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 -- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 msgr2=0x7fb89c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8b4159870 0x7fb89c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 -- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb89c004d00 msgr2=0x7fb89c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb89c004d00 0x7fb89c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.215+0000 7fb8b99d0640 1 -- 172.21.15.62:0/1647443839 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c003520 con 0x7fb89c003970 2023-09-30T13:58:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.216+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb89c003970 0x7fb89c003d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009ac0 tx=0x7fb89c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e09d543b7122ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.216+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac02c6b0 con 0x7fb89c003970 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.216+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb8ac02c810 con 0x7fb89c003970 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.216+0000 7fb8b89ce640 1 -- 172.21.15.62:0/1647443839 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac02cba0 con 0x7fb89c003970 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1647443839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb89c003970 msgr2=0x7fb89c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1647443839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb89c003970 0x7fb89c003d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009ac0 tx=0x7fb89c0057f0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8ba1d1640 1 -- 172.21.15.62:0/1647443839 reap_dead start 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1647443839 shutdown_connections 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1647443839 >> 172.21.15.62:0/1647443839 conn(0x7fb8b406a430 msgr2=0x7fb8b406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1647443839 shutdown_connections 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.217+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1647443839 wait complete. 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.218+0000 7fb8bbc34640 1 Processor -- start 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.218+0000 7fb8bbc34640 1 -- start start 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb89c003970 0x7fb8b414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 0x7fb8b41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c8070 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c6a40 con 0x7fb8b414d310 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8bbc34640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c5e30 con 0x7fb89c003970 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52396/0 (socket says 172.21.15.62:52396) 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 -- 172.21.15.62:0/1023448173 learned_addr learned my addr 172.21.15.62:0/1023448173 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb89c003970 0x7fb8b414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8ba1d1640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 0x7fb8b41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 -- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb89c003970 msgr2=0x7fb8b414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb89c003970 0x7fb8b414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 -- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 msgr2=0x7fb8b41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 0x7fb8b41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 -- 172.21.15.62:0/1023448173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40c6110 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8ba1d1640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 0x7fb8b41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b91cf640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011a70 tx=0x7fb8a8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8009680 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb8a800fb50 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.219+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800fee0 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.220+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40c63f0 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.220+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40c5ae0 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.221+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b4073e70 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.221+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb8a8014440 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.221+0000 7fb8b27fc640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 0x7fb8a006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.221+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb8a8089c00 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.222+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 0x7fb8a006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.222+0000 7fb8b99d0640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 0x7fb8a006cff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009ac0 tx=0x7fb8ac030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.226+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb8a8090080 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.436+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8b414fd90 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.436 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-09-30T13:58:16.437+0000 7f9b7f1be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T13:58:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.439+0000 7fb8b27fc640 1 -- 172.21.15.62:0/1023448173 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8a8022070 con 0x7fb8b40c6ed0 2023-09-30T13:58:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T13:58:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 msgr2=0x7fb8a006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 0x7fb8a006cff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009ac0 tx=0x7fb8ac030000 comp rx=0 tx=0).stop 2023-09-30T13:58:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 msgr2=0x7fb8b414c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011a70 tx=0x7fb8a8011f30 comp rx=0 tx=0).stop 2023-09-30T13:58:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 shutdown_connections 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb8a006ab30 0x7fb8a006cff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b414d310 0x7fb8b41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8b40c6ed0 0x7fb8b414c9f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 --2- 172.21.15.62:0/1023448173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb89c003970 0x7fb8b414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.441+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 >> 172.21.15.62:0/1023448173 conn(0x7fb8b406a430 msgr2=0x7fb8b40c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.442+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 shutdown_connections 2023-09-30T13:58:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.442+0000 7fb8bbc34640 1 -- 172.21.15.62:0/1023448173 wait complete. 2023-09-30T13:58:16.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T13:58:16.482 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-09-30T13:58:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.563+0000 7fe80a4d7640 1 Processor -- start 2023-09-30T13:58:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.563+0000 7fe80a4d7640 1 -- start start 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe80a4d7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe80415cb00 0x7fe804071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe80a4d7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80406d740 con 0x7fe80415cee0 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe80a4d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80406da20 con 0x7fe8040ae300 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe80a4d7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80406dd00 con 0x7fe80415cb00 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe8037fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe80415cee0 0x7fe8040c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56852/0 (socket says 172.21.15.62:56852) 2023-09-30T13:58:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe8037fe640 1 -- 172.21.15.62:0/3790418826 learned_addr learned my addr 172.21.15.62:0/3790418826 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe803fff640 1 --2- 172.21.15.62:0/3790418826 >> v2:172.21.15.135:3300/0 conn(0x7fe80415cb00 0x7fe804071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe802ffd640 1 -- 172.21.15.62:0/3790418826 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314450866 0 0) 0x7fe80406d740 con 0x7fe80415cee0 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.564+0000 7fe802ffd640 1 -- 172.21.15.62:0/3790418826 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ec003520 con 0x7fe80415cee0 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.565+0000 7fe803fff640 1 -- 172.21.15.62:0/3790418826 >> v1:172.21.15.135:6789/0 conn(0x7fe8040ae300 legacy=0x7fe80406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.565+0000 7fe803fff640 1 -- 172.21.15.62:0/3790418826 >> v1:172.21.15.62:6789/0 conn(0x7fe80415cee0 legacy=0x7fe8040c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.565+0000 7fe803fff640 1 -- 172.21.15.62:0/3790418826 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80406dfe0 con 0x7fe80415cb00 2023-09-30T13:58:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.565+0000 7fe803fff640 1 --2- 172.21.15.62:0/3790418826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cb00 0x7fe804071860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097a0 tx=0x7fe7f802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0dd83b17a6faf03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe802ffd640 1 -- 172.21.15.62:0/3790418826 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8030610 con 0x7fe80415cb00 2023-09-30T13:58:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe802ffd640 1 -- 172.21.15.62:0/3790418826 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe7f8030770 con 0x7fe80415cb00 2023-09-30T13:58:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe802ffd640 1 -- 172.21.15.62:0/3790418826 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8030b00 con 0x7fe80415cb00 2023-09-30T13:58:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 -- 172.21.15.62:0/3790418826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cb00 msgr2=0x7fe804071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/3790418826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cb00 0x7fe804071860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097a0 tx=0x7fe7f802b960 comp rx=0 tx=0).stop 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 -- 172.21.15.62:0/3790418826 shutdown_connections 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/3790418826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cb00 0x7fe804071860 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 -- 172.21.15.62:0/3790418826 >> 172.21.15.62:0/3790418826 conn(0x7fe804070970 msgr2=0x7fe804070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 -- 172.21.15.62:0/3790418826 shutdown_connections 2023-09-30T13:58:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.566+0000 7fe80a4d7640 1 -- 172.21.15.62:0/3790418826 wait complete. 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.567+0000 7fe80a4d7640 1 Processor -- start 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 -- start start 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 0x7fe8040c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 0x7fe80415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041f2250 con 0x7fe8040ae300 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040b1ac0 con 0x7fe80415cee0 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe80a4d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe804160250 con 0x7fe80415cb00 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe803fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe803fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52408/0 (socket says 172.21.15.62:52408) 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.568+0000 7fe803fff640 1 -- 172.21.15.62:0/395490110 learned_addr learned my addr 172.21.15.62:0/395490110 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe8037fe640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 0x7fe8040c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe808a74640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 0x7fe80415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 -- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 msgr2=0x7fe8040c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 0x7fe8040c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 -- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 msgr2=0x7fe80415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 0x7fe80415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 -- 172.21.15.62:0/395490110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8009400 con 0x7fe8040ae300 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe8037fe640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 0x7fe8040c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe808a74640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 0x7fe80415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe803fff640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80098c0 tx=0x7fe7f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f803e040 con 0x7fe8040ae300 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fe7f8039cb0 con 0x7fe8040ae300 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80415fc90 con 0x7fe8040ae300 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8044630 con 0x7fe8040ae300 2023-09-30T13:58:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.569+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8040c5fe0 con 0x7fe8040ae300 2023-09-30T13:58:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.570+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8040666d0 con 0x7fe8040ae300 2023-09-30T13:58:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.571+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe7f8044790 con 0x7fe8040ae300 2023-09-30T13:58:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.571+0000 7fe800ff9640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 0x7fe7f006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.571+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fe7f80ab830 con 0x7fe8040ae300 2023-09-30T13:58:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.571+0000 7fe8037fe640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 0x7fe7f006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.572+0000 7fe8037fe640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 0x7fe7f006cff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe80415bfd0 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:16.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.575+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe7f80768b0 con 0x7fe8040ae300 2023-09-30T13:58:16.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:16.796+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe80404e0d0 con 0x7fe8040ae300 2023-09-30T13:58:17.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.440+0000 7fe800ff9640 1 -- 172.21.15.62:0/395490110 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe7f8079ed0 con 0x7fe8040ae300 2023-09-30T13:58:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 msgr2=0x7fe7f006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 0x7fe7f006cff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe80415bfd0 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2023-09-30T13:58:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 msgr2=0x7fe80414fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80098c0 tx=0x7fe7f8004730 comp rx=0 tx=0).stop 2023-09-30T13:58:17.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 shutdown_connections 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe7f006ab30 0x7fe7f006cff0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe80415cee0 0x7fe80415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe80415cb00 0x7fe8040c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 --2- 172.21.15.62:0/395490110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8040ae300 0x7fe80414fed0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 >> 172.21.15.62:0/395490110 conn(0x7fe804070970 msgr2=0x7fe804069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 shutdown_connections 2023-09-30T13:58:17.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.443+0000 7fe80a4d7640 1 -- 172.21.15.62:0/395490110 wait complete. 2023-09-30T13:58:17.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T13:58:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.573+0000 7f0be74d4640 1 Processor -- start 2023-09-30T13:58:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 -- start start 2023-09-30T13:58:17.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0be00b20c0 0x7f0be00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0be00cf970 0x7f0be00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be00d31a0 con 0x7f0be015cca0 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be00cda90 con 0x7f0be00b20c0 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.574+0000 7f0be74d4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be00d0340 con 0x7f0be00cf970 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0be00b20c0 0x7f0be00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0be00b20c0 0x7f0be00d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50250/0 (socket says 172.21.15.62:50250) 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 -- 172.21.15.62:0/2209978116 learned_addr learned my addr 172.21.15.62:0/2209978116 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be5a71640 1 --2- 172.21.15.62:0/2209978116 >> v2:172.21.15.135:3300/0 conn(0x7f0be00cf970 0x7f0be00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 -- 172.21.15.62:0/2209978116 >> v2:172.21.15.135:3300/0 conn(0x7f0be00cf970 msgr2=0x7f0be00cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 --2- 172.21.15.62:0/2209978116 >> v2:172.21.15.135:3300/0 conn(0x7f0be00cf970 0x7f0be00cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 -- 172.21.15.62:0/2209978116 >> v1:172.21.15.135:6789/0 conn(0x7f0be015cca0 legacy=0x7f0be00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:17.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.575+0000 7f0be4a6f640 1 -- 172.21.15.62:0/2209978116 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00cdf60 con 0x7f0be00b20c0 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0be4a6f640 1 --2- 172.21.15.62:0/2209978116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00b20c0 0x7f0be00d3630 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0be00d1cb0 tx=0x7f0bd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642de681f23ad695 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0bdffff640 1 -- 172.21.15.62:0/2209978116 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4031870 con 0x7f0be00b20c0 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0bdffff640 1 -- 172.21.15.62:0/2209978116 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0bd40319d0 con 0x7f0be00b20c0 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0bdffff640 1 -- 172.21.15.62:0/2209978116 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4031d60 con 0x7f0be00b20c0 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0be74d4640 1 -- 172.21.15.62:0/2209978116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00b20c0 msgr2=0x7f0be00d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.576+0000 7f0be74d4640 1 --2- 172.21.15.62:0/2209978116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00b20c0 0x7f0be00d3630 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0be00d1cb0 tx=0x7f0bd402b910 comp rx=0 tx=0).stop 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 -- 172.21.15.62:0/2209978116 shutdown_connections 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 --2- 172.21.15.62:0/2209978116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00b20c0 0x7f0be00d3630 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 --2- 172.21.15.62:0/2209978116 >> v2:172.21.15.135:3300/0 conn(0x7f0be00cf970 0x7f0be00cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 -- 172.21.15.62:0/2209978116 >> 172.21.15.62:0/2209978116 conn(0x7f0be0071660 msgr2=0x7f0be0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:17.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 -- 172.21.15.62:0/2209978116 shutdown_connections 2023-09-30T13:58:17.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.577+0000 7f0be74d4640 1 -- 172.21.15.62:0/2209978116 wait complete. 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.578+0000 7f0be74d4640 1 Processor -- start 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.578+0000 7f0be74d4640 1 -- start start 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 0x7f0be00c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0be015cca0 0x7f0be0152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00c77b0 con 0x7f0be00cf970 2023-09-30T13:58:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0152e80 con 0x7f0be00b20c0 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00c6c30 con 0x7f0be015cca0 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50266/0 (socket says 172.21.15.62:50266) 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 -- 172.21.15.62:0/251978327 learned_addr learned my addr 172.21.15.62:0/251978327 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be5270640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 0x7f0be00c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be5a71640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0be015cca0 0x7f0be0152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 -- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0be015cca0 msgr2=0x7f0be0152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0be015cca0 0x7f0be0152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 -- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 msgr2=0x7f0be00c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 0x7f0be00c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 -- 172.21.15.62:0/251978327 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40094d0 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be5270640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 0x7f0be00c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be4a6f640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0bd402b950 tx=0x7f0bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4031810 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f0bd40443f0 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be00c6f10 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.579+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40447a0 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.580+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be00c74d0 con 0x7f0be00cf970 2023-09-30T13:58:17.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.580+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be0073e70 con 0x7f0be00cf970 2023-09-30T13:58:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.581+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0bd4044900 con 0x7f0be00cf970 2023-09-30T13:58:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.581+0000 7f0bddffb640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 0x7f0bcc06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.581+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f0bd402d040 con 0x7f0be00cf970 2023-09-30T13:58:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.582+0000 7f0be5270640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 0x7f0bcc06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:17.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.582+0000 7f0be5270640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 0x7f0bcc06d020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0be01f5470 tx=0x7f0bd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.586+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0bd4076b00 con 0x7f0be00cf970 2023-09-30T13:58:17.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:17.763+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0be00d3530 con 0x7f0be00cf970 2023-09-30T13:58:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.545+0000 7f0bddffb640 1 -- 172.21.15.62:0/251978327 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0bd407a120 con 0x7f0be00cf970 2023-09-30T13:58:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 msgr2=0x7f0bcc06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 0x7f0bcc06d020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0be01f5470 tx=0x7f0bd0009040 comp rx=0 tx=0).stop 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 msgr2=0x7f0be00b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0bd402b950 tx=0x7f0bd40046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 shutdown_connections 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f0bcc06ab60 0x7f0bcc06d020 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0be015cca0 0x7f0be0152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0be00cf970 0x7f0be00b7dc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 --2- 172.21.15.62:0/251978327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be00b20c0 0x7f0be00c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.550+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 >> 172.21.15.62:0/251978327 conn(0x7f0be0071660 msgr2=0x7f0be00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.551+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 shutdown_connections 2023-09-30T13:58:18.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.551+0000 7f0be74d4640 1 -- 172.21.15.62:0/251978327 wait complete. 2023-09-30T13:58:18.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T13:58:18.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 Processor -- start 2023-09-30T13:58:18.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 -- start start 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb77415cca0 0x7fb7740d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7740b20c0 0x7fb7740cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7740cf970 0x7fb7740cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740d0340 con 0x7fb7740cf970 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740d31a0 con 0x7fb77415cca0 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.683+0000 7fb7792bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cdf60 con 0x7fb7740b20c0 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7740cf970 0x7fb7740cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7740cf970 0x7fb7740cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50270/0 (socket says 172.21.15.62:50270) 2023-09-30T13:58:18.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 -- 172.21.15.62:0/700146378 learned_addr learned my addr 172.21.15.62:0/700146378 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb772ffd640 1 --2- 172.21.15.62:0/700146378 >> v2:172.21.15.135:3300/0 conn(0x7fb77415cca0 0x7fb7740d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7727fc640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7740b20c0 0x7fb7740cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 -- 172.21.15.62:0/700146378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7740b20c0 msgr2=0x7fb7740cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7740b20c0 0x7fb7740cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 -- 172.21.15.62:0/700146378 >> v2:172.21.15.135:3300/0 conn(0x7fb77415cca0 msgr2=0x7fb7740d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 --2- 172.21.15.62:0/700146378 >> v2:172.21.15.135:3300/0 conn(0x7fb77415cca0 0x7fb7740d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.684+0000 7fb7737fe640 1 -- 172.21.15.62:0/700146378 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740cdc80 con 0x7fb7740cf970 2023-09-30T13:58:18.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7737fe640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740cfe00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b4940 tx=0x7fb76c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf014e8b81cb978 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:18.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb771ffb640 1 -- 172.21.15.62:0/700146378 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c02c9e0 con 0x7fb7740cf970 2023-09-30T13:58:18.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb771ffb640 1 -- 172.21.15.62:0/700146378 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb76c02cb40 con 0x7fb7740cf970 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb771ffb640 1 -- 172.21.15.62:0/700146378 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0343f0 con 0x7fb7740cf970 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 -- 172.21.15.62:0/700146378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 msgr2=0x7fb7740cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740cfe00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b4940 tx=0x7fb76c02be40 comp rx=0 tx=0).stop 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 -- 172.21.15.62:0/700146378 shutdown_connections 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740cfe00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 --2- 172.21.15.62:0/700146378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7740b20c0 0x7fb7740cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 --2- 172.21.15.62:0/700146378 >> v2:172.21.15.135:3300/0 conn(0x7fb77415cca0 0x7fb7740d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 -- 172.21.15.62:0/700146378 >> 172.21.15.62:0/700146378 conn(0x7fb774071660 msgr2=0x7fb774071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 -- 172.21.15.62:0/700146378 shutdown_connections 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.685+0000 7fb7792bb640 1 -- 172.21.15.62:0/700146378 wait complete. 2023-09-30T13:58:18.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 Processor -- start 2023-09-30T13:58:18.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 -- start start 2023-09-30T13:58:18.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7740b20c0 0x7fb7740ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb77415cca0 0x7fb7740c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741f31f0 con 0x7fb7740cf970 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741f33d0 con 0x7fb7740b20c0 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.687+0000 7fb7792bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c7c40 con 0x7fb77415cca0 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50286/0 (socket says 172.21.15.62:50286) 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 -- 172.21.15.62:0/1991490849 learned_addr learned my addr 172.21.15.62:0/1991490849 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb772ffd640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7740b20c0 0x7fb7740ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7737fe640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb77415cca0 0x7fb7740c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 -- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb77415cca0 msgr2=0x7fb7740c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb77415cca0 0x7fb7740c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 -- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7740b20c0 msgr2=0x7fb7740ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7740b20c0 0x7fb7740ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 -- 172.21.15.62:0/1991490849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009b30 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7727fc640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00d800 tx=0x7fb75c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0096a0 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fb75c009800 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7740c7f20 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c009990 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.688+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7741f3920 con 0x7fb7740cf970 2023-09-30T13:58:18.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.689+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774073e70 con 0x7fb7740cf970 2023-09-30T13:58:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.690+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fb75c009af0 con 0x7fb7740cf970 2023-09-30T13:58:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.690+0000 7fb76b7fe640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 0x7fb75406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.690+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5735+0+0 (secure 0 0 0) 0x7fb75c089760 con 0x7fb7740cf970 2023-09-30T13:58:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.690+0000 7fb772ffd640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 0x7fb75406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:18.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.691+0000 7fb772ffd640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 0x7fb75406cff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:18.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.694+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fb75c054900 con 0x7fb7740cf970 2023-09-30T13:58:18.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:18.870+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb774161490 con 0x7fb7740cf970 2023-09-30T13:58:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.547+0000 7fb76b7fe640 1 -- 172.21.15.62:0/1991490849 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb75c057f20 con 0x7fb7740cf970 2023-09-30T13:58:19.550 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-09-30T13:58:19.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.551+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 msgr2=0x7fb75406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.551+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 0x7fb75406cff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.551+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 msgr2=0x7fb7740c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.551+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00d800 tx=0x7fb75c00dcc0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 shutdown_connections 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fb75406ab30 0x7fb75406cff0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb77415cca0 0x7fb7740c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7740cf970 0x7fb7740c7030 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 --2- 172.21.15.62:0/1991490849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7740b20c0 0x7fb7740ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 >> 172.21.15.62:0/1991490849 conn(0x7fb774071660 msgr2=0x7fb7740c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:19.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 shutdown_connections 2023-09-30T13:58:19.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.554+0000 7fb7792bb640 1 -- 172.21.15.62:0/1991490849 wait complete. 2023-09-30T13:58:19.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm client client_inject_fixed_oldest_tid 2023-09-30T13:58:19.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.727+0000 7f0625a15640 1 Processor -- start 2023-09-30T13:58:19.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.727+0000 7f0625a15640 1 -- start start 2023-09-30T13:58:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f0625a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f0625a15640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f06200b15e0 0x7f06200b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f0625a15640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200d17c0 con 0x7f062015e1e0 2023-09-30T13:58:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f0625a15640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200ce2d0 con 0x7f06200b15e0 2023-09-30T13:58:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f0625a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06200d0360 con 0x7f06200cd830 2023-09-30T13:58:19.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f061e7fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f061e7fc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:60420/0 (socket says 172.21.15.62:60420) 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f061e7fc640 1 -- 172.21.15.62:0/35377208 learned_addr learned my addr 172.21.15.62:0/35377208 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.729+0000 7f061f7fe640 1 --2- 172.21.15.62:0/35377208 >> v2:172.21.15.135:3300/0 conn(0x7f06200b15e0 0x7f06200b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.730+0000 7f061f7fe640 1 -- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 msgr2=0x7f06200b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.730+0000 7f061f7fe640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.730+0000 7f061f7fe640 1 -- 172.21.15.62:0/35377208 >> v1:172.21.15.135:6789/0 conn(0x7f062015e1e0 legacy=0x7f06200cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.730+0000 7f061f7fe640 1 -- 172.21.15.62:0/35377208 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200cc0a0 con 0x7f06200b15e0 2023-09-30T13:58:19.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.730+0000 7f061e7fc640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:58:19.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.731+0000 7f061f7fe640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06200b15e0 0x7f06200b0880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0618009d90 tx=0x7f061802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=787f1c8e605cf089 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:19.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.732+0000 7f061dffb640 1 -- 172.21.15.62:0/35377208 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061802cc60 con 0x7f06200b15e0 2023-09-30T13:58:19.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.732+0000 7f061dffb640 1 -- 172.21.15.62:0/35377208 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f061802cdc0 con 0x7f06200b15e0 2023-09-30T13:58:19.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.732+0000 7f061dffb640 1 -- 172.21.15.62:0/35377208 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618034660 con 0x7f06200b15e0 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 -- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06200b15e0 msgr2=0x7f06200b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06200b15e0 0x7f06200b0880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0618009d90 tx=0x7f061802beb0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 -- 172.21.15.62:0/35377208 shutdown_connections 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200cd830 0x7f06200b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 --2- 172.21.15.62:0/35377208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06200b15e0 0x7f06200b0880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 -- 172.21.15.62:0/35377208 >> 172.21.15.62:0/35377208 conn(0x7f06200d08e0 msgr2=0x7f06200d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 -- 172.21.15.62:0/35377208 shutdown_connections 2023-09-30T13:58:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.733+0000 7f0625a15640 1 -- 172.21.15.62:0/35377208 wait complete. 2023-09-30T13:58:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.735+0000 7f0625a15640 1 Processor -- start 2023-09-30T13:58:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.735+0000 7f0625a15640 1 -- start start 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 0x7f0620159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f062015e1e0 0x7f06200b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200c4ee0 con 0x7f06200cd830 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200b4330 con 0x7f062015e1e0 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f0625a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06200b4610 con 0x7f06200b15e0 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f061e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f061e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50288/0 (socket says 172.21.15.62:50288) 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f061e7fc640 1 -- 172.21.15.62:0/1242556720 learned_addr learned my addr 172.21.15.62:0/1242556720 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.736+0000 7f061f7fe640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f062015e1e0 0x7f06200b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061effd640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 0x7f0620159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 -- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 msgr2=0x7f0620159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 0x7f0620159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 -- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f062015e1e0 msgr2=0x7f06200b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f062015e1e0 0x7f06200b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 -- 172.21.15.62:0/1242556720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140094d0 con 0x7f06200cd830 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061effd640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 0x7f0620159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.737+0000 7f061e7fc640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f061400e9d0 tx=0x7f061400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.738+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400ca60 con 0x7f06200cd830 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.738+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0618009a70 con 0x7f06200cd830 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.738+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f061400cbc0 con 0x7f06200cd830 2023-09-30T13:58:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.738+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400ca60 con 0x7f06200cd830 2023-09-30T13:58:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.738+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06200b4bd0 con 0x7f06200cd830 2023-09-30T13:58:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.739+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f061400cd30 con 0x7f06200cd830 2023-09-30T13:58:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.740+0000 7f0607fff640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 0x7f060c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.740+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062004e0d0 con 0x7f06200cd830 2023-09-30T13:58:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.740+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0614088bd0 con 0x7f06200cd830 2023-09-30T13:58:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.740+0000 7f061effd640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 0x7f060c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:19.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.741+0000 7f061effd640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 0x7f060c06d0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0610000f60 tx=0x7f0610009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.748+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0614054010 con 0x7f06200cd830 2023-09-30T13:58:19.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:19.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:19.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.955+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "client", "name": "client_inject_fixed_oldest_tid"} v 0) v1 -- 0x7f06200c3b40 con 0x7f06200cd830 2023-09-30T13:58:19.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.958+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "client", "name": "client_inject_fixed_oldest_tid"}]=0 v20) v1 ==== 116+0+0 (secure 0 0 0) 0x7f06140170b0 con 0x7f06200cd830 2023-09-30T13:58:19.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.958+0000 7f0607fff640 1 -- 172.21.15.62:0/1242556720 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614054010 con 0x7f06200cd830 2023-09-30T13:58:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 msgr2=0x7f060c06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 0x7f060c06d0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0610000f60 tx=0x7f0610009040 comp rx=0 tx=0).stop 2023-09-30T13:58:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 msgr2=0x7f06200c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:19.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f061400e9d0 tx=0x7f061400ee90 comp rx=0 tx=0).stop 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 shutdown_connections 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f060c06abf0 0x7f060c06d0b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f062015e1e0 0x7f06200b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06200cd830 0x7f06200c9af0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 --2- 172.21.15.62:0/1242556720 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f06200b15e0 0x7f0620159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:19.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 >> 172.21.15.62:0/1242556720 conn(0x7f06200d08e0 msgr2=0x7f06200cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 shutdown_connections 2023-09-30T13:58:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:19.960+0000 7f0625a15640 1 -- 172.21.15.62:0/1242556720 wait complete. 2023-09-30T13:58:19.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_metadata_threshold 2023-09-30T13:58:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.079+0000 7f07184e0640 1 Processor -- start 2023-09-30T13:58:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.079+0000 7f07184e0640 1 -- start start 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f07184e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f071015cb00 0x7f0710071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f07184e0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07100ae300 0x7f071006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f07184e0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071006d740 con 0x7f071015cee0 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f07184e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071006da20 con 0x7f071015cb00 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f07184e0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071006dd00 con 0x7f07100ae300 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f071015cb00 0x7f0710071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f071015cb00 0x7f0710071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50300/0 (socket says 172.21.15.62:50300) 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 -- 172.21.15.62:0/2880521280 learned_addr learned my addr 172.21.15.62:0/2880521280 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f0716a7d640 1 --2- 172.21.15.62:0/2880521280 >> v2:172.21.15.135:3300/0 conn(0x7f07100ae300 0x7f071006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 -- 172.21.15.62:0/2880521280 >> v2:172.21.15.135:3300/0 conn(0x7f07100ae300 msgr2=0x7f071006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 --2- 172.21.15.62:0/2880521280 >> v2:172.21.15.135:3300/0 conn(0x7f07100ae300 0x7f071006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 -- 172.21.15.62:0/2880521280 >> v1:172.21.15.135:6789/0 conn(0x7f071015cee0 legacy=0x7f07100c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:20.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.080+0000 7f071627c640 1 -- 172.21.15.62:0/2880521280 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071006dfe0 con 0x7f071015cb00 2023-09-30T13:58:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.081+0000 7f071627c640 1 --2- 172.21.15.62:0/2880521280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071015cb00 0x7f0710071860 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f07100b1ac0 tx=0x7f070802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df40babf28496f59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.081+0000 7f071527a640 1 -- 172.21.15.62:0/2880521280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708030860 con 0x7f071015cb00 2023-09-30T13:58:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.081+0000 7f071527a640 1 -- 172.21.15.62:0/2880521280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080309c0 con 0x7f071015cb00 2023-09-30T13:58:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.081+0000 7f071527a640 1 -- 172.21.15.62:0/2880521280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708030d50 con 0x7f071015cb00 2023-09-30T13:58:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 -- 172.21.15.62:0/2880521280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071015cb00 msgr2=0x7f0710071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 --2- 172.21.15.62:0/2880521280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071015cb00 0x7f0710071860 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f07100b1ac0 tx=0x7f070802b9a0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 -- 172.21.15.62:0/2880521280 shutdown_connections 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 --2- 172.21.15.62:0/2880521280 >> v2:172.21.15.135:3300/0 conn(0x7f07100ae300 0x7f071006ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 --2- 172.21.15.62:0/2880521280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071015cb00 0x7f0710071860 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 -- 172.21.15.62:0/2880521280 >> 172.21.15.62:0/2880521280 conn(0x7f0710070970 msgr2=0x7f0710070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 -- 172.21.15.62:0/2880521280 shutdown_connections 2023-09-30T13:58:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.082+0000 7f07184e0640 1 -- 172.21.15.62:0/2880521280 wait complete. 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.083+0000 7f07184e0640 1 Processor -- start 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.083+0000 7f07184e0640 1 -- start start 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f071015cb00 0x7f07101f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f071015cee0 0x7f07100acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071014e840 con 0x7f07100ae300 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07101f6cb0 con 0x7f071015cee0 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f07184e0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07101f66f0 con 0x7f071015cb00 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50302/0 (socket says 172.21.15.62:50302) 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 -- 172.21.15.62:0/2845186489 learned_addr learned my addr 172.21.15.62:0/2845186489 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f0716a7d640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f071015cee0 0x7f07100acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f0715a7b640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f071015cb00 0x7f07101f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 -- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f071015cb00 msgr2=0x7f07101f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f071015cb00 0x7f07101f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 -- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f071015cee0 msgr2=0x7f07100acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f071015cee0 0x7f07100acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.084+0000 7f071627c640 1 -- 172.21.15.62:0/2845186489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080094d0 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f071627c640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f070802b9e0 tx=0x7f0708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708039d60 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708043400 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07101f69d0 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080437b0 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.085+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07100b3390 con 0x7f07100ae300 2023-09-30T13:58:20.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.086+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07100666d0 con 0x7f07100ae300 2023-09-30T13:58:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.086+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0708043910 con 0x7f07100ae300 2023-09-30T13:58:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.087+0000 7f070effd640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 0x7f06fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.087+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f070803e070 con 0x7f07100ae300 2023-09-30T13:58:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.087+0000 7f0715a7b640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 0x7f06fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.087+0000 7f0715a7b640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 0x7f06fc06cff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f07100b4c80 tx=0x7f0704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.091+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0708077560 con 0x7f07100ae300 2023-09-30T13:58:20.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.268+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_metadata_threshold"} v 0) v1 -- 0x7f07100b2f00 con 0x7f07100ae300 2023-09-30T13:58:20.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.271+0000 7f070effd640 1 -- 172.21.15.62:0/2845186489 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_metadata_threshold"}]=0 v21) v1 ==== 113+0+0 (secure 0 0 0) 0x7f070807ab80 con 0x7f07100ae300 2023-09-30T13:58:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 msgr2=0x7f06fc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 0x7f06fc06cff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f07100b4c80 tx=0x7f0704009040 comp rx=0 tx=0).stop 2023-09-30T13:58:20.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 msgr2=0x7f071014e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f070802b9e0 tx=0x7f0708004730 comp rx=0 tx=0).stop 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 shutdown_connections 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f06fc06ab30 0x7f06fc06cff0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f071015cee0 0x7f07100acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f071015cb00 0x7f07101f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 --2- 172.21.15.62:0/2845186489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07100ae300 0x7f071014e300 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 >> 172.21.15.62:0/2845186489 conn(0x7f0710070970 msgr2=0x7f07100afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 shutdown_connections 2023-09-30T13:58:20.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.274+0000 7f07184e0640 1 -- 172.21.15.62:0/2845186489 wait complete. 2023-09-30T13:58:20.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-09-30T13:58:20.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.394+0000 7f5b722f2640 1 Processor -- start 2023-09-30T13:58:20.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.394+0000 7f5b722f2640 1 -- start start 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b722f2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b6c156b20 0x7f5b6c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b722f2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c15a3e0 con 0x7f5b6c159b90 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b722f2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c15a100 con 0x7f5b6c070060 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b722f2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c06de80 con 0x7f5b6c156b20 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b6bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b6c156b20 0x7f5b6c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b7088f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5b6c159b90 0x7f5b6c0ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53718/0 (socket says 172.21.15.62:53718) 2023-09-30T13:58:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b7088f640 1 -- 172.21.15.62:0/3521764515 learned_addr learned my addr 172.21.15.62:0/3521764515 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b6bfff640 1 -- 172.21.15.62:0/3521764515 >> v1:172.21.15.135:6789/0 conn(0x7f5b6c070060 legacy=0x7f5b6c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b6bfff640 1 -- 172.21.15.62:0/3521764515 >> v1:172.21.15.62:6789/0 conn(0x7f5b6c159b90 legacy=0x7f5b6c0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b6bfff640 1 -- 172.21.15.62:0/3521764515 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c06c320 con 0x7f5b6c156b20 2023-09-30T13:58:20.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.395+0000 7f5b6affd640 1 -- 172.21.15.62:0/3521764515 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799392887 0 0) 0x7f5b6c15a3e0 con 0x7f5b6c159b90 2023-09-30T13:58:20.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b6bfff640 1 --2- 172.21.15.62:0/3521764515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c156b20 0x7f5b6c06ce00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097d0 tx=0x7f5b5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca6b7603809e009 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b6affd640 1 -- 172.21.15.62:0/3521764515 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c031830 con 0x7f5b6c156b20 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b6affd640 1 -- 172.21.15.62:0/3521764515 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c031990 con 0x7f5b6c156b20 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b6affd640 1 -- 172.21.15.62:0/3521764515 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c031d20 con 0x7f5b6c156b20 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b722f2640 1 -- 172.21.15.62:0/3521764515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c156b20 msgr2=0x7f5b6c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b722f2640 1 --2- 172.21.15.62:0/3521764515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c156b20 0x7f5b6c06ce00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097d0 tx=0x7f5b5c02b8d0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b722f2640 1 -- 172.21.15.62:0/3521764515 shutdown_connections 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b722f2640 1 --2- 172.21.15.62:0/3521764515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c156b20 0x7f5b6c06ce00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.396+0000 7f5b722f2640 1 -- 172.21.15.62:0/3521764515 >> 172.21.15.62:0/3521764515 conn(0x7f5b6c0cb720 msgr2=0x7f5b6c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.397+0000 7f5b722f2640 1 -- 172.21.15.62:0/3521764515 shutdown_connections 2023-09-30T13:58:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.397+0000 7f5b722f2640 1 -- 172.21.15.62:0/3521764515 wait complete. 2023-09-30T13:58:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 Processor -- start 2023-09-30T13:58:20.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 -- start start 2023-09-30T13:58:20.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 0x7f5b6c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 0x7f5b6c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c14e7b0 con 0x7f5b6c159b90 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c149800 con 0x7f5b6c070060 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.398+0000 7f5b722f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c149ae0 con 0x7f5b6c156b20 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50324/0 (socket says 172.21.15.62:50324) 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 -- 172.21.15.62:0/62682141 learned_addr learned my addr 172.21.15.62:0/62682141 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:20.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b6bfff640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 0x7f5b6c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b6b7fe640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 0x7f5b6c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 -- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 msgr2=0x7f5b6c148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 0x7f5b6c148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 -- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 msgr2=0x7f5b6c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 0x7f5b6c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 -- 172.21.15.62:0/62682141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009400 con 0x7f5b6c159b90 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b6b7fe640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 0x7f5b6c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:20.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b6bfff640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 0x7f5b6c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b7088f640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c700 tx=0x7f5b6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400ce10 con 0x7f5b6c159b90 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6400a640 con 0x7f5b6c159b90 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c149dc0 con 0x7f5b6c159b90 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400aa70 con 0x7f5b6c159b90 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.399+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c1589f0 con 0x7f5b6c159b90 2023-09-30T13:58:20.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.400+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c070470 con 0x7f5b6c159b90 2023-09-30T13:58:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.401+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f5b6400abd0 con 0x7f5b6c159b90 2023-09-30T13:58:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.401+0000 7f5b68ff9640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 0x7f5b5806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.401+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5b64088450 con 0x7f5b6c159b90 2023-09-30T13:58:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.402+0000 7f5b6bfff640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 0x7f5b5806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.402+0000 7f5b6bfff640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 0x7f5b5806cff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c036000 tx=0x7f5b5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.405+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f5b6c070470 con 0x7f5b6c159b90 2023-09-30T13:58:20.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.586+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5b6c14e8f0 con 0x7f5b6c159b90 2023-09-30T13:58:20.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.588+0000 7f5b68ff9640 1 -- 172.21.15.62:0/62682141 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5b6c14e8f0 con 0x7f5b6c159b90 2023-09-30T13:58:20.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 msgr2=0x7f5b5806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 0x7f5b5806cff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c036000 tx=0x7f5b5c008030 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 msgr2=0x7f5b6c153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c700 tx=0x7f5b6400cbc0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 shutdown_connections 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f5b5806ab30 0x7f5b5806cff0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b6c159b90 0x7f5b6c153bd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b6c156b20 0x7f5b6c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 --2- 172.21.15.62:0/62682141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b6c070060 0x7f5b6c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.590+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 >> 172.21.15.62:0/62682141 conn(0x7f5b6c0cb720 msgr2=0x7f5b6c150370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.591+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 shutdown_connections 2023-09-30T13:58:20.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.591+0000 7f5b722f2640 1 -- 172.21.15.62:0/62682141 wait complete. 2023-09-30T13:58:20.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_completed_requests 2023-09-30T13:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.709+0000 7f4a8e524640 1 Processor -- start 2023-09-30T13:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.709+0000 7f4a8e524640 1 -- start start 2023-09-30T13:58:20.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a8e524640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a8815e1e0 0x7f4a880cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a8e524640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4a880b15e0 0x7f4a880cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a8e524640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a880b1350 con 0x7f4a8815e750 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a8e524640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a880ce2d0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a8e524640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a880d0360 con 0x7f4a880b15e0 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a87fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a8815e1e0 0x7f4a880cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a87fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a8815e1e0 0x7f4a880cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50334/0 (socket says 172.21.15.62:50334) 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.710+0000 7f4a87fff640 1 -- 172.21.15.62:0/4136212628 learned_addr learned my addr 172.21.15.62:0/4136212628 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.711+0000 7f4a87fff640 1 -- 172.21.15.62:0/4136212628 >> v2:172.21.15.135:3300/0 conn(0x7f4a880b15e0 msgr2=0x7f4a880cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:20.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.711+0000 7f4a87fff640 1 --2- 172.21.15.62:0/4136212628 >> v2:172.21.15.135:3300/0 conn(0x7f4a880b15e0 0x7f4a880cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.711+0000 7f4a87fff640 1 -- 172.21.15.62:0/4136212628 >> v1:172.21.15.135:6789/0 conn(0x7f4a8815e750 legacy=0x7f4a8815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:20.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.711+0000 7f4a87fff640 1 -- 172.21.15.62:0/4136212628 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880d17c0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.711+0000 7f4a87fff640 1 --2- 172.21.15.62:0/4136212628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a880cd120 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4a880b22b0 tx=0x7f4a7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5e5a3dcf76a062 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a86ffd640 1 -- 172.21.15.62:0/4136212628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78031870 con 0x7f4a8815e1e0 2023-09-30T13:58:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a86ffd640 1 -- 172.21.15.62:0/4136212628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a780319d0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a86ffd640 1 -- 172.21.15.62:0/4136212628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78031d60 con 0x7f4a8815e1e0 2023-09-30T13:58:20.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 -- 172.21.15.62:0/4136212628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 msgr2=0x7f4a880cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 --2- 172.21.15.62:0/4136212628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a880cd120 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4a880b22b0 tx=0x7f4a7802b910 comp rx=0 tx=0).stop 2023-09-30T13:58:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 -- 172.21.15.62:0/4136212628 shutdown_connections 2023-09-30T13:58:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 --2- 172.21.15.62:0/4136212628 >> v2:172.21.15.135:3300/0 conn(0x7f4a880b15e0 0x7f4a880cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 --2- 172.21.15.62:0/4136212628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a880cd120 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 -- 172.21.15.62:0/4136212628 >> 172.21.15.62:0/4136212628 conn(0x7f4a880d08e0 msgr2=0x7f4a880d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 -- 172.21.15.62:0/4136212628 shutdown_connections 2023-09-30T13:58:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.712+0000 7f4a8e524640 1 -- 172.21.15.62:0/4136212628 wait complete. 2023-09-30T13:58:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.713+0000 7f4a8e524640 1 Processor -- start 2023-09-30T13:58:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.713+0000 7f4a8e524640 1 -- start start 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 0x7f4a88152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 0x7f4a881f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8815d4a0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8815c0d0 con 0x7f4a880b15e0 2023-09-30T13:58:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8e524640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880c8fb0 con 0x7f4a8815e750 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50342/0 (socket says 172.21.15.62:50342) 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a877fe640 1 -- 172.21.15.62:0/242719955 learned_addr learned my addr 172.21.15.62:0/242719955 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.714+0000 7f4a8cac1640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 0x7f4a881f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a87fff640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 0x7f4a88152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 -- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 msgr2=0x7f4a881f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 0x7f4a881f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 -- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 msgr2=0x7f4a88152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 0x7f4a88152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 -- 172.21.15.62:0/242719955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780094d0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a87fff640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 0x7f4a88152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a8cac1640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 0x7f4a881f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a877fe640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b410 tx=0x7f4a7c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c011830 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c0119b0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8815b550 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c011d60 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.715+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8815bdf0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.716+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8815b940 con 0x7f4a8815e1e0 2023-09-30T13:58:20.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.716+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4a7c01a400 con 0x7f4a8815e1e0 2023-09-30T13:58:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.717+0000 7f4a84ff9640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 0x7f4a7406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.717+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4a7c089140 con 0x7f4a8815e1e0 2023-09-30T13:58:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.717+0000 7f4a87fff640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 0x7f4a7406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.718+0000 7f4a87fff640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 0x7f4a7406cff0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a78036000 tx=0x7f4a7803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:20.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.721+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f4a7c0545e0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.897+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_completed_requests"} v 0) v1 -- 0x7f4a8804e0d0 con 0x7f4a8815e1e0 2023-09-30T13:58:20.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.901+0000 7f4a84ff9640 1 -- 172.21.15.62:0/242719955 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_completed_requests"}]=0 v23) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4a7c057c00 con 0x7f4a8815e1e0 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 msgr2=0x7f4a7406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 0x7f4a7406cff0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a78036000 tx=0x7f4a7803c040 comp rx=0 tx=0).stop 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 msgr2=0x7f4a8815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b410 tx=0x7f4a7c00b8d0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 shutdown_connections 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f4a7406ab30 0x7f4a7406cff0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a8815e750 0x7f4a881f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a8815e1e0 0x7f4a8815ac90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 --2- 172.21.15.62:0/242719955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a880b15e0 0x7f4a88152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 >> 172.21.15.62:0/242719955 conn(0x7f4a880d08e0 msgr2=0x7f4a880ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 shutdown_connections 2023-09-30T13:58:20.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:20.903+0000 7f4a8e524640 1 -- 172.21.15.62:0/242719955 wait complete. 2023-09-30T13:58:20.915 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2023-09-30T13:58:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.034+0000 7f307d8d7640 1 Processor -- start 2023-09-30T13:58:21.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.034+0000 7f307d8d7640 1 -- start start 2023-09-30T13:58:21.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f307d8d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f3078160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f307d8d7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3078160fa0 0x7f307806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f307d8d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30780ce0f0 con 0x7f30780d0eb0 2023-09-30T13:58:21.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f307d8d7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30780cd7c0 con 0x7f3078160fa0 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f307d8d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30780cdaa0 con 0x7f30780ce580 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3078160fa0 0x7f307806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3078160fa0 0x7f307806af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50352/0 (socket says 172.21.15.62:50352) 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 -- 172.21.15.62:0/952920802 learned_addr learned my addr 172.21.15.62:0/952920802 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30767fc640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f3078160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 -- 172.21.15.62:0/952920802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 msgr2=0x7f3078160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f3078160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.035+0000 7f30777fe640 1 -- 172.21.15.62:0/952920802 >> v1:172.21.15.135:6789/0 conn(0x7f30780d0eb0 legacy=0x7f30780d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.036+0000 7f30777fe640 1 -- 172.21.15.62:0/952920802 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780cdd80 con 0x7f3078160fa0 2023-09-30T13:58:21.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.036+0000 7f30777fe640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3078160fa0 0x7f307806af90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3068009e50 tx=0x7f306802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859606ec62eb18c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:21.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.036+0000 7f3075ffb640 1 -- 172.21.15.62:0/952920802 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306802cb00 con 0x7f3078160fa0 2023-09-30T13:58:21.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.036+0000 7f3075ffb640 1 -- 172.21.15.62:0/952920802 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306802cc60 con 0x7f3078160fa0 2023-09-30T13:58:21.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.036+0000 7f3075ffb640 1 -- 172.21.15.62:0/952920802 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680343f0 con 0x7f3078160fa0 2023-09-30T13:58:21.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 -- 172.21.15.62:0/952920802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3078160fa0 msgr2=0x7f307806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3078160fa0 0x7f307806af90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3068009e50 tx=0x7f306802bf60 comp rx=0 tx=0).stop 2023-09-30T13:58:21.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 -- 172.21.15.62:0/952920802 shutdown_connections 2023-09-30T13:58:21.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3078160fa0 0x7f307806af90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 --2- 172.21.15.62:0/952920802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f3078160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 -- 172.21.15.62:0/952920802 >> 172.21.15.62:0/952920802 conn(0x7f3078089fe0 msgr2=0x7f30780d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 -- 172.21.15.62:0/952920802 shutdown_connections 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.037+0000 7f307d8d7640 1 -- 172.21.15.62:0/952920802 wait complete. 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.038+0000 7f307d8d7640 1 Processor -- start 2023-09-30T13:58:21.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.038+0000 7f307d8d7640 1 -- start start 2023-09-30T13:58:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f30780cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 0x7f30780b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30780cbff0 con 0x7f30780d0eb0 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30780cb3e0 con 0x7f3078160fa0 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f307d8d7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30780cb6c0 con 0x7f30780ce580 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f30767fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f30767fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50354/0 (socket says 172.21.15.62:50354) 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.039+0000 7f30767fc640 1 -- 172.21.15.62:0/761805872 learned_addr learned my addr 172.21.15.62:0/761805872 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f3076ffd640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f30780cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 -- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 msgr2=0x7f30780cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30777fe640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 0x7f30780b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f30780cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 -- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 msgr2=0x7f30780b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 0x7f30780b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 -- 172.21.15.62:0/761805872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009b30 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f3076ffd640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f30780cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30777fe640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 0x7f30780b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f30767fc640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f306000d5d0 tx=0x7f306000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060004240 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30600043a0 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30780cb9a0 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060003830 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.040+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3078151420 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.041+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307804e0d0 con 0x7f30780d0eb0 2023-09-30T13:58:21.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.041+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3060003990 con 0x7f30780d0eb0 2023-09-30T13:58:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.042+0000 7f306ffff640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 0x7f305806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.042+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f30600892c0 con 0x7f30780d0eb0 2023-09-30T13:58:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.042+0000 7f3076ffd640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 0x7f305806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.043+0000 7f3076ffd640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 0x7f305806cff0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3070000f60 tx=0x7f3070009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:21.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.046+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f30600546d0 con 0x7f30780d0eb0 2023-09-30T13:58:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.289+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) v1 -- 0x7f30780d0c90 con 0x7f30780d0eb0 2023-09-30T13:58:21.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.561+0000 7f306ffff640 1 -- 172.21.15.62:0/761805872 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v194) v1 ==== 162+0+0 (secure 0 0 0) 0x7f3060057cf0 con 0x7f30780d0eb0 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 msgr2=0x7f305806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 0x7f305806cff0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3070000f60 tx=0x7f3070009040 comp rx=0 tx=0).stop 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 msgr2=0x7f3078150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f306000d5d0 tx=0x7f306000da90 comp rx=0 tx=0).stop 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 shutdown_connections 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f305806ab30 0x7f305806cff0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3078160fa0 0x7f30780b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30780d0eb0 0x7f3078150ee0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 --2- 172.21.15.62:0/761805872 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30780ce580 0x7f30780cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 >> 172.21.15.62:0/761805872 conn(0x7f3078089fe0 msgr2=0x7f30780d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 shutdown_connections 2023-09-30T13:58:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:21.563+0000 7f307d8d7640 1 -- 172.21.15.62:0/761805872 wait complete. 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... FAIL 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner: 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:====================================================================== 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:FAIL: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-09-30T13:58:21.575 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/test_client_limits.py", line 283, in test_client_blocklisted_oldest_tid 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner: self.mount_a.create_n_files("testdir/file2", 20, True) 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:AssertionError: CommandFailedError not raised 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner: 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:Ran 2 tests in 169.656s 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner: 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner: 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:====================================================================== 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:FAIL: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the 2023-09-30T13:58:21.576 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-30T13:58:21.577 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-09-30T13:58:21.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs/test_client_limits.py", line 283, in test_client_blocklisted_oldest_tid 2023-09-30T13:58:21.577 INFO:tasks.cephfs_test_runner: self.mount_a.create_n_files("testdir/file2", 20, True) 2023-09-30T13:58:21.577 INFO:tasks.cephfs_test_runner:AssertionError: CommandFailedError not raised 2023-09-30T13:58:21.577 INFO:tasks.cephfs_test_runner: 2023-09-30T13:58:21.577 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:58:21.646 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=547c3459bc534397b905c53a01348f19 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2023-09-30T13:58:21.647 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-09-30T13:58:21.825 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-30T13:58:21.977 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-30T13:58:21.977 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:21.977 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:22.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:58:22.010 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-09-30T13:58:22.010 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:22.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054844,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19277 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247648k,nr_inodes=811912,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495300k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-30T13:58:22.069 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:58:22.069 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:22.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:58:22.089 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-09-30T13:58:22.089 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T13:58:22.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054834,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20504 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247636k,nr_inodes=811909,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6495272k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-30T13:58:22.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.149 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-09-30T13:58:22.169 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-30T13:58:22.170 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T13:58:22.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-30T13:58:22.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T13:58:22.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2023-09-30T13:58:22.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.416 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-09-30T13:58:22.434 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-30T13:58:22.434 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-30T13:58:22.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-30T13:58:22.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-30T13:58:22.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T13:58:22.575 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-09-30T13:58:22.678 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T13:58:22.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T13:58:22.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:58:22.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 Processor -- start 2023-09-30T13:58:22.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 -- start start 2023-09-30T13:58:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02580cdc20 0x7f02580b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 0x7f02580ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580b2e50 con 0x7f02580b2940 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580ac2d0 con 0x7f02580cdc20 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.800+0000 7f025f597640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580cc340 con 0x7f02580cf140 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025d333640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f02580cdc20 0x7f02580b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025cb32640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f02580b2940 0x7f02580cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53726/0 (socket says 172.21.15.62:53726) 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025cb32640 1 -- 172.21.15.62:0/6105925 learned_addr learned my addr 172.21.15.62:0/6105925 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025db34640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 0x7f02580ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025d333640 1 -- 172.21.15.62:0/6105925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 msgr2=0x7f02580ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025d333640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 0x7f02580ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025d333640 1 -- 172.21.15.62:0/6105925 >> v1:172.21.15.62:6789/0 conn(0x7f02580b2940 legacy=0x7f02580cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025d333640 1 -- 172.21.15.62:0/6105925 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02580cc620 con 0x7f02580cdc20 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f024bfff640 1 -- 172.21.15.62:0/6105925 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036308634 0 0) 0x7f02580b2e50 con 0x7f02580b2940 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.801+0000 7f025db34640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 0x7f02580ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025d333640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f02580b2400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f024c009790 tx=0x7f024c02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5498c08f1eb233b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f024bfff640 1 -- 172.21.15.62:0/6105925 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c031770 con 0x7f02580cdc20 2023-09-30T13:58:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f024bfff640 1 -- 172.21.15.62:0/6105925 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0318d0 con 0x7f02580cdc20 2023-09-30T13:58:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f024bfff640 1 -- 172.21.15.62:0/6105925 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c031c60 con 0x7f02580cdc20 2023-09-30T13:58:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 -- 172.21.15.62:0/6105925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 msgr2=0x7f02580b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f02580b2400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f024c009790 tx=0x7f024c02b810 comp rx=0 tx=0).stop 2023-09-30T13:58:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 -- 172.21.15.62:0/6105925 shutdown_connections 2023-09-30T13:58:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580cf140 0x7f02580ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 --2- 172.21.15.62:0/6105925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f02580b2400 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.802+0000 7f025f597640 1 -- 172.21.15.62:0/6105925 >> 172.21.15.62:0/6105925 conn(0x7f025806a170 msgr2=0x7f025806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.803+0000 7f025f597640 1 -- 172.21.15.62:0/6105925 shutdown_connections 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.803+0000 7f025f597640 1 -- 172.21.15.62:0/6105925 wait complete. 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 Processor -- start 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 -- start start 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 0x7f02580c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 0x7f02581597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02581f39f0 con 0x7f02580cdc20 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02581f2de0 con 0x7f02580cf140 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.804+0000 7f025f597640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02581f30c0 con 0x7f02580b2940 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50374/0 (socket says 172.21.15.62:50374) 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 -- 172.21.15.62:0/1966478844 learned_addr learned my addr 172.21.15.62:0/1966478844 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025d333640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 0x7f02580c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025db34640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 0x7f02581597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 -- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 msgr2=0x7f02580c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 0x7f02580c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 -- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 msgr2=0x7f02581597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 0x7f02581597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 -- 172.21.15.62:0/1966478844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0093a0 con 0x7f02580cdc20 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025db34640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 0x7f02581597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025d333640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 0x7f02580c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025cb32640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f025400c410 tx=0x7f025400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540074e0 con 0x7f02580cdc20 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254007660 con 0x7f02580cdc20 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02581f33a0 con 0x7f02580cdc20 2023-09-30T13:58:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254004a20 con 0x7f02580cdc20 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.805+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025806cdd0 con 0x7f02580cdc20 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.807+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02581f3b60 con 0x7f02580cdc20 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.807+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f0254004b80 con 0x7f02580cdc20 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.807+0000 7f0249ffb640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 0x7f023c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.807+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0254088e10 con 0x7f02580cdc20 2023-09-30T13:58:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.808+0000 7f025d333640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 0x7f023c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.808+0000 7f025d333640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 0x7f023c06d020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f024c036000 tx=0x7f024c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.812+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f0254057cb0 con 0x7f02580cdc20 2023-09-30T13:58:22.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.982+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02580ccbe0 con 0x7f023c06ab60 2023-09-30T13:58:22.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.985+0000 7f0249ffb640 1 -- 172.21.15.62:0/1966478844 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51272 (secure 0 0 0) 0x7f024c031bc0 con 0x7f023c06ab60 2023-09-30T13:58:22.985 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:22.986 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:58:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 msgr2=0x7f023c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 0x7f023c06d020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f024c036000 tx=0x7f024c03d040 comp rx=0 tx=0).stop 2023-09-30T13:58:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 msgr2=0x7f0258159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f025400c410 tx=0x7f025400c8d0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 shutdown_connections 2023-09-30T13:58:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f023c06ab60 0x7f023c06d020 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02580cf140 0x7f02581597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f02580cdc20 0x7f0258159270 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 --2- 172.21.15.62:0/1966478844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f02580b2940 0x7f02580c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 >> 172.21.15.62:0/1966478844 conn(0x7f025806a170 msgr2=0x7f0258070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 shutdown_connections 2023-09-30T13:58:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:22.987+0000 7f025f597640 1 -- 172.21.15.62:0/1966478844 wait complete. 2023-09-30T13:58:22.998 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-09-30T13:58:21.723118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472152,"kb_used_data":164480,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754502568,"statfs":{"total":773094113280,"available":772610629632,"internally_reserved":0,"allocated":168427520,"data_stored":82656302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":314953272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39570456,"num_objects":-10160,"num_object_clones":0,"num_object_copies":-20320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-10301,"num_write_kb":-59819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001431"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-09-30T13:57:33.554764+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:57:33.554764+0000","last_peered":"2023-09-30T13:57:33.554764+0000","last_clean":"2023-09-30T13:57:33.554764+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:57:33.554764+0000","last_undegraded":"2023-09-30T13:57:33.554764+0000","last_fullsized":"2023-09-30T13:57:33.554764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53744,"kb_used_data":14244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318096,"statfs":{"total":96636764160,"available":96581730304,"internally_reserved":0,"allocated":14585856,"data_stored":2675753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.37},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":1.024,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80800000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60500,"kb_used_data":25164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311340,"statfs":{"total":96636764160,"available":96574812160,"internally_reserved":0,"allocated":25767936,"data_stored":17072744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.62}]},{"osd":2,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58532,"kb_used_data":19036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313308,"statfs":{"total":96636764160,"available":96576827392,"internally_reserved":0,"allocated":19492864,"data_stored":8685515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.622}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.442}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58499999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53092,"kb_used_data":17752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318748,"statfs":{"total":96636764160,"available":96582397952,"internally_reserved":0,"allocated":18178048,"data_stored":8691331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71499999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92500000000000004,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66400000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":2.202,"15min":2.202},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":2.266,"15min":2.266},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60028,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94311812,"statfs":{"total":96636764160,"available":96575295488,"internally_reserved":0,"allocated":21020672,"data_stored":8694159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.312}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.501,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.37,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51400000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":1.258,"15min":1.258},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57772,"kb_used_data":18272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94314068,"statfs":{"total":96636764160,"available":96577605632,"internally_reserved":0,"allocated":18710528,"data_stored":8691918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.318,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56799999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.437}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64576,"kb_used_data":29236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307264,"statfs":{"total":96636764160,"available":96570638336,"internally_reserved":0,"allocated":29937664,"data_stored":21273030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61799999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53400000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.37}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.98499999999999999,"5min":1.002,"15min":1.002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.443},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84799999999999998,"5min":1.161,"15min":1.161},"last":0.52400000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":1.123,"15min":1.123},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83499999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90500000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63908,"kb_used_data":20248,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94307932,"statfs":{"total":96636764160,"available":96571322368,"internally_reserved":0,"allocated":20733952,"data_stored":6871852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.312},"min":{"1min":0.23100000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.67200000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36299999999999999,"15min":0.34599999999999997},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.378},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27100000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.372,"15min":0.35899999999999999},"min":{"1min":0.28999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.52400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83099999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.75800000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:58:23.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:58:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.107+0000 7f2d162de640 1 Processor -- start 2023-09-30T13:58:23.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.107+0000 7f2d162de640 1 -- start start 2023-09-30T13:58:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d162de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d162de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2d100c26f0 0x7f2d1006a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d162de640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1015aed0 con 0x7f2d1006dd60 2023-09-30T13:58:23.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d162de640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100b50a0 con 0x7f2d100c26f0 2023-09-30T13:58:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d162de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b1670 con 0x7f2d100b48e0 2023-09-30T13:58:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:60486/0 (socket says 172.21.15.62:60486) 2023-09-30T13:58:23.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 -- 172.21.15.62:0/1974318088 learned_addr learned my addr 172.21.15.62:0/1974318088 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d1487b640 1 --2- 172.21.15.62:0/1974318088 >> v2:172.21.15.135:3300/0 conn(0x7f2d100c26f0 0x7f2d1006a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 -- 172.21.15.62:0/1974318088 >> v2:172.21.15.135:3300/0 conn(0x7f2d100c26f0 msgr2=0x7f2d1006a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 --2- 172.21.15.62:0/1974318088 >> v2:172.21.15.135:3300/0 conn(0x7f2d100c26f0 0x7f2d1006a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 -- 172.21.15.62:0/1974318088 >> v1:172.21.15.135:6789/0 conn(0x7f2d1006dd60 legacy=0x7f2d1006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.108+0000 7f2d0f7fe640 1 -- 172.21.15.62:0/1974318088 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10066070 con 0x7f2d100b48e0 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.109+0000 7f2d0f7fe640 1 --2- 172.21.15.62:0/1974318088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009870 tx=0x7f2d0402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbea676744b0f74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.109+0000 7f2d0effd640 1 -- 172.21.15.62:0/1974318088 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040317c0 con 0x7f2d100b48e0 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.109+0000 7f2d0effd640 1 -- 172.21.15.62:0/1974318088 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d04031920 con 0x7f2d100b48e0 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.109+0000 7f2d0effd640 1 -- 172.21.15.62:0/1974318088 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04031cb0 con 0x7f2d100b48e0 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 -- 172.21.15.62:0/1974318088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 msgr2=0x7f2d10069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 --2- 172.21.15.62:0/1974318088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009870 tx=0x7f2d0402b860 comp rx=0 tx=0).stop 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 -- 172.21.15.62:0/1974318088 shutdown_connections 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 --2- 172.21.15.62:0/1974318088 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d10069d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 --2- 172.21.15.62:0/1974318088 >> v2:172.21.15.135:3300/0 conn(0x7f2d100c26f0 0x7f2d1006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 -- 172.21.15.62:0/1974318088 >> 172.21.15.62:0/1974318088 conn(0x7f2d100b0b50 msgr2=0x7f2d100b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 -- 172.21.15.62:0/1974318088 shutdown_connections 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.110+0000 7f2d162de640 1 -- 172.21.15.62:0/1974318088 wait complete. 2023-09-30T13:58:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.111+0000 7f2d162de640 1 Processor -- start 2023-09-30T13:58:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.111+0000 7f2d162de640 1 -- start start 2023-09-30T13:58:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d1009d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 0x7f2d100c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c62d0 con 0x7f2d1006dd60 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c65b0 con 0x7f2d100c26f0 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d162de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c6890 con 0x7f2d100b48e0 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50388/0 (socket says 172.21.15.62:50388) 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0ffff640 1 -- 172.21.15.62:0/522089027 learned_addr learned my addr 172.21.15.62:0/522089027 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0f7fe640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d1009d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d1487b640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 0x7f2d100c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0ffff640 1 -- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 msgr2=0x7f2d1009d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.112+0000 7f2d0ffff640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d1009d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0ffff640 1 -- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 msgr2=0x7f2d100c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0ffff640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 0x7f2d100c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0ffff640 1 -- 172.21.15.62:0/522089027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040094d0 con 0x7f2d1006dd60 2023-09-30T13:58:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d1487b640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 0x7f2d100c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0ffff640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c450 tx=0x7f2d0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000052d0 con 0x7f2d1006dd60 2023-09-30T13:58:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00005430 con 0x7f2d1006dd60 2023-09-30T13:58:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00012870 con 0x7f2d1006dd60 2023-09-30T13:58:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100c6b70 con 0x7f2d1006dd60 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.113+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d100cd790 con 0x7f2d1006dd60 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.114+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004e0d0 con 0x7f2d1006dd60 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.114+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f2d000129d0 con 0x7f2d1006dd60 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.115+0000 7f2d0cff9640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 0x7f2cfc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.115+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2d00088b20 con 0x7f2d1006dd60 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.115+0000 7f2d0f7fe640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 0x7f2cfc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.116+0000 7f2d0f7fe640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 0x7f2cfc06cff0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2d04036000 tx=0x7f2d0403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.119+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f2d00053fc0 con 0x7f2d1006dd60 2023-09-30T13:58:23.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.291+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d100cb3d0 con 0x7f2cfc06ab30 2023-09-30T13:58:23.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.293+0000 7f2d0cff9640 1 -- 172.21.15.62:0/522089027 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51272 (secure 0 0 0) 0x7f2d04031b90 con 0x7f2cfc06ab30 2023-09-30T13:58:23.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:23.294 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:58:23.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 msgr2=0x7f2cfc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 0x7f2cfc06cff0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2d04036000 tx=0x7f2d0403d040 comp rx=0 tx=0).stop 2023-09-30T13:58:23.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 msgr2=0x7f2d100c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c450 tx=0x7f2d0000c910 comp rx=0 tx=0).stop 2023-09-30T13:58:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 shutdown_connections 2023-09-30T13:58:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f2cfc06ab30 0x7f2cfc06cff0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d100c26f0 0x7f2d100c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d100b48e0 0x7f2d1009d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 --2- 172.21.15.62:0/522089027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d1006dd60 0x7f2d100c1a30 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 >> 172.21.15.62:0/522089027 conn(0x7f2d100b0b50 msgr2=0x7f2d10069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 shutdown_connections 2023-09-30T13:58:23.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.295+0000 7f2d162de640 1 -- 172.21.15.62:0/522089027 wait complete. 2023-09-30T13:58:23.305 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-09-30T13:58:21.723118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472152,"kb_used_data":164480,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754502568,"statfs":{"total":773094113280,"available":772610629632,"internally_reserved":0,"allocated":168427520,"data_stored":82656302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":314953272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39570456,"num_objects":-10160,"num_object_clones":0,"num_object_copies":-20320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-10301,"num_write_kb":-59819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001431"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-09-30T13:57:33.554764+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:57:33.554764+0000","last_peered":"2023-09-30T13:57:33.554764+0000","last_clean":"2023-09-30T13:57:33.554764+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:57:33.554764+0000","last_undegraded":"2023-09-30T13:57:33.554764+0000","last_fullsized":"2023-09-30T13:57:33.554764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53744,"kb_used_data":14244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318096,"statfs":{"total":96636764160,"available":96581730304,"internally_reserved":0,"allocated":14585856,"data_stored":2675753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.37},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":1.024,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80800000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60500,"kb_used_data":25164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311340,"statfs":{"total":96636764160,"available":96574812160,"internally_reserved":0,"allocated":25767936,"data_stored":17072744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.62}]},{"osd":2,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58532,"kb_used_data":19036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313308,"statfs":{"total":96636764160,"available":96576827392,"internally_reserved":0,"allocated":19492864,"data_stored":8685515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.622}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.442}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58499999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53092,"kb_used_data":17752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318748,"statfs":{"total":96636764160,"available":96582397952,"internally_reserved":0,"allocated":18178048,"data_stored":8691331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71499999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92500000000000004,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66400000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":2.202,"15min":2.202},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":2.266,"15min":2.266},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60028,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94311812,"statfs":{"total":96636764160,"available":96575295488,"internally_reserved":0,"allocated":21020672,"data_stored":8694159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.312}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.501,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.37,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51400000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":1.258,"15min":1.258},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57772,"kb_used_data":18272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94314068,"statfs":{"total":96636764160,"available":96577605632,"internally_reserved":0,"allocated":18710528,"data_stored":8691918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.318,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56799999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.437}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64576,"kb_used_data":29236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307264,"statfs":{"total":96636764160,"available":96570638336,"internally_reserved":0,"allocated":29937664,"data_stored":21273030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61799999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53400000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.37}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.98499999999999999,"5min":1.002,"15min":1.002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.443},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84799999999999998,"5min":1.161,"15min":1.161},"last":0.52400000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":1.123,"15min":1.123},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83499999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90500000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63908,"kb_used_data":20248,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94307932,"statfs":{"total":96636764160,"available":96571322368,"internally_reserved":0,"allocated":20733952,"data_stored":6871852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.312},"min":{"1min":0.23100000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.67200000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36299999999999999,"15min":0.34599999999999997},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.378},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27100000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.372,"15min":0.35899999999999999},"min":{"1min":0.28999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.52400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83099999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.75800000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:58:23.307 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T13:58:23.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:58:23.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.414+0000 7fa33d051640 1 Processor -- start 2023-09-30T13:58:23.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.414+0000 7fa33d051640 1 -- start start 2023-09-30T13:58:23.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33d051640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3381598c0 0x7fa3380ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33d051640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa3380ceea0 0x7fa33815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33d051640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380b1e20 con 0x7fa3380cea30 2023-09-30T13:58:23.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33d051640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380b1530 con 0x7fa3380ceea0 2023-09-30T13:58:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33d051640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380b17d0 con 0x7fa3381598c0 2023-09-30T13:58:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33759e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa3380ceea0 0x7fa33815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa32ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa3380cea30 0x7fa33815d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53742/0 (socket says 172.21.15.62:53742) 2023-09-30T13:58:23.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa32ffff640 1 -- 172.21.15.62:0/4221230503 learned_addr learned my addr 172.21.15.62:0/4221230503 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa336d9d640 1 --2- 172.21.15.62:0/4221230503 >> v2:172.21.15.135:3300/0 conn(0x7fa3381598c0 0x7fa3380ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33759e640 1 -- 172.21.15.62:0/4221230503 >> v2:172.21.15.135:3300/0 conn(0x7fa3381598c0 msgr2=0x7fa3380ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:23.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33759e640 1 --2- 172.21.15.62:0/4221230503 >> v2:172.21.15.135:3300/0 conn(0x7fa3381598c0 0x7fa3380ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33759e640 1 -- 172.21.15.62:0/4221230503 >> v1:172.21.15.62:6789/0 conn(0x7fa3380cea30 legacy=0x7fa33815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33759e640 1 -- 172.21.15.62:0/4221230503 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380b1ab0 con 0x7fa3380ceea0 2023-09-30T13:58:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.415+0000 7fa33659c640 1 -- 172.21.15.62:0/4221230503 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186012851 0 0) 0x7fa3380b1e20 con 0x7fa3380cea30 2023-09-30T13:58:23.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.416+0000 7fa33759e640 1 --2- 172.21.15.62:0/4221230503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380ceea0 0x7fa33815dc30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa330009d90 tx=0x7fa33002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d548edb3fba681 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.416+0000 7fa33659c640 1 -- 172.21.15.62:0/4221230503 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33002cc60 con 0x7fa3380ceea0 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.416+0000 7fa33659c640 1 -- 172.21.15.62:0/4221230503 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33002cdc0 con 0x7fa3380ceea0 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.416+0000 7fa33659c640 1 -- 172.21.15.62:0/4221230503 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330034660 con 0x7fa3380ceea0 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 -- 172.21.15.62:0/4221230503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380ceea0 msgr2=0x7fa33815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 --2- 172.21.15.62:0/4221230503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380ceea0 0x7fa33815dc30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa330009d90 tx=0x7fa33002beb0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 -- 172.21.15.62:0/4221230503 shutdown_connections 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 --2- 172.21.15.62:0/4221230503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380ceea0 0x7fa33815dc30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 --2- 172.21.15.62:0/4221230503 >> v2:172.21.15.135:3300/0 conn(0x7fa3381598c0 0x7fa3380ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 -- 172.21.15.62:0/4221230503 >> 172.21.15.62:0/4221230503 conn(0x7fa33806a170 msgr2=0x7fa33806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 -- 172.21.15.62:0/4221230503 shutdown_connections 2023-09-30T13:58:23.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.417+0000 7fa33d051640 1 -- 172.21.15.62:0/4221230503 wait complete. 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.418+0000 7fa33d051640 1 Processor -- start 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.418+0000 7fa33d051640 1 -- start start 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3380ceea0 0x7fa3380cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3381598c0 0x7fa3380c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33814bfb0 con 0x7fa3380cea30 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338157d40 con 0x7fa3381598c0 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33d051640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338157a10 con 0x7fa3380ceea0 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50404/0 (socket says 172.21.15.62:50404) 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 -- 172.21.15.62:0/550605976 learned_addr learned my addr 172.21.15.62:0/550605976 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa32ffff640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3380ceea0 0x7fa3380cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa33759e640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3381598c0 0x7fa3380c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 -- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3380ceea0 msgr2=0x7fa3380cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3380ceea0 0x7fa3380cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 -- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3381598c0 msgr2=0x7fa3380c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3381598c0 0x7fa3380c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 -- 172.21.15.62:0/550605976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a70 con 0x7fa3380cea30 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.419+0000 7fa336d9d640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e8e0 tx=0x7fa32800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.420+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800c8e0 con 0x7fa3380cea30 2023-09-30T13:58:23.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.420+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800ca40 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.420+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338155d20 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.420+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32800cdd0 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.420+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3381562e0 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.421+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33804e0d0 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.421+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fa328013470 con 0x7fa3380cea30 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.422+0000 7fa32f7fe640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 0x7fa31806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.422+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa328089520 con 0x7fa3380cea30 2023-09-30T13:58:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.422+0000 7fa32ffff640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 0x7fa31806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.422+0000 7fa32ffff640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 0x7fa31806d020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa3380c5100 tx=0x7fa320007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.426+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fa3280549c0 con 0x7fa3380cea30 2023-09-30T13:58:23.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.599+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3380ade20 con 0x7fa31806ab60 2023-09-30T13:58:23.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.601+0000 7fa32f7fe640 1 -- 172.21.15.62:0/550605976 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51272 (secure 0 0 0) 0x7fa320007170 con 0x7fa31806ab60 2023-09-30T13:58:23.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:23.602 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:58:23.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 msgr2=0x7fa31806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 0x7fa31806d020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa3380c5100 tx=0x7fa320007b50 comp rx=0 tx=0).stop 2023-09-30T13:58:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 msgr2=0x7fa3381556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa32800e8e0 tx=0x7fa32800eda0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 shutdown_connections 2023-09-30T13:58:23.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fa31806ab60 0x7fa31806d020 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3381598c0 0x7fa3380c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3380ceea0 0x7fa3380cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 --2- 172.21.15.62:0/550605976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3380cea30 0x7fa3381556d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 >> 172.21.15.62:0/550605976 conn(0x7fa33806a170 msgr2=0x7fa33806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 shutdown_connections 2023-09-30T13:58:23.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.603+0000 7fa33d051640 1 -- 172.21.15.62:0/550605976 wait complete. 2023-09-30T13:58:23.613 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-09-30T13:58:21.723118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472152,"kb_used_data":164480,"kb_used_omap":12,"kb_used_meta":307571,"kb_avail":754502568,"statfs":{"total":773094113280,"available":772610629632,"internally_reserved":0,"allocated":168427520,"data_stored":82656302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":314953272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39570456,"num_objects":-10160,"num_object_clones":0,"num_object_copies":-20320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-10301,"num_write_kb":-59819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001431"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-09-30T13:57:33.554764+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:57:33.554764+0000","last_peered":"2023-09-30T13:57:33.554764+0000","last_clean":"2023-09-30T13:57:33.554764+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:57:33.554764+0000","last_undegraded":"2023-09-30T13:57:33.554764+0000","last_fullsized":"2023-09-30T13:57:33.554764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53744,"kb_used_data":14244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318096,"statfs":{"total":96636764160,"available":96581730304,"internally_reserved":0,"allocated":14585856,"data_stored":2675753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.37},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":1.024,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80800000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.436},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60500,"kb_used_data":25164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311340,"statfs":{"total":96636764160,"available":96574812160,"internally_reserved":0,"allocated":25767936,"data_stored":17072744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.62}]},{"osd":2,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58532,"kb_used_data":19036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313308,"statfs":{"total":96636764160,"available":96576827392,"internally_reserved":0,"allocated":19492864,"data_stored":8685515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.622}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.442}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58499999999999996}]},{"osd":3,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53092,"kb_used_data":17752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318748,"statfs":{"total":96636764160,"available":96582397952,"internally_reserved":0,"allocated":18178048,"data_stored":8691331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71499999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92500000000000004,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66400000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":2.202,"15min":2.202},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":2.266,"15min":2.266},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60028,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94311812,"statfs":{"total":96636764160,"available":96575295488,"internally_reserved":0,"allocated":21020672,"data_stored":8694159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.312}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.501,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.37,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51400000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":1.258,"15min":1.258},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57772,"kb_used_data":18272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94314068,"statfs":{"total":96636764160,"available":96577605632,"internally_reserved":0,"allocated":18710528,"data_stored":8691918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.318,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56799999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.437}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64576,"kb_used_data":29236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307264,"statfs":{"total":96636764160,"available":96570638336,"internally_reserved":0,"allocated":29937664,"data_stored":21273030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61799999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53400000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.37}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.98499999999999999,"5min":1.002,"15min":1.002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.443},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84799999999999998,"5min":1.161,"15min":1.161},"last":0.52400000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":1.123,"15min":1.123},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83499999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90500000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63908,"kb_used_data":20248,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94307932,"statfs":{"total":96636764160,"available":96571322368,"internally_reserved":0,"allocated":20733952,"data_stored":6871852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.312},"min":{"1min":0.23100000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.67200000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36299999999999999,"15min":0.34599999999999997},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.378},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27100000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.372,"15min":0.35899999999999999},"min":{"1min":0.28999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.52400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83099999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.75800000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:58:23.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T13:58:23.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 Processor -- start 2023-09-30T13:58:23.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 -- start start 2023-09-30T13:58:23.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89940cf140 0x7f89940ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940c8c90 0x7f89940c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940b1e20 con 0x7f89941598c0 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940b1530 con 0x7f89940cf140 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.722+0000 7f8998dce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940b17d0 con 0x7f89940c8c90 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89940cf140 0x7f89940ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89940cf140 0x7f89940ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50418/0 (socket says 172.21.15.62:50418) 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 -- 172.21.15.62:0/2174465721 learned_addr learned my addr 172.21.15.62:0/2174465721 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:23.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f899259c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f89941598c0 0x7f89940cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53746/0 (socket says 172.21.15.62:53746) 2023-09-30T13:58:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f8992d9d640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940c8c90 0x7f89940c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 -- 172.21.15.62:0/2174465721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940c8c90 msgr2=0x7f89940c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940c8c90 0x7f89940c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 -- 172.21.15.62:0/2174465721 >> v1:172.21.15.62:6789/0 conn(0x7f89941598c0 legacy=0x7f89940cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f8991d9b640 1 -- 172.21.15.62:0/2174465721 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231604911 0 0) 0x7f89940b1e20 con 0x7f89941598c0 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.723+0000 7f898bfff640 1 -- 172.21.15.62:0/2174465721 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940b1ab0 con 0x7f89940cf140 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f898bfff640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940cf140 0x7f89940ccc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c33fb11c0a02f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8991d9b640 1 -- 172.21.15.62:0/2174465721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c030840 con 0x7f89940cf140 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8991d9b640 1 -- 172.21.15.62:0/2174465721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0309a0 con 0x7f89940cf140 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8991d9b640 1 -- 172.21.15.62:0/2174465721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c030d30 con 0x7f89940cf140 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 -- 172.21.15.62:0/2174465721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940cf140 msgr2=0x7f89940ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940cf140 0x7f89940ccc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c02b980 comp rx=0 tx=0).stop 2023-09-30T13:58:23.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 -- 172.21.15.62:0/2174465721 shutdown_connections 2023-09-30T13:58:23.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940c8c90 0x7f89940c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 --2- 172.21.15.62:0/2174465721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940cf140 0x7f89940ccc20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 -- 172.21.15.62:0/2174465721 >> 172.21.15.62:0/2174465721 conn(0x7f899406a170 msgr2=0x7f899406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 -- 172.21.15.62:0/2174465721 shutdown_connections 2023-09-30T13:58:23.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.724+0000 7f8998dce640 1 -- 172.21.15.62:0/2174465721 wait complete. 2023-09-30T13:58:23.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.726+0000 7f8998dce640 1 Processor -- start 2023-09-30T13:58:23.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.726+0000 7f8998dce640 1 -- start start 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 0x7f89941efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 0x7f89940c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89941eff60 con 0x7f89940c8c90 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940ae0d0 con 0x7f89941598c0 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940ae3b0 con 0x7f89940cf140 2023-09-30T13:58:23.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50434/0 (socket says 172.21.15.62:50434) 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 -- 172.21.15.62:0/873170472 learned_addr learned my addr 172.21.15.62:0/873170472 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8992d9d640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 0x7f89940c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 -- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 msgr2=0x7f89941efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f898bfff640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 0x7f89941efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 0x7f89941efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 -- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 msgr2=0x7f89940c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 0x7f89940c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 -- 172.21.15.62:0/873170472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0094d0 con 0x7f89940c8c90 2023-09-30T13:58:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8992d9d640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 0x7f89940c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f898bfff640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 0x7f89941efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f899259c640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f898400c430 tx=0x7f898400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840074e0 con 0x7f89940c8c90 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984007640 con 0x7f89940c8c90 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940ae690 con 0x7f89940c8c90 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840059e0 con 0x7f89940c8c90 2023-09-30T13:58:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.727+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89940aec50 con 0x7f89940c8c90 2023-09-30T13:58:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.728+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940b2290 con 0x7f89940c8c90 2023-09-30T13:58:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.729+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8984005c00 con 0x7f89940c8c90 2023-09-30T13:58:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.729+0000 7f898affd640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 0x7f897406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.729+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f89840885e0 con 0x7f89940c8c90 2023-09-30T13:58:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.729+0000 7f898bfff640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 0x7f897406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.730+0000 7f898bfff640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 0x7f897406cff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f897c036000 tx=0x7f897c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.733+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f89940b2290 con 0x7f89940c8c90 2023-09-30T13:58:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.909+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89940b2290 con 0x7f89940c8c90 2023-09-30T13:58:23.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.910+0000 7f898affd640 1 -- 172.21.15.62:0/873170472 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13167 (secure 0 0 0) 0x7f89940b2290 con 0x7f89940c8c90 2023-09-30T13:58:23.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:23.910 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":57,"fsid":"79595c1b-6895-4c76-9183-336503666b5b","created":"2023-09-30T13:54:25.570715+0000","modified":"2023-09-30T13:58:19.545929+0000","last_up_change":"2023-09-30T13:54:36.824984+0000","last_in_change":"2023-09-30T13:54:27.751928+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T13:54:37.728674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1617d48e-c996-463c-bf1d-b5e3659642dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6814","nonce":1670179498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6819","nonce":1670179498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6823","nonce":1670179498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":1670179498},{"type":"v1","addr":"172.21.15.62:6821","nonce":1670179498}]},"public_addr":"172.21.15.62:6814/1670179498","cluster_addr":"172.21.15.62:6819/1670179498","heartbeat_back_addr":"172.21.15.62:6823/1670179498","heartbeat_front_addr":"172.21.15.62:6821/1670179498","state":["exists","up"]},{"osd":1,"uuid":"7334acb9-dd02-4c65-968a-e6f3eb5aa1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6801","nonce":2839251162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6803","nonce":2839251162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6807","nonce":2839251162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2839251162},{"type":"v1","addr":"172.21.15.62:6805","nonce":2839251162}]},"public_addr":"172.21.15.62:6801/2839251162","cluster_addr":"172.21.15.62:6803/2839251162","heartbeat_back_addr":"172.21.15.62:6807/2839251162","heartbeat_front_addr":"172.21.15.62:6805/2839251162","state":["exists","up"]},{"osd":2,"uuid":"22a78843-494d-4097-8a92-4b60a70d2e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6809","nonce":756004547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6811","nonce":756004547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6818","nonce":756004547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":756004547},{"type":"v1","addr":"172.21.15.62:6815","nonce":756004547}]},"public_addr":"172.21.15.62:6809/756004547","cluster_addr":"172.21.15.62:6811/756004547","heartbeat_back_addr":"172.21.15.62:6818/756004547","heartbeat_front_addr":"172.21.15.62:6815/756004547","state":["exists","up"]},{"osd":3,"uuid":"d564f1bb-203e-4a74-880d-8c49d7874e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6825","nonce":3656322715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6827","nonce":3656322715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6831","nonce":3656322715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3656322715},{"type":"v1","addr":"172.21.15.62:6829","nonce":3656322715}]},"public_addr":"172.21.15.62:6825/3656322715","cluster_addr":"172.21.15.62:6827/3656322715","heartbeat_back_addr":"172.21.15.62:6831/3656322715","heartbeat_front_addr":"172.21.15.62:6829/3656322715","state":["exists","up"]},{"osd":4,"uuid":"4e515b4c-a3ad-4a04-b5e7-e57c25760faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6825","nonce":2988495300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6827","nonce":2988495300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6831","nonce":2988495300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2988495300},{"type":"v1","addr":"172.21.15.135:6829","nonce":2988495300}]},"public_addr":"172.21.15.135:6825/2988495300","cluster_addr":"172.21.15.135:6827/2988495300","heartbeat_back_addr":"172.21.15.135:6831/2988495300","heartbeat_front_addr":"172.21.15.135:6829/2988495300","state":["exists","up"]},{"osd":5,"uuid":"5dc9c737-1e11-4d7e-933d-a5d65ec69066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6809","nonce":2369531037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6811","nonce":2369531037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6815","nonce":2369531037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2369531037},{"type":"v1","addr":"172.21.15.135:6813","nonce":2369531037}]},"public_addr":"172.21.15.135:6809/2369531037","cluster_addr":"172.21.15.135:6811/2369531037","heartbeat_back_addr":"172.21.15.135:6815/2369531037","heartbeat_front_addr":"172.21.15.135:6813/2369531037","state":["exists","up"]},{"osd":6,"uuid":"79d2784a-c063-4416-88b3-a4cb20a9e6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6801","nonce":3317239655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6803","nonce":3317239655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6807","nonce":3317239655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3317239655},{"type":"v1","addr":"172.21.15.135:6805","nonce":3317239655}]},"public_addr":"172.21.15.135:6801/3317239655","cluster_addr":"172.21.15.135:6803/3317239655","heartbeat_back_addr":"172.21.15.135:6807/3317239655","heartbeat_front_addr":"172.21.15.135:6805/3317239655","state":["exists","up"]},{"osd":7,"uuid":"cb2eb449-13b3-444b-886a-170adee249e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6817","nonce":53145653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6819","nonce":53145653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6823","nonce":53145653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":53145653},{"type":"v1","addr":"172.21.15.135:6821","nonce":53145653}]},"public_addr":"172.21.15.135:6817/53145653","cluster_addr":"172.21.15.135:6819/53145653","heartbeat_back_addr":"172.21.15.135:6823/53145653","heartbeat_front_addr":"172.21.15.135:6821/53145653","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.892743+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.813858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.879440+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.930536+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.943583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.956860+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.902938+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T13:54:32.957523+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6836/126973186":"2023-10-01T13:58:16.438062+0000","172.21.15.135:6834/126973186":"2023-10-01T13:58:16.438062+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T13:58:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 msgr2=0x7f897406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 0x7f897406cff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f897c036000 tx=0x7f897c03b040 comp rx=0 tx=0).stop 2023-09-30T13:58:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 msgr2=0x7f89940b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:23.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f898400c430 tx=0x7f898400c8f0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 shutdown_connections 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f897406ab30 0x7f897406cff0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89941598c0 0x7f89940c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f89940cf140 0x7f89941efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 --2- 172.21.15.62:0/873170472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89940c8c90 0x7f89940b0900 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 >> 172.21.15.62:0/873170472 conn(0x7f899406a170 msgr2=0x7f899406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 shutdown_connections 2023-09-30T13:58:23.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:23.912+0000 7f8998dce640 1 -- 172.21.15.62:0/873170472 wait complete. 2023-09-30T13:58:24.924 INFO:tasks.ceph:Scrubbing osd.0 2023-09-30T13:58:24.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:25.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.048+0000 7f604fd78640 1 Processor -- start 2023-09-30T13:58:25.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.048+0000 7f604fd78640 1 -- start start 2023-09-30T13:58:25.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604fd78640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 0x7f604806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604fd78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604fd78640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604806c3d0 con 0x7f6048069d50 2023-09-30T13:58:25.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604fd78640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604806e1b0 con 0x7f604806d890 2023-09-30T13:58:25.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604fd78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604815d810 con 0x7f6048065a20 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604db14640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 0x7f604806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:60518/0 (socket says 172.21.15.62:60518) 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604e315640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6048069d50 0x7f604806c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:47082/0 (socket says 172.21.15.62:47082) 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 -- 172.21.15.62:0/2593634235 learned_addr learned my addr 172.21.15.62:0/2593634235 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604db14640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 0x7f604806dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:40032/0 (socket says 172.21.15.62:40032) 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 -- 172.21.15.62:0/2593634235 >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 msgr2=0x7f604806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:25.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 --2- 172.21.15.62:0/2593634235 >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 0x7f604806dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 -- 172.21.15.62:0/2593634235 >> v1:172.21.15.135:6789/0 conn(0x7f6048069d50 legacy=0x7f604806c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.049+0000 7f604d313640 1 -- 172.21.15.62:0/2593634235 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604815daf0 con 0x7f6048065a20 2023-09-30T13:58:25.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.050+0000 7f604d313640 1 --2- 172.21.15.62:0/2593634235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6038009870 tx=0x7f603802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363e1383f1eeeb18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.050+0000 7f604cb12640 1 -- 172.21.15.62:0/2593634235 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603802f840 con 0x7f6048065a20 2023-09-30T13:58:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.050+0000 7f604cb12640 1 -- 172.21.15.62:0/2593634235 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603802f9a0 con 0x7f6048065a20 2023-09-30T13:58:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.050+0000 7f604cb12640 1 -- 172.21.15.62:0/2593634235 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603802fd30 con 0x7f6048065a20 2023-09-30T13:58:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 -- 172.21.15.62:0/2593634235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 msgr2=0x7f604815cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 --2- 172.21.15.62:0/2593634235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6038009870 tx=0x7f603802ba20 comp rx=0 tx=0).stop 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 -- 172.21.15.62:0/2593634235 shutdown_connections 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 --2- 172.21.15.62:0/2593634235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048065a20 0x7f604815cf30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 --2- 172.21.15.62:0/2593634235 >> v2:172.21.15.135:3300/0 conn(0x7f604806d890 0x7f604806dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 -- 172.21.15.62:0/2593634235 >> 172.21.15.62:0/2593634235 conn(0x7f60480b0790 msgr2=0x7f60480b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 -- 172.21.15.62:0/2593634235 shutdown_connections 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.051+0000 7f604fd78640 1 -- 172.21.15.62:0/2593634235 wait complete. 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.052+0000 7f604fd78640 1 Processor -- start 2023-09-30T13:58:25.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.052+0000 7f604fd78640 1 -- start start 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6048065a20 0x7f60481f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048069d50 0x7f60480afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 0x7f60481f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604814e6c0 con 0x7f604806d890 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60481f6740 con 0x7f6048065a20 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604fd78640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c7190 con 0x7f6048069d50 2023-09-30T13:58:25.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604e315640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 0x7f60481f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604db14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6048065a20 0x7f60481f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604d313640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048069d50 0x7f60480afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604e315640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 0x7f60481f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50444/0 (socket says 172.21.15.62:50444) 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.053+0000 7f604e315640 1 -- 172.21.15.62:0/461212956 learned_addr learned my addr 172.21.15.62:0/461212956 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 -- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6048065a20 msgr2=0x7f60481f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6048065a20 0x7f60481f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 -- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 msgr2=0x7f60481f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 0x7f60481f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380094d0 con 0x7f6048069d50 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604e315640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f604806d890 0x7f60481f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604d313640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048069d50 0x7f60480afe30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6038033000 tx=0x7f6038004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038041400 con 0x7f6048069d50 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380415a0 con 0x7f6048069d50 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604809e3b0 con 0x7f6048069d50 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038041950 con 0x7f6048069d50 2023-09-30T13:58:25.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.054+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604809e970 con 0x7f6048069d50 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.055+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f604815e0b0 con 0x7f6048069d50 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6038041ab0 con 0x7f6048069d50 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f602c06ab30 0x7f602c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f603803c070 con 0x7f6048069d50 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f602c070e30 0x7f602c073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f604db14640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f602c06ab30 0x7f602c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f602c073940 con 0x7f602c070e30 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60380ac9e0 con 0x7f6048069d50 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.056+0000 7f604e315640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f602c070e30 0x7f602c073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.057+0000 7f604e315640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f602c070e30 0x7f602c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.057+0000 7f604db14640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f602c06ab30 0x7f602c06cff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6044009b40 tx=0x7f6044009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.057+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== osd.0 v2:172.21.15.62:6812/1670179498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f602c073940 con 0x7f602c070e30 2023-09-30T13:58:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 --> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f604815ddd0 con 0x7f602c070e30 2023-09-30T13:58:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f603e7fc640 1 -- 172.21.15.62:0/461212956 <== osd.0 v2:172.21.15.62:6812/1670179498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6040004e20 con 0x7f602c070e30 2023-09-30T13:58:25.071 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:25.071 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:25.071 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:25.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f602c070e30 msgr2=0x7f602c073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.62:6812/1670179498,v1:172.21.15.62:6814/1670179498] conn(0x7f602c070e30 0x7f602c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f602c06ab30 msgr2=0x7f602c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f602c06ab30 0x7f602c06cff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6044009b40 tx=0x7f6044009190 comp rx=0 tx=0).stop 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048069d50 msgr2=0x7f60480afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 --2- 172.21.15.62:0/461212956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6048069d50 0x7f60480afe30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6038033000 tx=0x7f6038004730 comp rx=0 tx=0).stop 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604e315640 1 -- 172.21.15.62:0/461212956 reap_dead start 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 shutdown_connections 2023-09-30T13:58:25.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 >> 172.21.15.62:0/461212956 conn(0x7f60480b0790 msgr2=0x7f604815e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 shutdown_connections 2023-09-30T13:58:25.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.071+0000 7f604fd78640 1 -- 172.21.15.62:0/461212956 wait complete. 2023-09-30T13:58:25.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-30T13:58:25.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.189+0000 7fe4b2cc2640 1 Processor -- start 2023-09-30T13:58:25.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.189+0000 7fe4b2cc2640 1 -- start start 2023-09-30T13:58:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b2cc2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b2cc2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0ce300 con 0x7fe4ac1595e0 2023-09-30T13:58:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b2cc2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac071880 con 0x7fe4ac1599c0 2023-09-30T13:58:25.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b2cc2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac071b60 con 0x7fe4ac0b0670 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50458/0 (socket says 172.21.15.62:50458) 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 -- 172.21.15.62:0/1970032555 learned_addr learned my addr 172.21.15.62:0/1970032555 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 -- 172.21.15.62:0/1970032555 >> v1:172.21.15.135:6789/0 conn(0x7fe4ac1599c0 legacy=0x7fe4ac0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 -- 172.21.15.62:0/1970032555 >> v1:172.21.15.62:6789/0 conn(0x7fe4ac1595e0 legacy=0x7fe4ac0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4b125f640 1 -- 172.21.15.62:0/1970032555 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac071e40 con 0x7fe4ac0b0670 2023-09-30T13:58:25.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.190+0000 7fe4ab7fe640 1 -- 172.21.15.62:0/1970032555 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948938125 0 0) 0x7fe4ac0ce300 con 0x7fe4ac1595e0 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.191+0000 7fe4b125f640 1 --2- 172.21.15.62:0/1970032555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400d150 tx=0x7fe4a402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50abc14c35911d50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.191+0000 7fe4ab7fe640 1 -- 172.21.15.62:0/1970032555 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a402ea80 con 0x7fe4ac0b0670 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.191+0000 7fe4ab7fe640 1 -- 172.21.15.62:0/1970032555 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a402ebe0 con 0x7fe4ac0b0670 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.191+0000 7fe4ab7fe640 1 -- 172.21.15.62:0/1970032555 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4009600 con 0x7fe4ac0b0670 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/1970032555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 msgr2=0x7fe4ac0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/1970032555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400d150 tx=0x7fe4a402e0e0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/1970032555 shutdown_connections 2023-09-30T13:58:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/1970032555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0c8b30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/1970032555 >> 172.21.15.62:0/1970032555 conn(0x7fe4ac06a430 msgr2=0x7fe4ac06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/1970032555 shutdown_connections 2023-09-30T13:58:25.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.192+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/1970032555 wait complete. 2023-09-30T13:58:25.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.193+0000 7fe4b2cc2640 1 Processor -- start 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.193+0000 7fe4b2cc2640 1 -- start start 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ac1595e0 0x7fe4ac0ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4ac1599c0 0x7fe4ac0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac145ae0 con 0x7fe4ac0b0670 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac145dc0 con 0x7fe4ac1595e0 2023-09-30T13:58:25.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b2cc2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1460a0 con 0x7fe4ac1599c0 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50470/0 (socket says 172.21.15.62:50470) 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 -- 172.21.15.62:0/357002551 learned_addr learned my addr 172.21.15.62:0/357002551 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4abfff640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ac1595e0 0x7fe4ac0ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b125f640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4ac1599c0 0x7fe4ac0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 -- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4ac1599c0 msgr2=0x7fe4ac0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4ac1599c0 0x7fe4ac0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 -- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ac1595e0 msgr2=0x7fe4ac0ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ac1595e0 0x7fe4ac0ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 -- 172.21.15.62:0/357002551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a400bd40 con 0x7fe4ac0b0670 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.194+0000 7fe4b0a5e640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c3c0 tx=0x7fe4a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.195+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00035f0 con 0x7fe4ac0b0670 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.195+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0003770 con 0x7fe4ac0b0670 2023-09-30T13:58:25.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.195+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac146380 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.195+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0003b20 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.195+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac0c76c0 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.196+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac073e70 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.196+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fe4a0003c80 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.196+0000 7fe4a97fa640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 0x7fe49006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.197+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe4a00884c0 con 0x7fe4ac0b0670 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.197+0000 7fe4abfff640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 0x7fe49006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.197+0000 7fe4abfff640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 0x7fe49006cff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0ccea0 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.201+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fe4a0053a10 con 0x7fe4ac0b0670 2023-09-30T13:58:25.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.376+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4ac072120 con 0x7fe49006ab30 2023-09-30T13:58:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.376+0000 7fe4a97fa640 1 -- 172.21.15.62:0/357002551 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4980014a0 con 0x7fe49006ab30 2023-09-30T13:58:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 msgr2=0x7fe49006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 0x7fe49006cff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0ccea0 tx=0x7fe498009040 comp rx=0 tx=0).stop 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 msgr2=0x7fe4ac0af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c3c0 tx=0x7fe4a000c880 comp rx=0 tx=0).stop 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 shutdown_connections 2023-09-30T13:58:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fe49006ab30 0x7fe49006cff0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4ac1599c0 0x7fe4ac0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ac1595e0 0x7fe4ac0ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 --2- 172.21.15.62:0/357002551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4ac0b0670 0x7fe4ac0af340 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 >> 172.21.15.62:0/357002551 conn(0x7fe4ac06a430 msgr2=0x7fe4ac06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 shutdown_connections 2023-09-30T13:58:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.378+0000 7fe4b2cc2640 1 -- 172.21.15.62:0/357002551 wait complete. 2023-09-30T13:58:25.388 INFO:tasks.ceph:Scrubbing osd.1 2023-09-30T13:58:25.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:25.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.499+0000 7fc36cf8e640 1 Processor -- start 2023-09-30T13:58:25.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.499+0000 7fc36cf8e640 1 -- start start 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36cf8e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc368159770 0x7fc368159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36cf8e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36815dee0 0x7fc3680ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36cf8e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36815d2f0 con 0x7fc3680cc020 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36cf8e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36815a090 con 0x7fc368159770 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36cf8e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680cdd40 con 0x7fc36815dee0 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc368159770 0x7fc368159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc35ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc3680cc020 0x7fc36815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53770/0 (socket says 172.21.15.62:53770) 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc35ffff640 1 -- 172.21.15.62:0/3955353485 learned_addr learned my addr 172.21.15.62:0/3955353485 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc366d9d640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36815dee0 0x7fc3680ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36659c640 1 -- 172.21.15.62:0/3955353485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36815dee0 msgr2=0x7fc3680ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36659c640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36815dee0 0x7fc3680ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36659c640 1 -- 172.21.15.62:0/3955353485 >> v1:172.21.15.62:6789/0 conn(0x7fc3680cc020 legacy=0x7fc36815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc365d9b640 1 -- 172.21.15.62:0/3955353485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485923690 0 0) 0x7fc36815d2f0 con 0x7fc3680cc020 2023-09-30T13:58:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.500+0000 7fc36659c640 1 -- 172.21.15.62:0/3955353485 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36815a270 con 0x7fc368159770 2023-09-30T13:58:25.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.501+0000 7fc36659c640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc368159770 0x7fc368159b50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097a0 tx=0x7fc35802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4ffb58fabfa1af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.501+0000 7fc365d9b640 1 -- 172.21.15.62:0/3955353485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358031830 con 0x7fc368159770 2023-09-30T13:58:25.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.501+0000 7fc365d9b640 1 -- 172.21.15.62:0/3955353485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358031990 con 0x7fc368159770 2023-09-30T13:58:25.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.501+0000 7fc365d9b640 1 -- 172.21.15.62:0/3955353485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358031d20 con 0x7fc368159770 2023-09-30T13:58:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 -- 172.21.15.62:0/3955353485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc368159770 msgr2=0x7fc368159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc368159770 0x7fc368159b50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097a0 tx=0x7fc35802b8d0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 -- 172.21.15.62:0/3955353485 shutdown_connections 2023-09-30T13:58:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36815dee0 0x7fc3680ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/3955353485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc368159770 0x7fc368159b50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 -- 172.21.15.62:0/3955353485 >> 172.21.15.62:0/3955353485 conn(0x7fc36806a3b0 msgr2=0x7fc3680affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 -- 172.21.15.62:0/3955353485 shutdown_connections 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.502+0000 7fc36cf8e640 1 -- 172.21.15.62:0/3955353485 wait complete. 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.503+0000 7fc36cf8e640 1 Processor -- start 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.503+0000 7fc36cf8e640 1 -- start start 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3680cc020 0x7fc368158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc368159770 0x7fc3680ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 0x7fc3680ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c9540 con 0x7fc36815dee0 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681643a0 con 0x7fc368159770 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36cf8e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c8f80 con 0x7fc3680cc020 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 0x7fc3680ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 0x7fc3680ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50486/0 (socket says 172.21.15.62:50486) 2023-09-30T13:58:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 -- 172.21.15.62:0/251285624 learned_addr learned my addr 172.21.15.62:0/251285624 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc36659c640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3680cc020 0x7fc368158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc35ffff640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc368159770 0x7fc3680ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 -- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3680cc020 msgr2=0x7fc368158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3680cc020 0x7fc368158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 -- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc368159770 msgr2=0x7fc3680ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc368159770 0x7fc3680ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc366d9d640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009400 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.504+0000 7fc35ffff640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc368159770 0x7fc3680ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc366d9d640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 0x7fc3680ae7a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc36000efc0 tx=0x7fc36000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360014480 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000f040 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680c9260 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360014820 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.505+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680c3890 con 0x7fc36815dee0 2023-09-30T13:58:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.506+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc36815a830 con 0x7fc36815dee0 2023-09-30T13:58:25.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.506+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc360014980 con 0x7fc36815dee0 2023-09-30T13:58:25.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35effd640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc34806ab30 0x7fc34806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc36008a850 con 0x7fc36815dee0 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35effd640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fc348070e30 0x7fc348073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc348073940 con 0x7fc348070e30 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc36659c640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc34806ab30 0x7fc34806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36008abc0 con 0x7fc36815dee0 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35ffff640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fc348070e30 0x7fc348073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc35ffff640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fc348070e30 0x7fc348073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.507+0000 7fc36659c640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc34806ab30 0x7fc34806cff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc358036000 tx=0x7fc35803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.508+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== osd.1 v2:172.21.15.62:6800/2839251162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc348073940 con 0x7fc348070e30 2023-09-30T13:58:25.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 --> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc36815a550 con 0x7fc348070e30 2023-09-30T13:58:25.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc35effd640 1 -- 172.21.15.62:0/251285624 <== osd.1 v2:172.21.15.62:6800/2839251162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc3500047e0 con 0x7fc348070e30 2023-09-30T13:58:25.521 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:25.521 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:25.522 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fc348070e30 msgr2=0x7fc348073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:6800/2839251162,v1:172.21.15.62:6801/2839251162] conn(0x7fc348070e30 0x7fc348073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc34806ab30 msgr2=0x7fc34806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc34806ab30 0x7fc34806cff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc358036000 tx=0x7fc35803d040 comp rx=0 tx=0).stop 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 msgr2=0x7fc3680ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 --2- 172.21.15.62:0/251285624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc36815dee0 0x7fc3680ae7a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc36000efc0 tx=0x7fc36000c490 comp rx=0 tx=0).stop 2023-09-30T13:58:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc366d9d640 1 -- 172.21.15.62:0/251285624 reap_dead start 2023-09-30T13:58:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 shutdown_connections 2023-09-30T13:58:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.521+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 >> 172.21.15.62:0/251285624 conn(0x7fc36806a3b0 msgr2=0x7fc3680af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.522+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 shutdown_connections 2023-09-30T13:58:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.522+0000 7fc36cf8e640 1 -- 172.21.15.62:0/251285624 wait complete. 2023-09-30T13:58:25.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-30T13:58:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.639+0000 7f88f4aaf640 1 Processor -- start 2023-09-30T13:58:25.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.639+0000 7f88f4aaf640 1 -- start start 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88f4aaf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88f0160160 0x7f88f00d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88f4aaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88f4aaf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f00cda60 con 0x7f88f00b5cd0 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88f4aaf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f00d18a0 con 0x7f88f0160160 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88f4aaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0160540 con 0x7f88f00d3600 2023-09-30T13:58:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.640+0000 7f88edd9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88f0160160 0x7f88f00d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88eed9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f88f00b5cd0 0x7f88f00cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.62:47092/0 (socket says 172.21.15.62:47092) 2023-09-30T13:58:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88edd9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:60568/0 (socket says 172.21.15.62:60568) 2023-09-30T13:58:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88f0160160 0x7f88f00d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:40060/0 (socket says 172.21.15.62:40060) 2023-09-30T13:58:25.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88eed9d640 1 -- 172.21.15.62:0/7152250 learned_addr learned my addr 172.21.15.62:0/7152250 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 -- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 msgr2=0x7f88f00b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 -- 172.21.15.62:0/7152250 >> v1:172.21.15.135:6789/0 conn(0x7f88f00b5cd0 legacy=0x7f88f00cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88ee59c640 1 -- 172.21.15.62:0/7152250 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00cd450 con 0x7f88f0160160 2023-09-30T13:58:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.641+0000 7f88edd9b640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88ee59c640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f00d30c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097a0 tx=0x7f88e802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b6b5c50dd488d61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88ed59a640 1 -- 172.21.15.62:0/7152250 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8030800 con 0x7f88f0160160 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88ed59a640 1 -- 172.21.15.62:0/7152250 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8030960 con 0x7f88f0160160 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88ed59a640 1 -- 172.21.15.62:0/7152250 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8030cf0 con 0x7f88f0160160 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 -- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 msgr2=0x7f88f00d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f00d30c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097a0 tx=0x7f88e802b940 comp rx=0 tx=0).stop 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 -- 172.21.15.62:0/7152250 shutdown_connections 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00d3600 0x7f88f00b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/7152250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f00d30c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 -- 172.21.15.62:0/7152250 >> 172.21.15.62:0/7152250 conn(0x7f88f0089fe0 msgr2=0x7f88f00d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 -- 172.21.15.62:0/7152250 shutdown_connections 2023-09-30T13:58:25.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.642+0000 7f88f4aaf640 1 -- 172.21.15.62:0/7152250 wait complete. 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 Processor -- start 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 -- start start 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 0x7f88f0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00cbc30 con 0x7f88f00d3600 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00cb060 con 0x7f88f0160160 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.644+0000 7f88f4aaf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00cb300 con 0x7f88f00b5cd0 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88edd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88edd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50488/0 (socket says 172.21.15.62:50488) 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 0x7f88f0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88edd9b640 1 -- 172.21.15.62:0/3323890453 learned_addr learned my addr 172.21.15.62:0/3323890453 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88eed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 -- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 msgr2=0x7f88f006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 -- 172.21.15.62:0/3323890453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 msgr2=0x7f88f00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 -- 172.21.15.62:0/3323890453 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009400 con 0x7f88f00b5cd0 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88edd9b640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T13:58:25.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88ee59c640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 0x7f88f0154cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f88e8033000 tx=0x7f88e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e803e070 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8039a10 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8039da0 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8009400 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.645+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00cb8c0 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.646+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0073e70 con 0x7f88f00b5cd0 2023-09-30T13:58:25.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.647+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f88e804a3f0 con 0x7f88f00b5cd0 2023-09-30T13:58:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.647+0000 7f88e6ffd640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 0x7f88d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.647+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f88e80aa990 con 0x7f88f00b5cd0 2023-09-30T13:58:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.647+0000 7f88edd9b640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 0x7f88d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.648+0000 7f88edd9b640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 0x7f88d006cff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f88f015c0b0 tx=0x7f88d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.652+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f88e8075d30 con 0x7f88f00b5cd0 2023-09-30T13:58:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.827+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f00d15c0 con 0x7f88d006ab30 2023-09-30T13:58:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.828+0000 7f88e6ffd640 1 -- 172.21.15.62:0/3323890453 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88d8014440 con 0x7f88d006ab30 2023-09-30T13:58:25.828 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2023-09-30T13:58:25.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 msgr2=0x7f88d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 0x7f88d006cff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f88f015c0b0 tx=0x7f88d8009190 comp rx=0 tx=0).stop 2023-09-30T13:58:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 msgr2=0x7f88f0154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 0x7f88f0154cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f88e8033000 tx=0x7f88e80046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 shutdown_connections 2023-09-30T13:58:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f88d006ab30 0x7f88d006cff0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88f0160160 0x7f88f006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88f00d3600 0x7f88f00cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 --2- 172.21.15.62:0/3323890453 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f00b5cd0 0x7f88f0154cb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.829+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 >> 172.21.15.62:0/3323890453 conn(0x7f88f0089fe0 msgr2=0x7f88f00cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.830+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 shutdown_connections 2023-09-30T13:58:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.830+0000 7f88f4aaf640 1 -- 172.21.15.62:0/3323890453 wait complete. 2023-09-30T13:58:25.840 INFO:tasks.ceph:Scrubbing osd.2 2023-09-30T13:58:25.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:25.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.951+0000 7f4342051640 1 Processor -- start 2023-09-30T13:58:25.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.951+0000 7f4342051640 1 -- start start 2023-09-30T13:58:25.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f4342051640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f433c159b50 0x7f433c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f4342051640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15a000 con 0x7f433c15dd10 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f4342051640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15e120 con 0x7f433c159770 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f4342051640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c15d2f0 con 0x7f433c159b50 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f433c15dd10 0x7f433c0ca6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53780/0 (socket says 172.21.15.62:53780) 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433bfff640 1 -- 172.21.15.62:0/208211975 learned_addr learned my addr 172.21.15.62:0/208211975 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433affd640 1 --2- 172.21.15.62:0/208211975 >> v2:172.21.15.135:3300/0 conn(0x7f433c159b50 0x7f433c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930018104 0 0) 0x7f433c15a000 con 0x7f433c15dd10 2023-09-30T13:58:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4324005730 con 0x7f433c15dd10 2023-09-30T13:58:25.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23788915 0 0) 0x7f433c15e120 con 0x7f433c159770 2023-09-30T13:58:25.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c15a000 con 0x7f433c159770 2023-09-30T13:58:25.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433affd640 1 -- 172.21.15.62:0/208211975 >> v1:172.21.15.135:6789/0 conn(0x7f433c159770 legacy=0x7f433c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.952+0000 7f433affd640 1 -- 172.21.15.62:0/208211975 >> v1:172.21.15.62:6789/0 conn(0x7f433c15dd10 legacy=0x7f433c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.953+0000 7f433affd640 1 -- 172.21.15.62:0/208211975 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0cc730 con 0x7f433c159b50 2023-09-30T13:58:25.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.953+0000 7f433affd640 1 --2- 172.21.15.62:0/208211975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159b50 0x7f433c15d7d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f43300097a0 tx=0x7f433002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98811ac02638f57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330030610 con 0x7f433c159b50 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330030770 con 0x7f433c159b50 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f433a7fc640 1 -- 172.21.15.62:0/208211975 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330030ae0 con 0x7f433c159b50 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 -- 172.21.15.62:0/208211975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159b50 msgr2=0x7f433c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 --2- 172.21.15.62:0/208211975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159b50 0x7f433c15d7d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f43300097a0 tx=0x7f433002b960 comp rx=0 tx=0).stop 2023-09-30T13:58:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 -- 172.21.15.62:0/208211975 shutdown_connections 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 --2- 172.21.15.62:0/208211975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159b50 0x7f433c15d7d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 -- 172.21.15.62:0/208211975 >> 172.21.15.62:0/208211975 conn(0x7f433c06a3b0 msgr2=0x7f433c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 -- 172.21.15.62:0/208211975 shutdown_connections 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.954+0000 7f4342051640 1 -- 172.21.15.62:0/208211975 wait complete. 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.955+0000 7f4342051640 1 Processor -- start 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.955+0000 7f4342051640 1 -- start start 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159770 0x7f433c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433c159b50 0x7f433c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 0x7f433c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0c9c00 con 0x7f433c15dd10 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1589f0 con 0x7f433c159770 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f4342051640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0c8ff0 con 0x7f433c159b50 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f433bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 0x7f433c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f433bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 0x7f433c15aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50494/0 (socket says 172.21.15.62:50494) 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f433bfff640 1 -- 172.21.15.62:0/2261397901 learned_addr learned my addr 172.21.15.62:0/2261397901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f433b7fe640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159770 0x7f433c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.956+0000 7f433affd640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433c159b50 0x7f433c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 -- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433c159b50 msgr2=0x7f433c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f433c159b50 0x7f433c0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 -- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159770 msgr2=0x7f433c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f433c159770 0x7f433c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009400 con 0x7f433c15dd10 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f433bfff640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 0x7f433c15aa70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f433400cbc0 tx=0x7f433400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400ad40 con 0x7f433c15dd10 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334012400 con 0x7f433c15dd10 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c0c92d0 con 0x7f433c15dd10 2023-09-30T13:58:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400aea0 con 0x7f433c15dd10 2023-09-30T13:58:25.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.957+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c0c9890 con 0x7f433c15dd10 2023-09-30T13:58:25.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.958+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f433c15a270 con 0x7f433c15dd10 2023-09-30T13:58:25.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.958+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f4334007070 con 0x7f433c15dd10 2023-09-30T13:58:25.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f4323fff640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f432806ab30 0x7f432806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4334088ef0 con 0x7f433c15dd10 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f4323fff640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7f4328070e30 0x7f4328073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4328073940 con 0x7f4328070e30 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f433408b5b0 con 0x7f433c15dd10 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f433b7fe640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f432806ab30 0x7f432806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f433affd640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7f4328070e30 0x7f4328073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f433affd640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7f4328070e30 0x7f4328073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.959+0000 7f433b7fe640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f432806ab30 0x7f432806cff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f432c0011e0 tx=0x7f432c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:25.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.960+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== osd.2 v2:172.21.15.62:6808/756004547 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4328073940 con 0x7f4328070e30 2023-09-30T13:58:25.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 --> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f433c0cdd40 con 0x7f4328070e30 2023-09-30T13:58:25.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4323fff640 1 -- 172.21.15.62:0/2261397901 <== osd.2 v2:172.21.15.62:6808/756004547 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f43300308e0 con 0x7f4328070e30 2023-09-30T13:58:25.973 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:25.973 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:25.973 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:25.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7f4328070e30 msgr2=0x7f4328073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:6808/756004547,v1:172.21.15.62:6809/756004547] conn(0x7f4328070e30 0x7f4328073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:25.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f432806ab30 msgr2=0x7f432806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f432806ab30 0x7f432806cff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f432c0011e0 tx=0x7f432c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 msgr2=0x7f433c15aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 --2- 172.21.15.62:0/2261397901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c15dd10 0x7f433c15aa70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f433400cbc0 tx=0x7f433400a430 comp rx=0 tx=0).stop 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f433bfff640 1 -- 172.21.15.62:0/2261397901 reap_dead start 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 shutdown_connections 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 >> 172.21.15.62:0/2261397901 conn(0x7f433c06a3b0 msgr2=0x7f433c0af700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:25.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 shutdown_connections 2023-09-30T13:58:25.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:25.973+0000 7f4342051640 1 -- 172.21.15.62:0/2261397901 wait complete. 2023-09-30T13:58:25.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-30T13:58:26.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.090+0000 7f6910ef2640 1 Processor -- start 2023-09-30T13:58:26.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.090+0000 7f6910ef2640 1 -- start start 2023-09-30T13:58:26.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f6910ef2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 0x7f690c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f6910ef2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0ce300 con 0x7f690c071310 2023-09-30T13:58:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f6910ef2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c071880 con 0x7f690c1595e0 2023-09-30T13:58:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f6910ef2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c071b60 con 0x7f690c1599c0 2023-09-30T13:58:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f690ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f690c071310 0x7f690c0aff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53794/0 (socket says 172.21.15.62:53794) 2023-09-30T13:58:26.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f690ad9d640 1 -- 172.21.15.62:0/3501460545 learned_addr learned my addr 172.21.15.62:0/3501460545 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:26.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.091+0000 7f6909d9b640 1 --2- 172.21.15.62:0/3501460545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 0x7f690c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862790435 0 0) 0x7f690c0ce300 con 0x7f690c071310 2023-09-30T13:58:26.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f8003520 con 0x7f690c071310 2023-09-30T13:58:26.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633264049 0 0) 0x7f690c071880 con 0x7f690c1595e0 2023-09-30T13:58:26.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f690c0ce300 con 0x7f690c1595e0 2023-09-30T13:58:26.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490552823 0 0) 0x7f68f8003520 con 0x7f690c071310 2023-09-30T13:58:26.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f6909d9b640 1 -- 172.21.15.62:0/3501460545 >> v1:172.21.15.135:6789/0 conn(0x7f690c1595e0 legacy=0x7f690c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f6909d9b640 1 -- 172.21.15.62:0/3501460545 >> v1:172.21.15.62:6789/0 conn(0x7f690c071310 legacy=0x7f690c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.092+0000 7f6909d9b640 1 -- 172.21.15.62:0/3501460545 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c071e40 con 0x7f690c1599c0 2023-09-30T13:58:26.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6909d9b640 1 --2- 172.21.15.62:0/3501460545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 0x7f690c0c8b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097d0 tx=0x7f68f402b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51d6cc3e92d8a38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0019f0 con 0x7f690c1599c0 2023-09-30T13:58:26.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f402e050 con 0x7f690c1599c0 2023-09-30T13:58:26.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f690959a640 1 -- 172.21.15.62:0/3501460545 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4030730 con 0x7f690c1599c0 2023-09-30T13:58:26.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6910ef2640 1 -- 172.21.15.62:0/3501460545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 msgr2=0x7f690c0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6910ef2640 1 --2- 172.21.15.62:0/3501460545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 0x7f690c0c8b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097d0 tx=0x7f68f402b6e0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6910ef2640 1 -- 172.21.15.62:0/3501460545 shutdown_connections 2023-09-30T13:58:26.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6910ef2640 1 --2- 172.21.15.62:0/3501460545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1599c0 0x7f690c0c8b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.093+0000 7f6910ef2640 1 -- 172.21.15.62:0/3501460545 >> 172.21.15.62:0/3501460545 conn(0x7f690c06a430 msgr2=0x7f690c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.094+0000 7f6910ef2640 1 -- 172.21.15.62:0/3501460545 shutdown_connections 2023-09-30T13:58:26.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.094+0000 7f6910ef2640 1 -- 172.21.15.62:0/3501460545 wait complete. 2023-09-30T13:58:26.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.095+0000 7f6910ef2640 1 Processor -- start 2023-09-30T13:58:26.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.095+0000 7f6910ef2640 1 -- start start 2023-09-30T13:58:26.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.095+0000 7f6910ef2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1595e0 0x7f690c0c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f690c1599c0 0x7f690c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c151050 con 0x7f690c071310 2023-09-30T13:58:26.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0c48c0 con 0x7f690c1599c0 2023-09-30T13:58:26.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0c3cb0 con 0x7f690c1595e0 2023-09-30T13:58:26.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50506/0 (socket says 172.21.15.62:50506) 2023-09-30T13:58:26.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 -- 172.21.15.62:0/2653216803 learned_addr learned my addr 172.21.15.62:0/2653216803 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6909d9b640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1595e0 0x7f690c0c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690ad9d640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f690c1599c0 0x7f690c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 -- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1595e0 msgr2=0x7f690c0c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1595e0 0x7f690c0c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 -- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f690c1599c0 msgr2=0x7f690c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f690c1599c0 0x7f690c0c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 -- 172.21.15.62:0/2653216803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009400 con 0x7f690c071310 2023-09-30T13:58:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f690a59c640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f690400c430 tx=0x7f690400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040052d0 con 0x7f690c071310 2023-09-30T13:58:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904005450 con 0x7f690c071310 2023-09-30T13:58:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904003830 con 0x7f690c071310 2023-09-30T13:58:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c0c3f90 con 0x7f690c071310 2023-09-30T13:58:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.096+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0c4550 con 0x7f690c071310 2023-09-30T13:58:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.097+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0c46e0 con 0x7f690c071310 2023-09-30T13:58:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.098+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6904003990 con 0x7f690c071310 2023-09-30T13:58:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.098+0000 7f6902ffd640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 0x7f68ec06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.098+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6904088590 con 0x7f690c071310 2023-09-30T13:58:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.099+0000 7f6909d9b640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 0x7f68ec06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.099+0000 7f6909d9b640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 0x7f68ec06cff0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.103+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f6904053a50 con 0x7f690c071310 2023-09-30T13:58:26.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.279+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f690c0b3e10 con 0x7f68ec06ab30 2023-09-30T13:58:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.279+0000 7f6902ffd640 1 -- 172.21.15.62:0/2653216803 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f690c0b3e10 con 0x7f68ec06ab30 2023-09-30T13:58:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2023-09-30T13:58:26.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 msgr2=0x7f68ec06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 0x7f68ec06cff0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f4008030 comp rx=0 tx=0).stop 2023-09-30T13:58:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 msgr2=0x7f690c150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f690400c430 tx=0x7f690400c8f0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 shutdown_connections 2023-09-30T13:58:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f68ec06ab30 0x7f68ec06cff0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f690c1599c0 0x7f690c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f690c1595e0 0x7f690c0c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 --2- 172.21.15.62:0/2653216803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f690c071310 0x7f690c150b10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 >> 172.21.15.62:0/2653216803 conn(0x7f690c06a430 msgr2=0x7f690c15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 shutdown_connections 2023-09-30T13:58:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.282+0000 7f6910ef2640 1 -- 172.21.15.62:0/2653216803 wait complete. 2023-09-30T13:58:26.292 INFO:tasks.ceph:Scrubbing osd.3 2023-09-30T13:58:26.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:26.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.403+0000 7facf96bb640 1 Processor -- start 2023-09-30T13:58:26.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.403+0000 7facf96bb640 1 -- start start 2023-09-30T13:58:26.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.403+0000 7facf96bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf96bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facf40c8aa0 0x7facf40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf96bb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf415e540 con 0x7facf415ad20 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf96bb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf4155200 con 0x7facf40c8aa0 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf96bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40b4280 con 0x7facf4070590 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facf40c8aa0 0x7facf40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7facf40c8aa0 0x7facf40c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50508/0 (socket says 172.21.15.62:50508) 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facebfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7facf415ad20 0x7facf415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53798/0 (socket says 172.21.15.62:53798) 2023-09-30T13:58:26.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 -- 172.21.15.62:0/477067813 learned_addr learned my addr 172.21.15.62:0/477067813 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf2ffd640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 -- 172.21.15.62:0/477067813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 msgr2=0x7facf4070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 -- 172.21.15.62:0/477067813 >> v1:172.21.15.62:6789/0 conn(0x7facf415ad20 legacy=0x7facf415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf37fe640 1 -- 172.21.15.62:0/477067813 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf415b1a0 con 0x7facf40c8aa0 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf27fc640 1 -- 172.21.15.62:0/477067813 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331589420 0 0) 0x7facf415e540 con 0x7facf415ad20 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.404+0000 7facf2ffd640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf37fe640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf40c8f30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7facec009e50 tx=0x7facec02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d26a869158f8c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf27fc640 1 -- 172.21.15.62:0/477067813 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec02cb00 con 0x7facf40c8aa0 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf27fc640 1 -- 172.21.15.62:0/477067813 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec02cc60 con 0x7facf40c8aa0 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf27fc640 1 -- 172.21.15.62:0/477067813 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0343f0 con 0x7facf40c8aa0 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf96bb640 1 -- 172.21.15.62:0/477067813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 msgr2=0x7facf40c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.405+0000 7facf96bb640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf40c8f30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7facec009e50 tx=0x7facec02bf60 comp rx=0 tx=0).stop 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 -- 172.21.15.62:0/477067813 shutdown_connections 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf40c8f30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 --2- 172.21.15.62:0/477067813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 -- 172.21.15.62:0/477067813 >> 172.21.15.62:0/477067813 conn(0x7facf406a3b0 msgr2=0x7facf40affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 -- 172.21.15.62:0/477067813 shutdown_connections 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.406+0000 7facf96bb640 1 -- 172.21.15.62:0/477067813 wait complete. 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 Processor -- start 2023-09-30T13:58:26.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 -- start start 2023-09-30T13:58:26.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf415ad20 0x7facf4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40c4ba0 con 0x7facf40c8aa0 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4152e70 con 0x7facf415ad20 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.407+0000 7facf96bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4155f30 con 0x7facf4070590 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf41532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50510/0 (socket says 172.21.15.62:50510) 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 -- 172.21.15.62:0/1611250461 learned_addr learned my addr 172.21.15.62:0/1611250461 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facf2ffd640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 -- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 msgr2=0x7facf4152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf4070590 0x7facf4152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 -- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf415ad20 msgr2=0x7facf4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facf37fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf415ad20 0x7facf4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf415ad20 0x7facf4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009b30 con 0x7facf40c8aa0 2023-09-30T13:58:26.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facf37fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf415ad20 0x7facf4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:26.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facebfff640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf41532c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c430 tx=0x7facdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0074e0 con 0x7facf40c8aa0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc007660 con 0x7facf40c8aa0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc004a20 con 0x7facf40c8aa0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf4156210 con 0x7facf40c8aa0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.408+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf41567d0 con 0x7facf40c8aa0 2023-09-30T13:58:26.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.409+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facf415b730 con 0x7facf40c8aa0 2023-09-30T13:58:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7facdc004b80 con 0x7facf40c8aa0 2023-09-30T13:58:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7facdc088ef0 con 0x7facf40c8aa0 2023-09-30T13:58:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7facd4070e30 0x7facd4073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facd4073940 con 0x7facd4070e30 2023-09-30T13:58:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7facdc08b5b0 con 0x7facf40c8aa0 2023-09-30T13:58:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7facf2ffd640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.410+0000 7facf37fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7facd4070e30 0x7facd4073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.411+0000 7facf37fe640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7facd4070e30 0x7facd4073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.411+0000 7facf2ffd640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7face4006fd0 tx=0x7face4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.411+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== osd.3 v2:172.21.15.62:6824/3656322715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7facd4073940 con 0x7facd4070e30 2023-09-30T13:58:26.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.424+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 --> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7facf415b450 con 0x7facd4070e30 2023-09-30T13:58:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.424+0000 7faceb7fe640 1 -- 172.21.15.62:0/1611250461 <== osd.3 v2:172.21.15.62:6824/3656322715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7facec02cad0 con 0x7facd4070e30 2023-09-30T13:58:26.424 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:26.424 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:26.424 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.424+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7facd4070e30 msgr2=0x7facd4073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:6824/3656322715,v1:172.21.15.62:6825/3656322715] conn(0x7facd4070e30 0x7facd4073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 msgr2=0x7facd406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7facd406ab30 0x7facd406cff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7face4006fd0 tx=0x7face4008040 comp rx=0 tx=0).stop 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 msgr2=0x7facf41532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 --2- 172.21.15.62:0/1611250461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facf40c8aa0 0x7facf41532c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c430 tx=0x7facdc00c8f0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf37fe640 1 -- 172.21.15.62:0/1611250461 reap_dead start 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 shutdown_connections 2023-09-30T13:58:26.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 >> 172.21.15.62:0/1611250461 conn(0x7facf406a3b0 msgr2=0x7facf415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 shutdown_connections 2023-09-30T13:58:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.425+0000 7facf96bb640 1 -- 172.21.15.62:0/1611250461 wait complete. 2023-09-30T13:58:26.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-30T13:58:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.542+0000 7feb51fc9640 1 Processor -- start 2023-09-30T13:58:26.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.542+0000 7feb51fc9640 1 -- start start 2023-09-30T13:58:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb51fc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb4c15aaa0 0x7feb4c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb51fc9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0cd9b0 con 0x7feb4c065a20 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb51fc9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c15ae80 con 0x7feb4c0c2460 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb51fc9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c0ccda0 con 0x7feb4c15aaa0 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb4c15aaa0 0x7feb4c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feb4c065a20 0x7feb4c0cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53806/0 (socket says 172.21.15.62:53806) 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4bfff640 1 -- 172.21.15.62:0/797283568 learned_addr learned my addr 172.21.15.62:0/797283568 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4b7fe640 1 -- 172.21.15.62:0/797283568 >> v1:172.21.15.135:6789/0 conn(0x7feb4c0c2460 legacy=0x7feb4c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4b7fe640 1 -- 172.21.15.62:0/797283568 >> v1:172.21.15.62:6789/0 conn(0x7feb4c065a20 legacy=0x7feb4c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.543+0000 7feb4b7fe640 1 -- 172.21.15.62:0/797283568 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0cd080 con 0x7feb4c15aaa0 2023-09-30T13:58:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.544+0000 7feb4b7fe640 1 --2- 172.21.15.62:0/797283568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c0b1bb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097a0 tx=0x7feb3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327318c3faf22bb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.544+0000 7feb4a7fc640 1 -- 172.21.15.62:0/797283568 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c030610 con 0x7feb4c15aaa0 2023-09-30T13:58:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.544+0000 7feb4a7fc640 1 -- 172.21.15.62:0/797283568 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c030770 con 0x7feb4c15aaa0 2023-09-30T13:58:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.544+0000 7feb4a7fc640 1 -- 172.21.15.62:0/797283568 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c030b00 con 0x7feb4c15aaa0 2023-09-30T13:58:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 -- 172.21.15.62:0/797283568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 msgr2=0x7feb4c0b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 --2- 172.21.15.62:0/797283568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c0b1bb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097a0 tx=0x7feb3c02b960 comp rx=0 tx=0).stop 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 -- 172.21.15.62:0/797283568 shutdown_connections 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 --2- 172.21.15.62:0/797283568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c0b1bb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 -- 172.21.15.62:0/797283568 >> 172.21.15.62:0/797283568 conn(0x7feb4c0b0850 msgr2=0x7feb4c0b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 -- 172.21.15.62:0/797283568 shutdown_connections 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.545+0000 7feb51fc9640 1 -- 172.21.15.62:0/797283568 wait complete. 2023-09-30T13:58:26.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.546+0000 7feb51fc9640 1 Processor -- start 2023-09-30T13:58:26.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.546+0000 7feb51fc9640 1 -- start start 2023-09-30T13:58:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 0x7feb4c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 0x7feb4c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0c54d0 con 0x7feb4c15aaa0 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0c4850 con 0x7feb4c065a20 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb51fc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0c4b30 con 0x7feb4c0c2460 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50528/0 (socket says 172.21.15.62:50528) 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb4bfff640 1 -- 172.21.15.62:0/980490561 learned_addr learned my addr 172.21.15.62:0/980490561 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb4b7fe640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 0x7feb4c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.547+0000 7feb4affd640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 0x7feb4c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 -- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 msgr2=0x7feb4c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 0x7feb4c156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 -- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 msgr2=0x7feb4c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 0x7feb4c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 -- 172.21.15.62:0/980490561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009400 con 0x7feb4c15aaa0 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4affd640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 0x7feb4c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4b7fe640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 0x7feb4c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:26.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb4bfff640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feb4400ca80 tx=0x7feb4400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400ac30 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400ad90 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0c4e10 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44012600 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.548+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c15d200 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.549+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c0c5610 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.549+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7feb44007070 con 0x7feb4c15aaa0 2023-09-30T13:58:26.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.550+0000 7feb33fff640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 0x7feb3806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.550+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7feb44088da0 con 0x7feb4c15aaa0 2023-09-30T13:58:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.550+0000 7feb4b7fe640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 0x7feb3806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.551+0000 7feb4b7fe640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 0x7feb3806cff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feb3c036000 tx=0x7feb3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.554+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7feb4c0c5610 con 0x7feb4c15aaa0 2023-09-30T13:58:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.730+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7feb4c0cd640 con 0x7feb3806ab30 2023-09-30T13:58:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.730+0000 7feb33fff640 1 -- 172.21.15.62:0/980490561 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb3c030a60 con 0x7feb3806ab30 2023-09-30T13:58:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2023-09-30T13:58:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 msgr2=0x7feb3806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 0x7feb3806cff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feb3c036000 tx=0x7feb3c008030 comp rx=0 tx=0).stop 2023-09-30T13:58:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 msgr2=0x7feb4c15ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feb4400ca80 tx=0x7feb4400cf40 comp rx=0 tx=0).stop 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 shutdown_connections 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7feb3806ab30 0x7feb3806cff0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb4c15aaa0 0x7feb4c15ccc0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb4c0c2460 0x7feb4c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 --2- 172.21.15.62:0/980490561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c065a20 0x7feb4c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 >> 172.21.15.62:0/980490561 conn(0x7feb4c0b0850 msgr2=0x7feb4c0ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.732+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 shutdown_connections 2023-09-30T13:58:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.733+0000 7feb51fc9640 1 -- 172.21.15.62:0/980490561 wait complete. 2023-09-30T13:58:26.743 INFO:tasks.ceph:Scrubbing osd.4 2023-09-30T13:58:26.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:26.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.854+0000 7f6163c26640 1 Processor -- start 2023-09-30T13:58:26.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.854+0000 7f6163c26640 1 -- start start 2023-09-30T13:58:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f6163c26640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f615c065a20 0x7f615c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f6163c26640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c069d50 0x7f615c06c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f6163c26640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c06c3d0 con 0x7f615c06d890 2023-09-30T13:58:26.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f6163c26640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c15d810 con 0x7f615c065a20 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f6163c26640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c15daf0 con 0x7f615c069d50 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61611c1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f615c065a20 0x7f615c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61619c2640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f615c06d890 0x7f615c06dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53808/0 (socket says 172.21.15.62:53808) 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61619c2640 1 -- 172.21.15.62:0/3577805891 learned_addr learned my addr 172.21.15.62:0/3577805891 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61621c3640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c069d50 0x7f615c06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61611c1640 1 -- 172.21.15.62:0/3577805891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c069d50 msgr2=0x7f615c06c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61611c1640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c069d50 0x7f615c06c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61611c1640 1 -- 172.21.15.62:0/3577805891 >> v1:172.21.15.62:6789/0 conn(0x7f615c06d890 legacy=0x7f615c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61611c1640 1 -- 172.21.15.62:0/3577805891 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c15ddd0 con 0x7f615c065a20 2023-09-30T13:58:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.855+0000 7f61609c0640 1 -- 172.21.15.62:0/3577805891 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439720077 0 0) 0x7f615c06c3d0 con 0x7f615c06d890 2023-09-30T13:58:26.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.856+0000 7f61611c1640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c065a20 0x7f615c15cf30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f671e01c829d2caa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.856+0000 7f61609c0640 1 -- 172.21.15.62:0/3577805891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c030610 con 0x7f615c065a20 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.856+0000 7f61609c0640 1 -- 172.21.15.62:0/3577805891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c030770 con 0x7f615c065a20 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.856+0000 7f61609c0640 1 -- 172.21.15.62:0/3577805891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c030b00 con 0x7f615c065a20 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 -- 172.21.15.62:0/3577805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c065a20 msgr2=0x7f615c15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c065a20 0x7f615c15cf30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c02b960 comp rx=0 tx=0).stop 2023-09-30T13:58:26.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 -- 172.21.15.62:0/3577805891 shutdown_connections 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c069d50 0x7f615c06c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 --2- 172.21.15.62:0/3577805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c065a20 0x7f615c15cf30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 -- 172.21.15.62:0/3577805891 >> 172.21.15.62:0/3577805891 conn(0x7f615c0b0790 msgr2=0x7f615c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 -- 172.21.15.62:0/3577805891 shutdown_connections 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.857+0000 7f6163c26640 1 -- 172.21.15.62:0/3577805891 wait complete. 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.858+0000 7f6163c26640 1 Processor -- start 2023-09-30T13:58:26.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.858+0000 7f6163c26640 1 -- start start 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c065a20 0x7f615c09f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c069d50 0x7f615c0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 0x7f615c1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0b04b0 con 0x7f615c06d890 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c09e340 con 0x7f615c069d50 2023-09-30T13:58:26.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f6163c26640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c09e620 con 0x7f615c065a20 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 0x7f615c1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 0x7f615c1f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50544/0 (socket says 172.21.15.62:50544) 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 -- 172.21.15.62:0/326090638 learned_addr learned my addr 172.21.15.62:0/326090638 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61619c2640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c065a20 0x7f615c09f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61611c1640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c069d50 0x7f615c0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 -- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c065a20 msgr2=0x7f615c09f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c065a20 0x7f615c09f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 -- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c069d50 msgr2=0x7f615c0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c069d50 0x7f615c0c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009400 con 0x7f615c06d890 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61619c2640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f615c065a20 0x7f615c09f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61611c1640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c069d50 0x7f615c0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.859+0000 7f61621c3640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 0x7f615c1f57d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6154007e60 tx=0x7f615400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154014420 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540145a0 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c09e900 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154014950 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c09eec0 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.860+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f615c0b1600 con 0x7f615c06d890 2023-09-30T13:58:26.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.861+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f6154014ab0 con 0x7f615c06d890 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.861+0000 7f61527fc640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f614006ab30 0x7f614006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6154089990 con 0x7f615c06d890 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61527fc640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f6140070e30 0x7f6140073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6140073940 con 0x7f6140070e30 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f615408e2c0 con 0x7f615c06d890 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61619c2640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f614006ab30 0x7f614006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61611c1640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f6140070e30 0x7f6140073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61611c1640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f6140070e30 0x7f6140073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.862+0000 7f61619c2640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f614006ab30 0x7f614006cff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6158000f60 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.863+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== osd.4 v2:172.21.15.135:6824/2988495300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6140073940 con 0x7f6140070e30 2023-09-30T13:58:26.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.876+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 --> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f615c15e0b0 con 0x7f6140070e30 2023-09-30T13:58:26.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f61527fc640 1 -- 172.21.15.62:0/326090638 <== osd.4 v2:172.21.15.135:6824/2988495300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f614c004040 con 0x7f6140070e30 2023-09-30T13:58:26.876 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:26.877 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:26.877 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f6140070e30 msgr2=0x7f6140073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6824/2988495300,v1:172.21.15.135:6825/2988495300] conn(0x7f6140070e30 0x7f6140073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f614006ab30 msgr2=0x7f614006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f614006ab30 0x7f614006cff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6158000f60 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-09-30T13:58:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 msgr2=0x7f615c1f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 --2- 172.21.15.62:0/326090638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c06d890 0x7f615c1f57d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6154007e60 tx=0x7f615400e4b0 comp rx=0 tx=0).stop 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f61621c3640 1 -- 172.21.15.62:0/326090638 reap_dead start 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 shutdown_connections 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 >> 172.21.15.62:0/326090638 conn(0x7f615c0b0790 msgr2=0x7f615c15ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 shutdown_connections 2023-09-30T13:58:26.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.877+0000 7f6163c26640 1 -- 172.21.15.62:0/326090638 wait complete. 2023-09-30T13:58:26.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-30T13:58:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.994+0000 7fbe2d656640 1 Processor -- start 2023-09-30T13:58:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.994+0000 7fbe2d656640 1 -- start start 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe2d656640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe28160160 0x7fbe280d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe2d656640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe2d656640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe280cda60 con 0x7fbe280b5cd0 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe2d656640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe280d18a0 con 0x7fbe28160160 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe2d656640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe28160540 con 0x7fbe280d3600 2023-09-30T13:58:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe26ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe28160160 0x7fbe280d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe277fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbe280b5cd0 0x7fbe280cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53822/0 (socket says 172.21.15.62:53822) 2023-09-30T13:58:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe277fe640 1 -- 172.21.15.62:0/307794419 learned_addr learned my addr 172.21.15.62:0/307794419 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.995+0000 7fbe26ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe28160160 0x7fbe280d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50556/0 (socket says 172.21.15.62:50556) 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe267fc640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe26ffd640 1 -- 172.21.15.62:0/307794419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 msgr2=0x7fbe280b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe26ffd640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe26ffd640 1 -- 172.21.15.62:0/307794419 >> v1:172.21.15.62:6789/0 conn(0x7fbe280b5cd0 legacy=0x7fbe280cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe26ffd640 1 -- 172.21.15.62:0/307794419 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280cd450 con 0x7fbe28160160 2023-09-30T13:58:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.996+0000 7fbe26ffd640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe28160160 0x7fbe280d30c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbe200097a0 tx=0x7fbe2002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13330feeae27042 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe25ffb640 1 -- 172.21.15.62:0/307794419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20030610 con 0x7fbe28160160 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe25ffb640 1 -- 172.21.15.62:0/307794419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20030770 con 0x7fbe28160160 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe25ffb640 1 -- 172.21.15.62:0/307794419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20030b00 con 0x7fbe28160160 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 -- 172.21.15.62:0/307794419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe28160160 msgr2=0x7fbe280d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe28160160 0x7fbe280d30c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbe200097a0 tx=0x7fbe2002b960 comp rx=0 tx=0).stop 2023-09-30T13:58:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 -- 172.21.15.62:0/307794419 shutdown_connections 2023-09-30T13:58:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 --2- 172.21.15.62:0/307794419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe28160160 0x7fbe280d30c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 -- 172.21.15.62:0/307794419 >> 172.21.15.62:0/307794419 conn(0x7fbe28089fe0 msgr2=0x7fbe280d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 -- 172.21.15.62:0/307794419 shutdown_connections 2023-09-30T13:58:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.997+0000 7fbe2d656640 1 -- 172.21.15.62:0/307794419 wait complete. 2023-09-30T13:58:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.998+0000 7fbe2d656640 1 Processor -- start 2023-09-30T13:58:27.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 -- start start 2023-09-30T13:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe28160160 0x7fbe2806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280cbc30 con 0x7fbe280b5cd0 2023-09-30T13:58:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280cb060 con 0x7fbe28160160 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe2d656640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280cb300 con 0x7fbe280d3600 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe26ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe26ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50564/0 (socket says 172.21.15.62:50564) 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe26ffd640 1 -- 172.21.15.62:0/3446058687 learned_addr learned my addr 172.21.15.62:0/3446058687 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe277fe640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe28160160 0x7fbe2806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:26.999+0000 7fbe267fc640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 -- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 msgr2=0x7fbe280cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 -- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe28160160 msgr2=0x7fbe2806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe28160160 0x7fbe2806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 -- 172.21.15.62:0/3446058687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe20009400 con 0x7fbe280b5cd0 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe26ffd640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fbe2002bf70 tx=0x7fbe200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2003e070 con 0x7fbe280b5cd0 2023-09-30T13:58:27.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20006e10 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe280cb5e0 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20039c30 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.000+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe281551f0 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.001+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe28073e70 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.001+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fbe200423f0 con 0x7fbe280b5cd0 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.002+0000 7fbe1f7fe640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 0x7fbe0806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.002+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbe200aaba0 con 0x7fbe280b5cd0 2023-09-30T13:58:27.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.002+0000 7fbe267fc640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 0x7fbe0806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.002+0000 7fbe267fc640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 0x7fbe0806cff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe2815c0b0 tx=0x7fbe10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.006+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fbe20076060 con 0x7fbe280b5cd0 2023-09-30T13:58:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.182+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe28155380 con 0x7fbe0806ab30 2023-09-30T13:58:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.183+0000 7fbe1f7fe640 1 -- 172.21.15.62:0/3446058687 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbe28155380 con 0x7fbe0806ab30 2023-09-30T13:58:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 4 to deep-scrub 2023-09-30T13:58:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 msgr2=0x7fbe0806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 0x7fbe0806cff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe2815c0b0 tx=0x7fbe10008040 comp rx=0 tx=0).stop 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 msgr2=0x7fbe28154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fbe2002bf70 tx=0x7fbe200046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 shutdown_connections 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fbe0806ab30 0x7fbe0806cff0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe28160160 0x7fbe2806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe280d3600 0x7fbe280cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 --2- 172.21.15.62:0/3446058687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe280b5cd0 0x7fbe28154cb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 >> 172.21.15.62:0/3446058687 conn(0x7fbe28089fe0 msgr2=0x7fbe280cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 shutdown_connections 2023-09-30T13:58:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.185+0000 7fbe2d656640 1 -- 172.21.15.62:0/3446058687 wait complete. 2023-09-30T13:58:27.195 INFO:tasks.ceph:Scrubbing osd.5 2023-09-30T13:58:27.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:27.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.305+0000 7ff6fc0de640 1 Processor -- start 2023-09-30T13:58:27.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.305+0000 7ff6fc0de640 1 -- start start 2023-09-30T13:58:27.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fc0de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff6f415cca0 0x7ff6f40d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fc0de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40b20c0 0x7ff6f40cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fc0de640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40d31a0 con 0x7ff6f40cf970 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fc0de640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40cdf60 con 0x7ff6f415cca0 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fc0de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40cdc80 con 0x7ff6f40b20c0 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fa67b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6f40cf970 0x7ff6f4160610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53824/0 (socket says 172.21.15.62:53824) 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6fa67b640 1 -- 172.21.15.62:0/60150277 learned_addr learned my addr 172.21.15.62:0/60150277 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.306+0000 7ff6f9679640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40b20c0 0x7ff6f40cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/60150277 >> v2:172.21.15.135:3300/0 conn(0x7ff6f415cca0 0x7ff6f40d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f8e78640 1 -- 172.21.15.62:0/60150277 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038250918 0 0) 0x7ff6f40d31a0 con 0x7ff6f40cf970 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f8e78640 1 -- 172.21.15.62:0/60150277 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc003520 con 0x7ff6f40cf970 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f9e7a640 1 -- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40b20c0 msgr2=0x7ff6f40cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40b20c0 0x7ff6f40cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f9e7a640 1 -- 172.21.15.62:0/60150277 >> v1:172.21.15.62:6789/0 conn(0x7ff6f40cf970 legacy=0x7ff6f4160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.307+0000 7ff6f9e7a640 1 -- 172.21.15.62:0/60150277 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40d2b50 con 0x7ff6f415cca0 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f415cca0 0x7ff6f40d3630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009d90 tx=0x7ff6e402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8996f22203c3624 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6f8e78640 1 -- 172.21.15.62:0/60150277 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402cbc0 con 0x7ff6f415cca0 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6f8e78640 1 -- 172.21.15.62:0/60150277 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e402cd20 con 0x7ff6f415cca0 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6f8e78640 1 -- 172.21.15.62:0/60150277 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4034640 con 0x7ff6f415cca0 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 -- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f415cca0 msgr2=0x7ff6f40d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f415cca0 0x7ff6f40d3630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009d90 tx=0x7ff6e402be10 comp rx=0 tx=0).stop 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 -- 172.21.15.62:0/60150277 shutdown_connections 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40b20c0 0x7ff6f40cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/60150277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f415cca0 0x7ff6f40d3630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.308+0000 7ff6fc0de640 1 -- 172.21.15.62:0/60150277 >> 172.21.15.62:0/60150277 conn(0x7ff6f4071660 msgr2=0x7ff6f4071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.309+0000 7ff6fc0de640 1 -- 172.21.15.62:0/60150277 shutdown_connections 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.309+0000 7ff6fc0de640 1 -- 172.21.15.62:0/60150277 wait complete. 2023-09-30T13:58:27.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 Processor -- start 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 -- start start 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f40b20c0 0x7ff6f40c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40cf970 0x7ff6f40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 0x7ff6f40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41459d0 con 0x7ff6f415cca0 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41f5ce0 con 0x7ff6f40b20c0 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fc0de640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4148d70 con 0x7ff6f40cf970 2023-09-30T13:58:27.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.310+0000 7ff6fa67b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 0x7ff6f40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 0x7ff6f40b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50576/0 (socket says 172.21.15.62:50576) 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 -- 172.21.15.62:0/1806747288 learned_addr learned my addr 172.21.15.62:0/1806747288 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f9679640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40cf970 0x7ff6f40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f40b20c0 0x7ff6f40c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 -- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40cf970 msgr2=0x7ff6f40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f40cf970 0x7ff6f40b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 -- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f40b20c0 msgr2=0x7ff6f40c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f40b20c0 0x7ff6f40c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009a70 con 0x7ff6f415cca0 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f40b20c0 0x7ff6f40c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fa67b640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 0x7ff6f40b3ca0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c3f0 tx=0x7ff6ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005ce0 con 0x7ff6f415cca0 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec005e40 con 0x7ff6f415cca0 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec007310 con 0x7ff6f415cca0 2023-09-30T13:58:27.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f41f53f0 con 0x7ff6f415cca0 2023-09-30T13:58:27.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.311+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f40ca130 con 0x7ff6f415cca0 2023-09-30T13:58:27.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.312+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6f40d2e30 con 0x7ff6f415cca0 2023-09-30T13:58:27.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff6ec007470 con 0x7ff6f415cca0 2023-09-30T13:58:27.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff6e006ab30 0x7ff6e006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff6ec088540 con 0x7ff6f415cca0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7ff6e0070e30 0x7ff6e0073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6e0073940 con 0x7ff6e0070e30 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6ec08ac00 con 0x7ff6f415cca0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.313+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff6e006ab30 0x7ff6e006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.314+0000 7ff6f9679640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7ff6e0070e30 0x7ff6e0073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.314+0000 7ff6f9e7a640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff6e006ab30 0x7ff6e006cff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4036000 tx=0x7ff6e4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.314+0000 7ff6f9679640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7ff6e0070e30 0x7ff6e0073270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.315+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== osd.5 v2:172.21.15.135:6808/2369531037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff6e0073940 con 0x7ff6e0070e30 2023-09-30T13:58:27.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.327+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 --> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6f41f5e50 con 0x7ff6e0070e30 2023-09-30T13:58:27.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6f27fc640 1 -- 172.21.15.62:0/1806747288 <== osd.5 v2:172.21.15.135:6808/2369531037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff6f41f5e50 con 0x7ff6e0070e30 2023-09-30T13:58:27.331 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:27.331 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:27.332 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:27.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7ff6e0070e30 msgr2=0x7ff6e0073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6808/2369531037,v1:172.21.15.135:6809/2369531037] conn(0x7ff6e0070e30 0x7ff6e0073270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff6e006ab30 msgr2=0x7ff6e006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff6e006ab30 0x7ff6e006cff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4036000 tx=0x7ff6e4030000 comp rx=0 tx=0).stop 2023-09-30T13:58:27.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 msgr2=0x7ff6f40b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 --2- 172.21.15.62:0/1806747288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6f415cca0 0x7ff6f40b3ca0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c3f0 tx=0x7ff6ec00c8b0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fa67b640 1 -- 172.21.15.62:0/1806747288 reap_dead start 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.328+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 shutdown_connections 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.329+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 >> 172.21.15.62:0/1806747288 conn(0x7ff6f4071660 msgr2=0x7ff6f40b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.329+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 shutdown_connections 2023-09-30T13:58:27.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.329+0000 7ff6fc0de640 1 -- 172.21.15.62:0/1806747288 wait complete. 2023-09-30T13:58:27.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-30T13:58:27.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.446+0000 7f8f3e644640 1 Processor -- start 2023-09-30T13:58:27.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.446+0000 7f8f3e644640 1 -- start start 2023-09-30T13:58:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f381568d0 0x7f8f380ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f38156cb0 0x7f8f380c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8f380ca070 0x7f8f380c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f38159890 con 0x7f8f38156cb0 2023-09-30T13:58:27.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f38159b70 con 0x7f8f380ca070 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3e644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38159e50 con 0x7f8f381568d0 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f38156cb0 0x7f8f380c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f38156cb0 0x7f8f380c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50580/0 (socket says 172.21.15.62:50580) 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 -- 172.21.15.62:0/3207203328 learned_addr learned my addr 172.21.15.62:0/3207203328 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f3cbe1640 1 --2- 172.21.15.62:0/3207203328 >> v2:172.21.15.135:3300/0 conn(0x7f8f380ca070 0x7f8f380c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f37fff640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f381568d0 0x7f8f380ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 -- 172.21.15.62:0/3207203328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f381568d0 msgr2=0x7f8f380ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f381568d0 0x7f8f380ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 -- 172.21.15.62:0/3207203328 >> v2:172.21.15.135:3300/0 conn(0x7f8f380ca070 msgr2=0x7f8f380c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 --2- 172.21.15.62:0/3207203328 >> v2:172.21.15.135:3300/0 conn(0x7f8f380ca070 0x7f8f380c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.447+0000 7f8f377fe640 1 -- 172.21.15.62:0/3207203328 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3815a130 con 0x7f8f38156cb0 2023-09-30T13:58:27.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.448+0000 7f8f377fe640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f38156cb0 0x7f8f380c9b30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8f38157110 tx=0x7f8f2c02da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1459a47fc1176387 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.448+0000 7f8f36ffd640 1 -- 172.21.15.62:0/3207203328 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c02f850 con 0x7f8f38156cb0 2023-09-30T13:58:27.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.448+0000 7f8f36ffd640 1 -- 172.21.15.62:0/3207203328 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c02f9b0 con 0x7f8f38156cb0 2023-09-30T13:58:27.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.448+0000 7f8f36ffd640 1 -- 172.21.15.62:0/3207203328 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c02fd40 con 0x7f8f38156cb0 2023-09-30T13:58:27.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 -- 172.21.15.62:0/3207203328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f38156cb0 msgr2=0x7f8f380c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f38156cb0 0x7f8f380c9b30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8f38157110 tx=0x7f8f2c02da90 comp rx=0 tx=0).stop 2023-09-30T13:58:27.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 -- 172.21.15.62:0/3207203328 shutdown_connections 2023-09-30T13:58:27.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 --2- 172.21.15.62:0/3207203328 >> v2:172.21.15.135:3300/0 conn(0x7f8f380ca070 0x7f8f380c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f38156cb0 0x7f8f380c9b30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 --2- 172.21.15.62:0/3207203328 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f381568d0 0x7f8f380ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 -- 172.21.15.62:0/3207203328 >> 172.21.15.62:0/3207203328 conn(0x7f8f3806a430 msgr2=0x7f8f3806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 -- 172.21.15.62:0/3207203328 shutdown_connections 2023-09-30T13:58:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.449+0000 7f8f3e644640 1 -- 172.21.15.62:0/3207203328 wait complete. 2023-09-30T13:58:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.450+0000 7f8f3e644640 1 Processor -- start 2023-09-30T13:58:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 -- start start 2023-09-30T13:58:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ca070 0x7f8f38071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f38156cb0 0x7f8f380acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380acaa0 con 0x7f8f381568d0 2023-09-30T13:58:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b2250 con 0x7f8f380ca070 2023-09-30T13:58:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f3e644640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b2530 con 0x7f8f38156cb0 2023-09-30T13:58:27.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50596/0 (socket says 172.21.15.62:50596) 2023-09-30T13:58:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.451+0000 7f8f377fe640 1 -- 172.21.15.62:0/1951499305 learned_addr learned my addr 172.21.15.62:0/1951499305 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f37fff640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ca070 0x7f8f38071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f3cbe1640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f38156cb0 0x7f8f380acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 -- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f38156cb0 msgr2=0x7f8f380acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f38156cb0 0x7f8f380acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 -- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ca070 msgr2=0x7f8f38071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ca070 0x7f8f38071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 -- 172.21.15.62:0/1951499305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0094d0 con 0x7f8f381568d0 2023-09-30T13:58:27.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f377fe640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c000c00 tx=0x7f8f2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c03d040 con 0x7f8f381568d0 2023-09-30T13:58:27.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c039890 con 0x7f8f381568d0 2023-09-30T13:58:27.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380b2810 con 0x7f8f381568d0 2023-09-30T13:58:27.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c039c40 con 0x7f8f381568d0 2023-09-30T13:58:27.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.452+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380c4dd0 con 0x7f8f381568d0 2023-09-30T13:58:27.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.453+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f38073e70 con 0x7f8f381568d0 2023-09-30T13:58:27.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.454+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f8f2c04c400 con 0x7f8f381568d0 2023-09-30T13:58:27.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.454+0000 7f8f34ff9640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 0x7f8f2406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.454+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8f2c034070 con 0x7f8f381568d0 2023-09-30T13:58:27.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.455+0000 7f8f37fff640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 0x7f8f2406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.455+0000 7f8f37fff640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 0x7f8f2406d020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009990 tx=0x7f8f28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.459+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f8f2c076920 con 0x7f8f381568d0 2023-09-30T13:58:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.634+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f3815a410 con 0x7f8f2406ab60 2023-09-30T13:58:27.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.635+0000 7f8f34ff9640 1 -- 172.21.15.62:0/1951499305 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f28010870 con 0x7f8f2406ab60 2023-09-30T13:58:27.634 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 5 to deep-scrub 2023-09-30T13:58:27.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 msgr2=0x7f8f2406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 0x7f8f2406d020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009990 tx=0x7f8f28008040 comp rx=0 tx=0).stop 2023-09-30T13:58:27.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 msgr2=0x7f8f38153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c000c00 tx=0x7f8f2c0046c0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 shutdown_connections 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f8f2406ab60 0x7f8f2406d020 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f38156cb0 0x7f8f380acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f381568d0 0x7f8f38153ad0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 --2- 172.21.15.62:0/1951499305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f380ca070 0x7f8f38071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 >> 172.21.15.62:0/1951499305 conn(0x7f8f3806a430 msgr2=0x7f8f3806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.636+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 shutdown_connections 2023-09-30T13:58:27.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.637+0000 7f8f3e644640 1 -- 172.21.15.62:0/1951499305 wait complete. 2023-09-30T13:58:27.647 INFO:tasks.ceph:Scrubbing osd.6 2023-09-30T13:58:27.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.757+0000 7f15410d4640 1 Processor -- start 2023-09-30T13:58:27.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 -- start start 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f153c0ce8e0 0x7f153c0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f153c0d0830 0x7f153c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c06b9a0 con 0x7f153c15ccb0 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0d1200 con 0x7f153c0d0830 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f15410d4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0ceda0 con 0x7f153c0ce8e0 2023-09-30T13:58:27.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.758+0000 7f153b59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f153c0d0830 0x7f153c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f153c0d0830 0x7f153c0d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47506/0 (socket says 172.21.15.62:47506) 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 -- 172.21.15.62:0/4264020495 learned_addr learned my addr 172.21.15.62:0/4264020495 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f1533fff640 1 --2- 172.21.15.62:0/4264020495 >> v2:172.21.15.135:3300/0 conn(0x7f153c0ce8e0 0x7f153c0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 -- 172.21.15.62:0/4264020495 >> v2:172.21.15.135:3300/0 conn(0x7f153c0ce8e0 msgr2=0x7f153c0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 --2- 172.21.15.62:0/4264020495 >> v2:172.21.15.135:3300/0 conn(0x7f153c0ce8e0 0x7f153c0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 -- 172.21.15.62:0/4264020495 >> v1:172.21.15.135:6789/0 conn(0x7f153c15ccb0 legacy=0x7f153c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.759+0000 7f153b59e640 1 -- 172.21.15.62:0/4264020495 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0cf080 con 0x7f153c0d0830 2023-09-30T13:58:27.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f153b59e640 1 --2- 172.21.15.62:0/4264020495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c0d0830 0x7f153c0d0cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f153c08b160 tx=0x7f153402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff2ef9c2cd7d22b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f153a59c640 1 -- 172.21.15.62:0/4264020495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153402cb20 con 0x7f153c0d0830 2023-09-30T13:58:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f153a59c640 1 -- 172.21.15.62:0/4264020495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153402cc80 con 0x7f153c0d0830 2023-09-30T13:58:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f153a59c640 1 -- 172.21.15.62:0/4264020495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15340343f0 con 0x7f153c0d0830 2023-09-30T13:58:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 -- 172.21.15.62:0/4264020495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c0d0830 msgr2=0x7f153c0d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 --2- 172.21.15.62:0/4264020495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c0d0830 0x7f153c0d0cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f153c08b160 tx=0x7f153402bf80 comp rx=0 tx=0).stop 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 -- 172.21.15.62:0/4264020495 shutdown_connections 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 --2- 172.21.15.62:0/4264020495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c0d0830 0x7f153c0d0cc0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 --2- 172.21.15.62:0/4264020495 >> v2:172.21.15.135:3300/0 conn(0x7f153c0ce8e0 0x7f153c0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 -- 172.21.15.62:0/4264020495 >> 172.21.15.62:0/4264020495 conn(0x7f153c089fe0 msgr2=0x7f153c099c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 -- 172.21.15.62:0/4264020495 shutdown_connections 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.760+0000 7f15410d4640 1 -- 172.21.15.62:0/4264020495 wait complete. 2023-09-30T13:58:27.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 Processor -- start 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 -- start start 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0ce8e0 0x7f153c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c0d0830 0x7f153c1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 0x7f153c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c6730 con 0x7f153c15ccb0 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c6a10 con 0x7f153c0d0830 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.762+0000 7f15410d4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c6cf0 con 0x7f153c0ce8e0 2023-09-30T13:58:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 0x7f153c148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 0x7f153c148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47518/0 (socket says 172.21.15.62:47518) 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 -- 172.21.15.62:0/1367131559 learned_addr learned my addr 172.21.15.62:0/1367131559 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153ad9d640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0ce8e0 0x7f153c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f1533fff640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c0d0830 0x7f153c1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 -- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0ce8e0 msgr2=0x7f153c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f153c0ce8e0 0x7f153c1f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 -- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c0d0830 msgr2=0x7f153c1f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f153c0d0830 0x7f153c1f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534009b30 con 0x7f153c15ccb0 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f153b59e640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 0x7f153c148a00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1534009f40 tx=0x7f1534004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534009510 con 0x7f153c15ccb0 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153403e450 con 0x7f153c15ccb0 2023-09-30T13:58:27.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0c6fd0 con 0x7f153c15ccb0 2023-09-30T13:58:27.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153403e800 con 0x7f153c15ccb0 2023-09-30T13:58:27.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.763+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c0c46b0 con 0x7f153c15ccb0 2023-09-30T13:58:27.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.764+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f153c0cf640 con 0x7f153c15ccb0 2023-09-30T13:58:27.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f153403e960 con 0x7f153c15ccb0 2023-09-30T13:58:27.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151c06ab30 0x7f151c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f15340abd80 con 0x7f153c15ccb0 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7f151c070e30 0x7f151c073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f151c073940 con 0x7f151c070e30 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15340b0030 con 0x7f153c15ccb0 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f153ad9d640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151c06ab30 0x7f151c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.765+0000 7f1533fff640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7f151c070e30 0x7f151c073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.766+0000 7f153ad9d640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151c06ab30 0x7f151c06cff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f152c0015f0 tx=0x7f152c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.766+0000 7f1533fff640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7f151c070e30 0x7f151c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.767+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== osd.6 v2:172.21.15.135:6800/3317239655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f151c073940 con 0x7f151c070e30 2023-09-30T13:58:27.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.779+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 --> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f153c0cf360 con 0x7f151c070e30 2023-09-30T13:58:27.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15337fe640 1 -- 172.21.15.62:0/1367131559 <== osd.6 v2:172.21.15.135:6800/3317239655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1524009120 con 0x7f151c070e30 2023-09-30T13:58:27.780 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:27.780 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:27.781 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:27.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7f151c070e30 msgr2=0x7f151c073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6800/3317239655,v1:172.21.15.135:6801/3317239655] conn(0x7f151c070e30 0x7f151c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151c06ab30 msgr2=0x7f151c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f151c06ab30 0x7f151c06cff0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f152c0015f0 tx=0x7f152c009040 comp rx=0 tx=0).stop 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 msgr2=0x7f153c148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 --2- 172.21.15.62:0/1367131559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f153c15ccb0 0x7f153c148a00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1534009f40 tx=0x7f1534004a40 comp rx=0 tx=0).stop 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f153b59e640 1 -- 172.21.15.62:0/1367131559 reap_dead start 2023-09-30T13:58:27.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 shutdown_connections 2023-09-30T13:58:27.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 >> 172.21.15.62:0/1367131559 conn(0x7f153c089fe0 msgr2=0x7f153c0b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 shutdown_connections 2023-09-30T13:58:27.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.780+0000 7f15410d4640 1 -- 172.21.15.62:0/1367131559 wait complete. 2023-09-30T13:58:27.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-30T13:58:27.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.898+0000 7ff9587b0640 1 Processor -- start 2023-09-30T13:58:27.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.898+0000 7ff9587b0640 1 -- start start 2023-09-30T13:58:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff9587b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff950160160 0x7ff9500d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff9587b0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff9500d3600 0x7ff9500b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff9587b0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9500cda60 con 0x7ff9500b5cd0 2023-09-30T13:58:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff9587b0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500d18a0 con 0x7ff950160160 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff9587b0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff950160540 con 0x7ff9500d3600 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff950160160 0x7ff9500d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff950160160 0x7ff9500d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47524/0 (socket says 172.21.15.62:47524) 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 -- 172.21.15.62:0/2736525158 learned_addr learned my addr 172.21.15.62:0/2736525158 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff955d4b640 1 --2- 172.21.15.62:0/2736525158 >> v2:172.21.15.135:3300/0 conn(0x7ff9500d3600 0x7ff9500b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 -- 172.21.15.62:0/2736525158 >> v2:172.21.15.135:3300/0 conn(0x7ff9500d3600 msgr2=0x7ff9500b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 --2- 172.21.15.62:0/2736525158 >> v2:172.21.15.135:3300/0 conn(0x7ff9500d3600 0x7ff9500b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 -- 172.21.15.62:0/2736525158 >> v1:172.21.15.135:6789/0 conn(0x7ff9500b5cd0 legacy=0x7ff9500cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.899+0000 7ff95654c640 1 -- 172.21.15.62:0/2736525158 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500cd450 con 0x7ff950160160 2023-09-30T13:58:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.900+0000 7ff95654c640 1 --2- 172.21.15.62:0/2736525158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff950160160 0x7ff9500d30c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff95008cc30 tx=0x7ff94802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ad7141831b43f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.900+0000 7ff95554a640 1 -- 172.21.15.62:0/2736525158 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94802cbb0 con 0x7ff950160160 2023-09-30T13:58:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.900+0000 7ff95554a640 1 -- 172.21.15.62:0/2736525158 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94802cd10 con 0x7ff950160160 2023-09-30T13:58:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.900+0000 7ff95554a640 1 -- 172.21.15.62:0/2736525158 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948034610 con 0x7ff950160160 2023-09-30T13:58:27.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 -- 172.21.15.62:0/2736525158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff950160160 msgr2=0x7ff9500d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 --2- 172.21.15.62:0/2736525158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff950160160 0x7ff9500d30c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff95008cc30 tx=0x7ff94802c010 comp rx=0 tx=0).stop 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 -- 172.21.15.62:0/2736525158 shutdown_connections 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 --2- 172.21.15.62:0/2736525158 >> v2:172.21.15.135:3300/0 conn(0x7ff9500d3600 0x7ff9500b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 --2- 172.21.15.62:0/2736525158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff950160160 0x7ff9500d30c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 -- 172.21.15.62:0/2736525158 >> 172.21.15.62:0/2736525158 conn(0x7ff950089fe0 msgr2=0x7ff9500d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 -- 172.21.15.62:0/2736525158 shutdown_connections 2023-09-30T13:58:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.901+0000 7ff9587b0640 1 -- 172.21.15.62:0/2736525158 wait complete. 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.902+0000 7ff9587b0640 1 Processor -- start 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.902+0000 7ff9587b0640 1 -- start start 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 0x7ff95006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 0x7ff95006c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501f2910 con 0x7ff9500b5cd0 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501f2bf0 con 0x7ff950160160 2023-09-30T13:58:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff9587b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501f2ed0 con 0x7ff9500d3600 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47540/0 (socket says 172.21.15.62:47540) 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 -- 172.21.15.62:0/3880909325 learned_addr learned my addr 172.21.15.62:0/3880909325 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff956d4d640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 0x7ff95006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff955d4b640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 0x7ff95006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 -- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 msgr2=0x7ff95006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 0x7ff95006c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 -- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 msgr2=0x7ff95006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 0x7ff95006c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 -- 172.21.15.62:0/3880909325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009b30 con 0x7ff9500b5cd0 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff955d4b640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 0x7ff95006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff956d4d640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 0x7ff95006c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff95654c640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff948000f80 tx=0x7ff948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.903+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948009510 con 0x7ff9500b5cd0 2023-09-30T13:58:27.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.904+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94803e450 con 0x7ff9500b5cd0 2023-09-30T13:58:27.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.904+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9501f31b0 con 0x7ff9500b5cd0 2023-09-30T13:58:27.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.904+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94803e800 con 0x7ff9500b5cd0 2023-09-30T13:58:27.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.904+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9500c9730 con 0x7ff9500b5cd0 2023-09-30T13:58:27.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.904+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950073e70 con 0x7ff9500b5cd0 2023-09-30T13:58:27.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.905+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7ff94803e960 con 0x7ff9500b5cd0 2023-09-30T13:58:27.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.905+0000 7ff94effd640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 0x7ff93c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:27.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.905+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff9480abe10 con 0x7ff9500b5cd0 2023-09-30T13:58:27.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.906+0000 7ff955d4b640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 0x7ff93c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:27.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.906+0000 7ff955d4b640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 0x7ff93c06cff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff95006cdd0 tx=0x7ff944008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:27.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:27.909+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7ff948077230 con 0x7ff9500b5cd0 2023-09-30T13:58:28.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.085+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9500d15c0 con 0x7ff93c06ab30 2023-09-30T13:58:28.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.086+0000 7ff94effd640 1 -- 172.21.15.62:0/3880909325 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff944004030 con 0x7ff93c06ab30 2023-09-30T13:58:28.086 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 6 to deep-scrub 2023-09-30T13:58:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 msgr2=0x7ff93c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 0x7ff93c06cff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff95006cdd0 tx=0x7ff944008040 comp rx=0 tx=0).stop 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 msgr2=0x7ff9500c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff948000f80 tx=0x7ff948004a40 comp rx=0 tx=0).stop 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 shutdown_connections 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7ff93c06ab30 0x7ff93c06cff0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950160160 0x7ff95006c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9500d3600 0x7ff95006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 --2- 172.21.15.62:0/3880909325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9500b5cd0 0x7ff9500c91f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 >> 172.21.15.62:0/3880909325 conn(0x7ff950089fe0 msgr2=0x7ff9500b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 shutdown_connections 2023-09-30T13:58:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.088+0000 7ff9587b0640 1 -- 172.21.15.62:0/3880909325 wait complete. 2023-09-30T13:58:28.098 INFO:tasks.ceph:Scrubbing osd.7 2023-09-30T13:58:28.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-30T13:58:28.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.209+0000 7fdad0161640 1 Processor -- start 2023-09-30T13:58:28.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.209+0000 7fdad0161640 1 -- start start 2023-09-30T13:58:28.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdad0161640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdac8159770 0x7fdac8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdad0161640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdac80cc020 0x7fdac815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdad0161640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac815d2f0 con 0x7fdac80cc4d0 2023-09-30T13:58:28.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdad0161640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac815a090 con 0x7fdac80cc020 2023-09-30T13:58:28.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdad0161640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80cdd40 con 0x7fdac8159770 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdac80cc020 0x7fdac815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdac80cc020 0x7fdac815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47548/0 (socket says 172.21.15.62:47548) 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 -- 172.21.15.62:0/3199213603 learned_addr learned my addr 172.21.15.62:0/3199213603 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacdefd640 1 --2- 172.21.15.62:0/3199213603 >> v2:172.21.15.135:3300/0 conn(0x7fdac8159770 0x7fdac8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 -- 172.21.15.62:0/3199213603 >> v2:172.21.15.135:3300/0 conn(0x7fdac8159770 msgr2=0x7fdac8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/3199213603 >> v2:172.21.15.135:3300/0 conn(0x7fdac8159770 0x7fdac8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 -- 172.21.15.62:0/3199213603 >> v1:172.21.15.135:6789/0 conn(0x7fdac80cc4d0 legacy=0x7fdac80c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.210+0000 7fdacd6fc640 1 -- 172.21.15.62:0/3199213603 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac815a270 con 0x7fdac80cc020 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.211+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/3199213603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac815d7d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdac80adee0 tx=0x7fdab802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a631b27bf8b5c382 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.211+0000 7fdaccefb640 1 -- 172.21.15.62:0/3199213603 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8031640 con 0x7fdac80cc020 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.211+0000 7fdaccefb640 1 -- 172.21.15.62:0/3199213603 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab80317a0 con 0x7fdac80cc020 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.211+0000 7fdaccefb640 1 -- 172.21.15.62:0/3199213603 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8031b30 con 0x7fdac80cc020 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 -- 172.21.15.62:0/3199213603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 msgr2=0x7fdac815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 --2- 172.21.15.62:0/3199213603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac815d7d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdac80adee0 tx=0x7fdab802b8f0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 -- 172.21.15.62:0/3199213603 shutdown_connections 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 --2- 172.21.15.62:0/3199213603 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac815d7d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 --2- 172.21.15.62:0/3199213603 >> v2:172.21.15.135:3300/0 conn(0x7fdac8159770 0x7fdac8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 -- 172.21.15.62:0/3199213603 >> 172.21.15.62:0/3199213603 conn(0x7fdac806a3b0 msgr2=0x7fdac80affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 -- 172.21.15.62:0/3199213603 shutdown_connections 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.212+0000 7fdad0161640 1 -- 172.21.15.62:0/3199213603 wait complete. 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.213+0000 7fdad0161640 1 Processor -- start 2023-09-30T13:58:28.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.213+0000 7fdad0161640 1 -- start start 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac81f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdac80cc4d0 0x7fdac80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdac8159770 0x7fdac81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c4350 con 0x7fdac80cc020 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c3740 con 0x7fdac8159770 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c3a20 con 0x7fdac80cc4d0 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac81f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac81f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47556/0 (socket says 172.21.15.62:47556) 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 -- 172.21.15.62:0/2525146499 learned_addr learned my addr 172.21.15.62:0/2525146499 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdac80cc4d0 0x7fdac80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdace6fe640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdac8159770 0x7fdac81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 -- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdac80cc4d0 msgr2=0x7fdac80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdac80cc4d0 0x7fdac80c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 -- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdac8159770 msgr2=0x7fdac81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdac8159770 0x7fdac81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80094d0 con 0x7fdac80cc020 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdac80cc4d0 0x7fdac80c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdace6fe640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdac8159770 0x7fdac81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdacdefd640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac81f1f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdac400d800 tx=0x7fdac400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400b6c0 con 0x7fdac80cc020 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400b820 con 0x7fdac80cc020 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400bbb0 con 0x7fdac80cc020 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.214+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac80c3d00 con 0x7fdac80cc020 2023-09-30T13:58:28.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.215+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac8152f00 con 0x7fdac80cc020 2023-09-30T13:58:28.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.215+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdac815a830 con 0x7fdac80cc020 2023-09-30T13:58:28.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.216+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fdac400bd10 con 0x7fdac80cc020 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.216+0000 7fdabe7fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdaac06ab60 0x7fdaac06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.216+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdac40895a0 con 0x7fdac80cc020 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdabe7fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fdaac070e60 0x7fdaac0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaac073970 con 0x7fdaac070e60 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdac408bc60 con 0x7fdac80cc020 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdaac06ab60 0x7fdaac06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdace6fe640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fdaac070e60 0x7fdaac0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdacd6fc640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdaac06ab60 0x7fdaac06d020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036000 tx=0x7fdab803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.217+0000 7fdace6fe640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fdaac070e60 0x7fdaac0732a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.218+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== osd.7 v2:172.21.15.135:6816/53145653 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdaac073970 con 0x7fdaac070e60 2023-09-30T13:58:28.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.231+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 --> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdac815a550 con 0x7fdaac070e60 2023-09-30T13:58:28.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.231+0000 7fdabe7fc640 1 -- 172.21.15.62:0/2525146499 <== osd.7 v2:172.21.15.135:6816/53145653 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdac0006b50 con 0x7fdaac070e60 2023-09-30T13:58:28.231 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-09-30T13:58:28.231 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T13:58:28.231 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-09-30T13:58:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fdaac070e60 msgr2=0x7fdaac0732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6816/53145653,v1:172.21.15.135:6817/53145653] conn(0x7fdaac070e60 0x7fdaac0732a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdaac06ab60 msgr2=0x7fdaac06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fdaac06ab60 0x7fdaac06d020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036000 tx=0x7fdab803c040 comp rx=0 tx=0).stop 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 msgr2=0x7fdac81f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 --2- 172.21.15.62:0/2525146499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdac80cc020 0x7fdac81f1f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdac400d800 tx=0x7fdac400dcc0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdace6fe640 1 -- 172.21.15.62:0/2525146499 reap_dead start 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 shutdown_connections 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 >> 172.21.15.62:0/2525146499 conn(0x7fdac806a3b0 msgr2=0x7fdac80b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 shutdown_connections 2023-09-30T13:58:28.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.232+0000 7fdad0161640 1 -- 172.21.15.62:0/2525146499 wait complete. 2023-09-30T13:58:28.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-30T13:58:28.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 Processor -- start 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 -- start start 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3bac0ce600 0x7f3bac0cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0cda60 con 0x7f3bac0b5790 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0d18a0 con 0x7f3bac160160 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.349+0000 7f3bb3090640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac160540 con 0x7f3bac0ce600 2023-09-30T13:58:28.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3bb162d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3bac0ce600 0x7f3bac0cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3babfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3bac0b5790 0x7f3bac0cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51514/0 (socket says 172.21.15.62:51514) 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3babfff640 1 -- 172.21.15.62:0/561427277 learned_addr learned my addr 172.21.15.62:0/561427277 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3bb162d640 1 -- 172.21.15.62:0/561427277 >> v1:172.21.15.135:6789/0 conn(0x7f3bac160160 legacy=0x7f3bac0d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3bb162d640 1 -- 172.21.15.62:0/561427277 >> v1:172.21.15.62:6789/0 conn(0x7f3bac0b5790 legacy=0x7f3bac0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3bb162d640 1 -- 172.21.15.62:0/561427277 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0cd450 con 0x7f3bac0ce600 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.350+0000 7f3bab7fe640 1 -- 172.21.15.62:0/561427277 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496257026 0 0) 0x7f3bac0cda60 con 0x7f3bac0b5790 2023-09-30T13:58:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb162d640 1 --2- 172.21.15.62:0/561427277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0ce600 0x7f3bac0cf080 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0097a0 tx=0x7f3b9c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404f39832155f16e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bab7fe640 1 -- 172.21.15.62:0/561427277 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c030610 con 0x7f3bac0ce600 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bab7fe640 1 -- 172.21.15.62:0/561427277 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c030770 con 0x7f3bac0ce600 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bab7fe640 1 -- 172.21.15.62:0/561427277 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c030b00 con 0x7f3bac0ce600 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 -- 172.21.15.62:0/561427277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0ce600 msgr2=0x7f3bac0cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 --2- 172.21.15.62:0/561427277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0ce600 0x7f3bac0cf080 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0097a0 tx=0x7f3b9c02b960 comp rx=0 tx=0).stop 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 -- 172.21.15.62:0/561427277 shutdown_connections 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 --2- 172.21.15.62:0/561427277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0ce600 0x7f3bac0cf080 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 -- 172.21.15.62:0/561427277 >> 172.21.15.62:0/561427277 conn(0x7f3bac089fe0 msgr2=0x7f3bac0d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.351+0000 7f3bb3090640 1 -- 172.21.15.62:0/561427277 shutdown_connections 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.352+0000 7f3bb3090640 1 -- 172.21.15.62:0/561427277 wait complete. 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.353+0000 7f3bb3090640 1 Processor -- start 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.353+0000 7f3bb3090640 1 -- start start 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.353+0000 7f3bb3090640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.353+0000 7f3bb3090640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 0x7f3bac15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 0x7f3bac1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1f3250 con 0x7f3bac0b5790 2023-09-30T13:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1f2780 con 0x7f3bac160160 2023-09-30T13:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1f29b0 con 0x7f3bac0ce600 2023-09-30T13:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47578/0 (socket says 172.21.15.62:47578) 2023-09-30T13:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 -- 172.21.15.62:0/2036223940 learned_addr learned my addr 172.21.15.62:0/2036223940 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb162d640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 0x7f3bac1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3babfff640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 0x7f3bac15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 -- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 msgr2=0x7f3bac15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 0x7f3bac15d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 -- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 msgr2=0x7f3bac1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 0x7f3bac1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 -- 172.21.15.62:0/2036223940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c009400 con 0x7f3bac0b5790 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb162d640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 0x7f3bac1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3babfff640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 0x7f3bac15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T13:58:28.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb0e2c640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c7c0 tx=0x7f3ba400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400aa50 con 0x7f3bac0b5790 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400abb0 con 0x7f3bac0b5790 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac1f2c90 con 0x7f3bac0b5790 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4012420 con 0x7f3bac0b5790 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.354+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac09e0a0 con 0x7f3bac0b5790 2023-09-30T13:58:28.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.355+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac09df00 con 0x7f3bac0b5790 2023-09-30T13:58:28.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.356+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f3ba4012580 con 0x7f3bac0b5790 2023-09-30T13:58:28.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.356+0000 7f3ba97fa640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 0x7f3b8c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.356+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3ba40892f0 con 0x7f3bac0b5790 2023-09-30T13:58:28.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.356+0000 7f3babfff640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 0x7f3b8c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.357+0000 7f3babfff640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 0x7f3b8c06cfc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3bac15e930 tx=0x7f3b94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.360+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f3bac09df00 con 0x7f3bac0b5790 2023-09-30T13:58:28.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.536+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bac0d15c0 con 0x7f3b8c06ab00 2023-09-30T13:58:28.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.537+0000 7f3ba97fa640 1 -- 172.21.15.62:0/2036223940 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b94001c90 con 0x7f3b8c06ab00 2023-09-30T13:58:28.537 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 7 to deep-scrub 2023-09-30T13:58:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 msgr2=0x7f3b8c06cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 0x7f3b8c06cfc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3bac15e930 tx=0x7f3b94009040 comp rx=0 tx=0).stop 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 msgr2=0x7f3bac0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c7c0 tx=0x7f3ba400cc80 comp rx=0 tx=0).stop 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 shutdown_connections 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f3b8c06ab00 0x7f3b8c06cfc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bac160160 0x7f3bac1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3bac0ce600 0x7f3bac15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 --2- 172.21.15.62:0/2036223940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3bac0b5790 0x7f3bac0b2e80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 >> 172.21.15.62:0/2036223940 conn(0x7f3bac089fe0 msgr2=0x7f3bac06c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 shutdown_connections 2023-09-30T13:58:28.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.539+0000 7f3bb3090640 1 -- 172.21.15.62:0/2036223940 wait complete. 2023-09-30T13:58:28.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:58:28.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.656+0000 7f4192875640 1 Processor -- start 2023-09-30T13:58:28.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 -- start start 2023-09-30T13:58:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f418c0d1410 0x7f418c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f418c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0cf450 con 0x7f418c15cbe0 2023-09-30T13:58:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c0cfcf0 con 0x7f418c0d1410 2023-09-30T13:58:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f4192875640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cf730 con 0x7f418c06b650 2023-09-30T13:58:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f418bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f418c15cbe0 0x7f418c0d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51522/0 (socket says 172.21.15.62:51522) 2023-09-30T13:58:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.657+0000 7f418bfff640 1 -- 172.21.15.62:0/179554761 learned_addr learned my addr 172.21.15.62:0/179554761 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-09-30T13:58:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f4190e12640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f418c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418b7fe640 1 --2- 172.21.15.62:0/179554761 >> v2:172.21.15.135:3300/0 conn(0x7f418c0d1410 0x7f418c0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515765914 0 0) 0x7f418c0cf450 con 0x7f418c15cbe0 2023-09-30T13:58:28.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4178003520 con 0x7f418c15cbe0 2023-09-30T13:58:28.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 107929562 0 0) 0x7f4178003520 con 0x7f418c15cbe0 2023-09-30T13:58:28.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 msgr2=0x7f418c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f418c06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 >> v2:172.21.15.135:3300/0 conn(0x7f418c0d1410 msgr2=0x7f418c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 --2- 172.21.15.62:0/179554761 >> v2:172.21.15.135:3300/0 conn(0x7f418c0d1410 0x7f418c0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0cfa10 con 0x7f418c15cbe0 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3061495928 0 0) 0x7f417c0017f0 con 0x7f418c15cbe0 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 >> v1:172.21.15.62:6789/0 conn(0x7f418c15cbe0 legacy=0x7f418c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4178003970 0x7f4178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f41780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f4178005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cfcf0 con 0x7f4178004d00 2023-09-30T13:58:28.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cf730 con 0x7f4178003970 2023-09-30T13:58:28.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417800b980 con 0x7f418c06b650 2023-09-30T13:58:28.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f4190e12640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f4178005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418bfff640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4178003970 0x7f4178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.658+0000 7f418b7fe640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f41780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 -- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 msgr2=0x7f41780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c06b650 0x7f41780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 -- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4178003970 msgr2=0x7f4178003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4178003970 0x7f4178003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 -- 172.21.15.62:0/179554761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178003520 con 0x7f4178004d00 2023-09-30T13:58:28.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f4190e12640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f4178005180 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fc0 tx=0x7f41780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e46d83e214486b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.659+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418402cc20 con 0x7f4178004d00 2023-09-30T13:58:28.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418400f040 con 0x7f4178004d00 2023-09-30T13:58:28.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f418affd640 1 -- 172.21.15.62:0/179554761 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184034440 con 0x7f4178004d00 2023-09-30T13:58:28.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 -- 172.21.15.62:0/179554761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 msgr2=0x7f4178005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 --2- 172.21.15.62:0/179554761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f4178005180 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4184009fc0 tx=0x7f41780057f0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4190e12640 1 -- 172.21.15.62:0/179554761 reap_dead start 2023-09-30T13:58:28.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 -- 172.21.15.62:0/179554761 shutdown_connections 2023-09-30T13:58:28.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 -- 172.21.15.62:0/179554761 >> 172.21.15.62:0/179554761 conn(0x7f418c089fe0 msgr2=0x7f418c0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 -- 172.21.15.62:0/179554761 shutdown_connections 2023-09-30T13:58:28.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.660+0000 7f4192875640 1 -- 172.21.15.62:0/179554761 wait complete. 2023-09-30T13:58:28.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.661+0000 7f4192875640 1 Processor -- start 2023-09-30T13:58:28.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.661+0000 7f4192875640 1 -- start start 2023-09-30T13:58:28.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f418c0b45b0 0x7f418c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c0c7e70 0x7f418c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c8840 con 0x7f4178004d00 2023-09-30T13:58:28.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c5fe0 con 0x7f418c0b45b0 2023-09-30T13:58:28.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f4192875640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0b3420 con 0x7f418c0c7e70 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f418bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f418bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47606/0 (socket says 172.21.15.62:47606) 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.662+0000 7f418bfff640 1 -- 172.21.15.62:0/459965229 learned_addr learned my addr 172.21.15.62:0/459965229 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 -- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c0c7e70 msgr2=0x7f418c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c0c7e70 0x7f418c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418b7fe640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f418c0b45b0 0x7f418c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 -- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f418c0b45b0 msgr2=0x7f418c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f418c0b45b0 0x7f418c0b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 -- 172.21.15.62:0/459965229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0b3700 con 0x7f4178004d00 2023-09-30T13:58:28.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f418bfff640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f417c00f910 tx=0x7f417c00fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c0072e0 con 0x7f4178004d00 2023-09-30T13:58:28.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c007440 con 0x7f4178004d00 2023-09-30T13:58:28.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c0057a0 con 0x7f4178004d00 2023-09-30T13:58:28.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c0b39e0 con 0x7f4178004d00 2023-09-30T13:58:28.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.663+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c1522f0 con 0x7f4178004d00 2023-09-30T13:58:28.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.664+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0b1a20 con 0x7f4178004d00 2023-09-30T13:58:28.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.664+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f417c005900 con 0x7f4178004d00 2023-09-30T13:58:28.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.665+0000 7f4188ff9640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 0x7f416c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:28.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.665+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f417c089210 con 0x7f4178004d00 2023-09-30T13:58:28.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.665+0000 7f418b7fe640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 0x7f416c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:28.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.666+0000 7f418b7fe640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 0x7f416c06cff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f418c0b49f0 tx=0x7f4174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:28.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.669+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f417c0546b0 con 0x7f4178004d00 2023-09-30T13:58:28.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.840+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f418c06b130 con 0x7f416c06ab30 2023-09-30T13:58:28.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.843+0000 7f4188ff9640 1 -- 172.21.15.62:0/459965229 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51146 (secure 0 0 0) 0x7f41740096f0 con 0x7f416c06ab30 2023-09-30T13:58:28.842 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:58:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 msgr2=0x7f416c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 0x7f416c06cff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f418c0b49f0 tx=0x7f4174008040 comp rx=0 tx=0).stop 2023-09-30T13:58:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 msgr2=0x7f418c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f417c00f910 tx=0x7f417c00fdd0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 shutdown_connections 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f416c06ab30 0x7f416c06cff0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f418c0c7e70 0x7f418c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f418c0b45b0 0x7f418c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 --2- 172.21.15.62:0/459965229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4178004d00 0x7f418c151db0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.844+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 >> 172.21.15.62:0/459965229 conn(0x7f418c089fe0 msgr2=0x7f418c0c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.845+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 shutdown_connections 2023-09-30T13:58:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:28.845+0000 7f4192875640 1 -- 172.21.15.62:0/459965229 wait complete. 2023-09-30T13:58:28.855 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-09-30T13:58:27.724291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":301756,"kb_used_data":6536,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672964,"statfs":{"total":773094113280,"available":772785115136,"internally_reserved":0,"allocated":6692864,"data_stored":3627288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":302173752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-39420,"num_objects":-10120,"num_object_clones":0,"num_object_copies":-20240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-10130,"num_write_kb":-10125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.177683"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-09-30T13:58:16.442626+0000","last_change":"2023-09-30T13:54:39.018547+0000","last_active":"2023-09-30T13:58:16.442626+0000","last_peered":"2023-09-30T13:58:16.442626+0000","last_clean":"2023-09-30T13:58:16.442626+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:58:16.442626+0000","last_undegraded":"2023-09-30T13:58:16.442626+0000","last_fullsized":"2023-09-30T13:58:16.442626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T13:54:37.826813+0000","last_clean_scrub_stamp":"2023-09-30T13:54:37.826813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:26:14.357999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40752,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331088,"statfs":{"total":96636764160,"available":96595034112,"internally_reserved":0,"allocated":1282048,"data_stored":896187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.442},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89800000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":1.024,"15min":1.024},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.80800000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69799999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.5},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63900000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.442}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.629}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.29399999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64600000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.46400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71799999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.30499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71499999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92500000000000004,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.625},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66400000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88700000000000001,"5min":2.202,"15min":2.202},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.495,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78200000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.57799999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":2.266,"15min":2.266},"last":0.71999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.37}]},{"osd":1,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.501,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.37,"15min":0.36499999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47599999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51400000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.28199999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71599999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79500000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.626},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81499999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.44}]},{"osd":7,"last update":"Sat Sep 30 13:57:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80100000000000005,"5min":1.258,"15min":1.258},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.318,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32800000000000001,"15min":0.32100000000000001},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.318},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36099999999999999},"min":{"1min":0.28299999999999997,"5min":0.22,"15min":0.22},"max":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56799999999999995,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93999999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46700000000000003}]},{"osd":6,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.58999999999999997},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:57:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.67500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61799999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.371},{"interface":"front","average":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53400000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.875,"15min":0.875},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.98499999999999999,"5min":1.002,"15min":1.002},"last":0.628},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.96699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84799999999999998,"5min":1.161,"15min":1.161},"last":0.68999999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.86399999999999999,"5min":1.123,"15min":1.123},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83499999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90500000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1282048,"data_stored":896187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.312},"min":{"1min":0.23100000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.67200000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36299999999999999,"15min":0.34599999999999997},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.64800000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.31}]},{"osd":2,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.371},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27100000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29299999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.372,"15min":0.35899999999999999},"min":{"1min":0.28999999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.52400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83099999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61899999999999999,"15min":0.60099999999999998},"min":{"1min":0.40799999999999997,"5min":0.311,"15min":0.311},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65200000000000002,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53800000000000003}]},{"osd":7,"last update":"Sat Sep 30 13:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:58:28.859 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-30T13:54:37.826813+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=13, tm_min=54, tm_sec=37, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=13, tm_min=58, tm_sec=23, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T13:58:28.859 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T13:58:48.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T13:58:48.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.980+0000 7f87e1d97640 1 Processor -- start 2023-09-30T13:58:48.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.980+0000 7f87e1d97640 1 -- start start 2023-09-30T13:58:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.980+0000 7f87e1d97640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc15cbe0 0x7f87dc0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87e1d97640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87dc06c660 0x7f87dc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87e1d97640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0d16a0 con 0x7f87dc0d0d00 2023-09-30T13:58:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87e1d97640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0cfcf0 con 0x7f87dc06c660 2023-09-30T13:58:48.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87e1d97640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0cf450 con 0x7f87dc15cbe0 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87dc06c660 0x7f87dc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87dc06c660 0x7f87dc0d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56346/0 (socket says 172.21.15.62:56346) 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 -- 172.21.15.62:0/1695993711 learned_addr learned my addr 172.21.15.62:0/1695993711 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87db7fe640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc15cbe0 0x7f87dc0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 -- 172.21.15.62:0/1695993711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc15cbe0 msgr2=0x7f87dc0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc15cbe0 0x7f87dc0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 -- 172.21.15.62:0/1695993711 >> v1:172.21.15.135:6789/0 conn(0x7f87dc0d0d00 legacy=0x7f87dc0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:48.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 -- 172.21.15.62:0/1695993711 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0cf730 con 0x7f87dc06c660 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87dbfff640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc06c660 0x7f87dc0d1160 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e50 tx=0x7f87d402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3525afeea5eca041 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87da7fc640 1 -- 172.21.15.62:0/1695993711 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d402cb90 con 0x7f87dc06c660 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87da7fc640 1 -- 172.21.15.62:0/1695993711 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d402ccf0 con 0x7f87dc06c660 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.982+0000 7f87da7fc640 1 -- 172.21.15.62:0/1695993711 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4034610 con 0x7f87dc06c660 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 -- 172.21.15.62:0/1695993711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc06c660 msgr2=0x7f87dc0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc06c660 0x7f87dc0d1160 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e50 tx=0x7f87d402bff0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 -- 172.21.15.62:0/1695993711 shutdown_connections 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc06c660 0x7f87dc0d1160 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 --2- 172.21.15.62:0/1695993711 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc15cbe0 0x7f87dc0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 -- 172.21.15.62:0/1695993711 >> 172.21.15.62:0/1695993711 conn(0x7f87dc089fe0 msgr2=0x7f87dc0d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 -- 172.21.15.62:0/1695993711 shutdown_connections 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.983+0000 7f87e1d97640 1 -- 172.21.15.62:0/1695993711 wait complete. 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.984+0000 7f87e1d97640 1 Processor -- start 2023-09-30T13:58:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.984+0000 7f87e1d97640 1 -- start start 2023-09-30T13:58:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87dc06c660 0x7f87dc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc0d0d00 0x7f87dc15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b6c30 con 0x7f87dc15cbe0 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0cbcb0 con 0x7f87dc06c660 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87e1d97640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b6020 con 0x7f87dc0d0d00 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56352/0 (socket says 172.21.15.62:56352) 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 -- 172.21.15.62:0/3791878321 learned_addr learned my addr 172.21.15.62:0/3791878321 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87db7fe640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87dc06c660 0x7f87dc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87daffd640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc0d0d00 0x7f87dc15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 -- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc0d0d00 msgr2=0x7f87dc15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc0d0d00 0x7f87dc15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 -- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87dc06c660 msgr2=0x7f87dc0b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87dc06c660 0x7f87dc0b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.985+0000 7f87dbfff640 1 -- 172.21.15.62:0/3791878321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009b30 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87dbfff640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f87d4036040 tx=0x7f87d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4009510 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d403e450 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0b6300 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d403e7e0 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.986+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc0b68c0 con 0x7f87dc15cbe0 2023-09-30T13:58:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.987+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc0b6de0 con 0x7f87dc15cbe0 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.987+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f87d403e940 con 0x7f87dc15cbe0 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.988+0000 7f87c3fff640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 0x7f87c806d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.988+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f87d40abad0 con 0x7f87dc15cbe0 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.988+0000 7f87db7fe640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 0x7f87c806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.988+0000 7f87db7fe640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 0x7f87c806d020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005f80 tx=0x7f87cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:48.992+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f87dc0b6de0 con 0x7f87dc15cbe0 2023-09-30T13:58:49.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.163+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 --> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87dc06b130 con 0x7f87c806ab60 2023-09-30T13:58:49.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.166+0000 7f87c3fff640 1 -- 172.21.15.62:0/3791878321 <== mgr.4100 v2:172.21.15.135:6832/2713400822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51039 (secure 0 0 0) 0x7f87cc00b6e0 con 0x7f87c806ab60 2023-09-30T13:58:49.166 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:49.167 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 msgr2=0x7f87c806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 0x7f87c806d020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005f80 tx=0x7f87cc008040 comp rx=0 tx=0).stop 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 msgr2=0x7f87dc0b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f87d4036040 tx=0x7f87d4004a40 comp rx=0 tx=0).stop 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 shutdown_connections 2023-09-30T13:58:49.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f87c806ab60 0x7f87c806d020 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc15cbe0 0x7f87dc0b54b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f87dc0d0d00 0x7f87dc15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 --2- 172.21.15.62:0/3791878321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87dc06c660 0x7f87dc0b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 >> 172.21.15.62:0/3791878321 conn(0x7f87dc089fe0 msgr2=0x7f87dc0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 shutdown_connections 2023-09-30T13:58:49.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.168+0000 7f87e1d97640 1 -- 172.21.15.62:0/3791878321 wait complete. 2023-09-30T13:58:49.178 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-09-30T13:58:47.728903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":301744,"kb_used_data":6536,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672976,"statfs":{"total":773094113280,"available":772785127424,"internally_reserved":0,"allocated":6692864,"data_stored":3627288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":302173752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002687"},"pg_stats":[{"pgid":"1.0","version":"57'119","reported_seq":207,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-09-30T13:58:28.636582+0000","last_change":"2023-09-30T13:58:28.636582+0000","last_active":"2023-09-30T13:58:28.636582+0000","last_peered":"2023-09-30T13:58:28.636582+0000","last_clean":"2023-09-30T13:58:28.636582+0000","last_became_active":"2023-09-30T13:54:39.017540+0000","last_became_peered":"2023-09-30T13:54:39.017540+0000","last_unstale":"2023-09-30T13:58:28.636582+0000","last_undegraded":"2023-09-30T13:58:28.636582+0000","last_fullsized":"2023-09-30T13:58:28.636582+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'119","last_scrub_stamp":"2023-09-30T13:58:28.636462+0000","last_deep_scrub":"57'119","last_deep_scrub_stamp":"2023-09-30T13:58:28.636462+0000","last_clean_scrub_stamp":"2023-09-30T13:58:28.636462+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:15:53.580871+0000","scrub_duration":0.0074412239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40748,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331092,"statfs":{"total":96636764160,"available":96595038208,"internally_reserved":0,"allocated":1282048,"data_stored":896187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.52400000000000002},"min":{"1min":0.221,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.76900000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65100000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66500000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.32900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69899999999999995}]},{"osd":2,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72999999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84099999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85399999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67000000000000004}]},{"osd":4,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.64100000000000001,"5min":1.024,"15min":1.024},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48199999999999998,"15min":0.47099999999999997},"min":{"1min":0.30599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.64500000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.29299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.66300000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.438}]},{"osd":6,"last update":"Sat Sep 30 13:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.51200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69899999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625}]},{"osd":1,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.51500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71099999999999997}]},{"osd":2,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.751},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.372},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.316,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.31}]},{"osd":5,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41299999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.39500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.45900000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.66300000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67500000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.754}]},{"osd":1,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.498},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.65100000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50700000000000001,"15min":0.48899999999999999},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65800000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66300000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.76900000000000002}]},{"osd":3,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.73499999999999999,"5min":1.208,"15min":1.208},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67900000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80700000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83399999999999996,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.622}]},{"osd":6,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67600000000000005,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.70399999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68799999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.59099999999999997,"15min":0.64500000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66800000000000004,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77500000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.58099999999999996,"15min":0.63400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.79100000000000004,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.58599999999999997,"15min":0.621},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81000000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.55200000000000005},"min":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59299999999999997,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.60499999999999998,"15min":0.65900000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73399999999999999,"5min":2.202,"15min":2.202},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49199999999999999,"15min":0.47799999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.50700000000000001,"15min":0.51600000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53700000000000003,"15min":0.56999999999999995},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.84299999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.58599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44800000000000001}]},{"osd":7,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.627,"15min":0.67000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81999999999999995,"5min":2.266,"15min":2.266},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.42499999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.316},{"interface":"front","average":{"1min":0.318,"5min":0.33300000000000002,"15min":0.33800000000000002},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35299999999999998,"15min":0.36299999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.47899999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38900000000000001,"15min":0.39300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53000000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.49299999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78600000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.749,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.374,"5min":0.371,"15min":0.371},"max":{"1min":0.67000000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71199999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Sep 30 13:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77400000000000002,"5min":1.258,"15min":1.258},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40176,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.315,"15min":0.307},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.495,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.21199999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48199999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.373},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36599999999999999,"15min":0.35999999999999999},"min":{"1min":0.22900000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.54600000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.27500000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.56200000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82999999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71899999999999997,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.45000000000000001}]},{"osd":5,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61399999999999999}]},{"osd":6,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81299999999999994,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.498}]},{"osd":7,"last update":"Sat Sep 30 13:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.622,"15min":0.63600000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74399999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.629,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84399999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":305819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57799999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.26900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.51600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.35599999999999998},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63200000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39500000000000002},"min":{"1min":0.28799999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55600000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54000000000000004,"5min":0.875,"15min":0.875},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.79000000000000004,"5min":1.002,"15min":1.002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.749,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.746}]},{"osd":5,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.70299999999999996,"5min":1.161,"15min":1.161},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88300000000000001,"5min":1.123,"15min":1.123},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Sep 30 13:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.621},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.626,"15min":0.627},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79200000000000004,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1282048,"data_stored":896187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33400000000000002,"15min":0.314},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.54000000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.36399999999999999,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52900000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.26100000000000001}]},{"osd":2,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.19400000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.57699999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.23699999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.374}]},{"osd":3,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.378,"15min":0.36099999999999999},"min":{"1min":0.224,"5min":0.219,"15min":0.219},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.39200000000000002},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.437}]},{"osd":4,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.34100000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.85599999999999998,"5min":1.044,"15min":1.044},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88400000000000001,"5min":1.03,"15min":1.03},"last":0.45700000000000002}]},{"osd":6,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":1.002,"15min":1.002},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Sep 30 13:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85899999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64500000000000002,"15min":0.628},"min":{"1min":0.44800000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T13:58:49.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-30T13:58:49.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.287+0000 7f1ce2d08640 1 Processor -- start 2023-09-30T13:58:49.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.287+0000 7f1ce2d08640 1 -- start start 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce2d08640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 0x7f1cdc15d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce2d08640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce2d08640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cdc06c540 con 0x7f1cdc153d20 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce2d08640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc15dc90 con 0x7f1cdc15d2e0 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce2d08640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc0b29c0 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1cdbfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 0x7f1cdc15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1cdbfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 0x7f1cdc15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.62:55194/0 (socket says 172.21.15.62:55194) 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.62:33732/0 (socket says 172.21.15.62:33732) 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1cdbfff640 1 -- 172.21.15.62:0/2893308949 learned_addr learned my addr 172.21.15.62:0/2893308949 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 -- 172.21.15.62:0/2893308949 >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 msgr2=0x7f1cdc15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 --2- 172.21.15.62:0/2893308949 >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 0x7f1cdc15d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 -- 172.21.15.62:0/2893308949 >> v1:172.21.15.135:6789/0 conn(0x7f1cdc153d20 legacy=0x7f1cdc0ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.288+0000 7f1ce12a5640 1 -- 172.21.15.62:0/2893308949 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc0aecd0 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.289+0000 7f1ce12a5640 1 --2- 172.21.15.62:0/2893308949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009d90 tx=0x7f1cd402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741a41e57f513c2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.289+0000 7f1cdb7fe640 1 -- 172.21.15.62:0/2893308949 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd402cc50 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.289+0000 7f1cdb7fe640 1 -- 172.21.15.62:0/2893308949 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd402cdb0 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.289+0000 7f1cdb7fe640 1 -- 172.21.15.62:0/2893308949 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4034660 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 -- 172.21.15.62:0/2893308949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 msgr2=0x7f1cdc06ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/2893308949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009d90 tx=0x7f1cd402bea0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 -- 172.21.15.62:0/2893308949 shutdown_connections 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/2893308949 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc06ce60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/2893308949 >> v2:172.21.15.135:3300/0 conn(0x7f1cdc15d2e0 0x7f1cdc15d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 -- 172.21.15.62:0/2893308949 >> 172.21.15.62:0/2893308949 conn(0x7f1cdc0cb720 msgr2=0x7f1cdc0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 -- 172.21.15.62:0/2893308949 shutdown_connections 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.290+0000 7f1ce2d08640 1 -- 172.21.15.62:0/2893308949 wait complete. 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.291+0000 7f1ce2d08640 1 Processor -- start 2023-09-30T13:58:49.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.291+0000 7f1ce2d08640 1 -- start start 2023-09-30T13:58:49.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc15d2e0 0x7f1cdc158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc153310 con 0x7f1cdc153d20 2023-09-30T13:58:49.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc143e90 con 0x7f1cdc15d2e0 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce2d08640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc140ba0 con 0x7f1cdc06c9d0 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56358/0 (socket says 172.21.15.62:56358) 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 -- 172.21.15.62:0/135001010 learned_addr learned my addr 172.21.15.62:0/135001010 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce12a5640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc15d2e0 0x7f1cdc158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1ce0aa4640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 -- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 msgr2=0x7f1cdc143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 -- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc15d2e0 msgr2=0x7f1cdc158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc15d2e0 0x7f1cdc158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.292+0000 7f1cdbfff640 1 -- 172.21.15.62:0/135001010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4009a70 con 0x7f1cdc153d20 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1cdbfff640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009fd0 tx=0x7f1cc800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800c940 con 0x7f1cdc153d20 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800caa0 con 0x7f1cdc153d20 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc1418e0 con 0x7f1cdc153d20 2023-09-30T13:58:49.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800ce30 con 0x7f1cdc153d20 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.293+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc140fb0 con 0x7f1cdc153d20 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.294+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc141a70 con 0x7f1cdc153d20 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.294+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7f1cc8013470 con 0x7f1cdc153d20 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.295+0000 7f1cd97fa640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 0x7f1cc006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.295+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1cc8089260 con 0x7f1cdc153d20 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.295+0000 7f1ce0aa4640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 0x7f1cc006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.295+0000 7f1ce0aa4640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 0x7f1cc006cff0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000f60 tx=0x7f1cd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.299+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7f1cc8054610 con 0x7f1cdc153d20 2023-09-30T13:58:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.475+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1cdc06dda0 con 0x7f1cdc153d20 2023-09-30T13:58:49.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.479+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1cc8057c30 con 0x7f1cdc153d20 2023-09-30T13:58:49.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.479+0000 7f1cd97fa640 1 -- 172.21.15.62:0/135001010 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1cc80890d0 con 0x7f1cdc153d20 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 msgr2=0x7f1cc006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 0x7f1cc006cff0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000f60 tx=0x7f1cd0009040 comp rx=0 tx=0).stop 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 msgr2=0x7f1cdc152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009fd0 tx=0x7f1cc800ed40 comp rx=0 tx=0).stop 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 shutdown_connections 2023-09-30T13:58:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7f1cc006ab30 0x7f1cc006cff0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cdc15d2e0 0x7f1cdc158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cdc153d20 0x7f1cdc152dd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 --2- 172.21.15.62:0/135001010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cdc06c9d0 0x7f1cdc143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 >> 172.21.15.62:0/135001010 conn(0x7f1cdc0cb720 msgr2=0x7f1cdc0cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 shutdown_connections 2023-09-30T13:58:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.481+0000 7f1ce2d08640 1 -- 172.21.15.62:0/135001010 wait complete. 2023-09-30T13:58:49.491 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T13:58:49.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T13:58:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.598+0000 7fc7c7548640 1 Processor -- start 2023-09-30T13:58:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.598+0000 7fc7c7548640 1 -- start start 2023-09-30T13:58:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7c015cbb0 0x7fc7c006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 0x7fc7c006bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7c00d1410 0x7fc7c00af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00cb810 con 0x7fc7c015cbb0 2023-09-30T13:58:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00caee0 con 0x7fc7c00d1410 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c7548640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00cb1c0 con 0x7fc7c006b070 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c52e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7c015cbb0 0x7fc7c006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c52e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7c015cbb0 0x7fc7c006b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56360/0 (socket says 172.21.15.62:56360) 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c52e4640 1 -- 172.21.15.62:0/2122326855 learned_addr learned my addr 172.21.15.62:0/2122326855 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c4ae3640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 0x7fc7c006bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.599+0000 7fc7c5ae5640 1 --2- 172.21.15.62:0/2122326855 >> v2:172.21.15.135:3300/0 conn(0x7fc7c00d1410 0x7fc7c00af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 -- 172.21.15.62:0/2122326855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 msgr2=0x7fc7c006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 0x7fc7c006bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 -- 172.21.15.62:0/2122326855 >> v2:172.21.15.135:3300/0 conn(0x7fc7c00d1410 msgr2=0x7fc7c00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/2122326855 >> v2:172.21.15.135:3300/0 conn(0x7fc7c00d1410 0x7fc7c00af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 -- 172.21.15.62:0/2122326855 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00cb4a0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c4ae3640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 0x7fc7c006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c006b5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00c42d0 tx=0x7fc7b802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3d097f11817abf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.600+0000 7fc7bffff640 1 -- 172.21.15.62:0/2122326855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8031860 con 0x7fc7c015cbb0 2023-09-30T13:58:49.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7bffff640 1 -- 172.21.15.62:0/2122326855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7b80319c0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7bffff640 1 -- 172.21.15.62:0/2122326855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8031d70 con 0x7fc7c015cbb0 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 -- 172.21.15.62:0/2122326855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 msgr2=0x7fc7c006b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c006b5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00c42d0 tx=0x7fc7b802b900 comp rx=0 tx=0).stop 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 -- 172.21.15.62:0/2122326855 shutdown_connections 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 --2- 172.21.15.62:0/2122326855 >> v2:172.21.15.135:3300/0 conn(0x7fc7c00d1410 0x7fc7c00af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c006b070 0x7fc7c006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 --2- 172.21.15.62:0/2122326855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c006b5e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 -- 172.21.15.62:0/2122326855 >> 172.21.15.62:0/2122326855 conn(0x7fc7c0089fe0 msgr2=0x7fc7c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 -- 172.21.15.62:0/2122326855 shutdown_connections 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.601+0000 7fc7c7548640 1 -- 172.21.15.62:0/2122326855 wait complete. 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.602+0000 7fc7c7548640 1 Processor -- start 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.602+0000 7fc7c7548640 1 -- start start 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 0x7fc7c009d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 0x7fc7c00b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c009b2e0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c009a6d0 con 0x7fc7c006b070 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c7548640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c009a9b0 con 0x7fc7c00d1410 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56364/0 (socket says 172.21.15.62:56364) 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 -- 172.21.15.62:0/3920673210 learned_addr learned my addr 172.21.15.62:0/3920673210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 0x7fc7c009d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c4ae3640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 0x7fc7c00b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 -- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 msgr2=0x7fc7c00b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 0x7fc7c00b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 -- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 msgr2=0x7fc7c009d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.603+0000 7fc7c5ae5640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 0x7fc7c009d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c5ae5640 1 -- 172.21.15.62:0/3920673210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80094d0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c4ae3640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 0x7fc7c00b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 0x7fc7c009d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c5ae5640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007e40 tx=0x7fc7b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0014620 con 0x7fc7c015cbb0 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7b000ee90 con 0x7fc7c015cbb0 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c006e4a0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0014a00 con 0x7fc7c015cbb0 2023-09-30T13:58:49.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.604+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c009af70 con 0x7fc7c015cbb0 2023-09-30T13:58:49.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.605+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c00b5da0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.605+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 89055+0+0 (secure 0 0 0) 0x7fc7b0014b60 con 0x7fc7c015cbb0 2023-09-30T13:58:49.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.606+0000 7fc7bdffb640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 0x7fc7ac06d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T13:58:49.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.606+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc7b0089b20 con 0x7fc7c015cbb0 2023-09-30T13:58:49.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.606+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 0x7fc7ac06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T13:58:49.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.607+0000 7fc7c52e4640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 0x7fc7ac06d020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8036000 tx=0x7fc7b803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T13:58:49.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.610+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178874 (secure 0 0 0) 0x7fc7b0054e20 con 0x7fc7c015cbb0 2023-09-30T13:58:49.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.822+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7c006e2a0 con 0x7fc7c015cbb0 2023-09-30T13:58:49.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.822+0000 7fc7bdffb640 1 -- 172.21.15.62:0/3920673210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fc7b0058440 con 0x7fc7c015cbb0 2023-09-30T13:58:49.822 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-30T13:58:49.823 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2223757041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2223757041},{"type":"v1","addr":"172.21.15.62:6834","nonce":2223757041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5498,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/699999449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":699999449},{"type":"v1","addr":"172.21.15.135:6836","nonce":699999449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5581,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1785084376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1785084376},{"type":"v1","addr":"172.21.15.135:6837","nonce":1785084376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/953613104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":953613104},{"type":"v1","addr":"172.21.15.62:6835","nonce":953613104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-09-30T13:58:49.823 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 25 2023-09-30T13:58:49.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.824+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 msgr2=0x7fc7ac06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.824+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 0x7fc7ac06d020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8036000 tx=0x7fc7b803c040 comp rx=0 tx=0).stop 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.824+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 msgr2=0x7fc7c00b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.824+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007e40 tx=0x7fc7b000e4b0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 shutdown_connections 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:6832/2713400822,v1:172.21.15.135:6833/2713400822] conn(0x7fc7ac06ab60 0x7fc7ac06d020 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7c015cbb0 0x7fc7c00b5860 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7c00d1410 0x7fc7c00b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 --2- 172.21.15.62:0/3920673210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c006b070 0x7fc7c009d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T13:58:49.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 >> 172.21.15.62:0/3920673210 conn(0x7fc7c0089fe0 msgr2=0x7fc7c00c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T13:58:49.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 shutdown_connections 2023-09-30T13:58:49.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-09-30T13:58:49.825+0000 7fc7c7548640 1 -- 172.21.15.62:0/3920673210 wait complete. 2023-09-30T13:58:49.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:49.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:49.835 DEBUG:tasks.cephfs.filesystem:already dead... 2023-09-30T13:58:49.835 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T13:58:49.836 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T13:58:49.836 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:49.884 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T13:58:49.885 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T13:58:49.885 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:49.933 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T13:58:49.934 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T13:58:49.934 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:49.945 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T13:58:49.946 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-30T13:58:49.946 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:49.997 INFO:tasks.ceph.mds.d:Stopped 2023-09-30T13:58:49.997 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T13:58:49.998 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T13:58:49.998 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.026 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T13:58:50.027 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T13:58:50.027 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.092 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T13:58:50.093 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T13:58:50.093 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.165 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T13:58:50.165 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T13:58:50.165 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.241 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T13:58:50.241 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-30T13:58:50.241 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.280 INFO:tasks.ceph.osd.4:Stopped 2023-09-30T13:58:50.280 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-30T13:58:50.280 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.361 INFO:tasks.ceph.osd.5:Stopped 2023-09-30T13:58:50.361 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-30T13:58:50.361 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.439 INFO:tasks.ceph.osd.6:Stopped 2023-09-30T13:58:50.440 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-30T13:58:50.440 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.509 INFO:tasks.ceph.osd.7:Stopped 2023-09-30T13:58:50.509 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T13:58:50.509 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-30T13:58:50.509 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.534 INFO:tasks.ceph.mgr.y:Stopped 2023-09-30T13:58:50.535 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T13:58:50.535 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-09-30T13:58:50.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-09-30T13:58:50.578 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T13:58:50.578 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T13:58:50.578 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T13:58:50.579 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.589 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T13:58:50.590 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T13:58:50.590 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.630 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T13:58:50.631 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T13:58:50.631 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T13:58:50.683 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T13:58:50.684 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T13:58:50.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2023-09-30T13:58:50.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:50.723 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T13:58:50.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:50.875 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T13:58:50.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:50.974 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T13:58:51.025 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:58:51.026 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T13:58:51.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:51.077 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-30T13:58:51.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:51.252 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-30T13:58:51.323 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:51.324 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-30T13:58:51.380 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:58:51.380 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-30T13:58:51.447 INFO:tasks.ceph:Archiving mon data... 2023-09-30T13:58:51.448 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/data/mon.a.tgz 2023-09-30T13:58:51.448 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2023-09-30T13:58:51.464 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.SW9biQhhG6 2023-09-30T13:58:51.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SW9biQhhG6 2023-09-30T13:58:51.612 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.SW9biQhhG6 2023-09-30T13:58:51.700 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.SW9biQhhG6 is 358KB 2023-09-30T13:58:51.798 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.SW9biQhhG6 2023-09-30T13:58:51.816 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/data/mon.b.tgz 2023-09-30T13:58:51.817 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-09-30T13:58:51.836 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.jPxdIibeX3 2023-09-30T13:58:51.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jPxdIibeX3 2023-09-30T13:58:52.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.jPxdIibeX3 2023-09-30T13:58:52.115 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.jPxdIibeX3 is 470KB 2023-09-30T13:58:52.243 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.jPxdIibeX3 2023-09-30T13:58:52.260 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/data/mon.c.tgz 2023-09-30T13:58:52.260 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-09-30T13:58:52.315 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.JPnXxyFEqz 2023-09-30T13:58:52.315 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.JPnXxyFEqz 2023-09-30T13:58:52.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.JPnXxyFEqz 2023-09-30T13:58:52.565 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.JPnXxyFEqz is 470KB 2023-09-30T13:58:52.685 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.JPnXxyFEqz 2023-09-30T13:58:52.703 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T13:58:52.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T13:58:52.710 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T13:58:52.778 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T13:58:52.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T13:58:52.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T13:58:52.828 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T13:58:52.854 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T13:58:52.858 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T13:58:53.089 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi062/crash 2023-09-30T13:58:53.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T13:58:53.243 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi135/crash 2023-09-30T13:58:53.259 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T13:58:53.288 INFO:tasks.ceph:Shutting down logrotate 2023-09-30T13:58:53.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:53.305 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:53.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:53.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T13:58:53.488 INFO:tasks.ceph:Compressing logs... 2023-09-30T13:58:53.489 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T13:58:53.505 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T13:58:53.536 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108894.log 2023-09-30T13:58:53.578 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87170.log 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86970.log 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87090.log 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87170.log.gz 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86970.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86970.log.gz 2023-09-30T13:58:53.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.87090.log.gz 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93603.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87010.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.93603.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87010.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-09-30T13:58:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87010.log.gz 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.1.93603.log.gz 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87210.log 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87050.log 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94749.log 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87210.log.gz 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87050.log: gzip 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T13:58:53.581 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.94749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86930.log 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87050.log.gz 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95424.log 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.86930.log: 92.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86930.log.gz 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.1.94749.log.gz 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87130.log 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.95424.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T13:58:53.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.87130.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87130.log.gz 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip 92.6% -- replaced with /var/log/ceph/ceph-client.1.95424.log.gz 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94038.log 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.94038.log: 91.3% -- replaced with /var/log/ceph/ceph-client.3.94038.log.gz 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T13:58:53.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.d.log: 91.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-09-30T13:58:53.632 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T13:58:53.692 INFO:teuthology.orchestra.run.smithi135.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T13:58:53.718 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103983.log 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108894.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95825.log 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108894.log.gz 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103983.log.gz 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99094.log 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110041.log 2023-09-30T13:58:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99094.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95825.log.gz 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99724.log 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99094.log.gz 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106279.log 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110041.log.gz 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95832.log 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106279.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.98070.log 2023-09-30T13:58:53.720 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99724.log.gz 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95832.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106279.log.gz 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107230.log 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95832.log.gz 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96954.log 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98070.log.gz 2023-09-30T13:58:53.721 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109915.log 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96954.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107230.log.gz 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93930.log 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1%/var/log/ceph/ceph-client.admin.109915.log: -- replaced with /var/log/ceph/ceph-client.admin.96954.log.gz 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108310.log 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109915.log.gz 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94986.log 2023-09-30T13:58:53.722 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108310.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93930.log.gz 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102379.log 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1%/var/log/ceph/ceph-client.admin.94986.log: -- replaced with /var/log/ceph/ceph-client.admin.108310.log.gz 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110269.log 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94986.log.gz 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110717.log 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110269.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102379.log.gz -5 2023-09-30T13:58:53.723 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97206.log 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110269.log.gz 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101485.log 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110717.log.gz 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95526.log 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93233.log 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97206.log.gz 2023-09-30T13:58:53.724 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101485.log.gz 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102631.log 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95526.log.gz 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110759.log 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95274.log 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93233.log.gz 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102631.log.gz 2023-09-30T13:58:53.725 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109090.log 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109048.log 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95274.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110759.log.gz 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95316.log 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95274.log.gz 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109090.log.gz 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102211.log 2023-09-30T13:58:53.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95316.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109048.log.gz 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102001.log 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102211.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95316.log.gz 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101091.log 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102211.log.gz 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99388.log 2023-09-30T13:58:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101091.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102001.log.gz 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110591.log 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101091.log.gz 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93318.log 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99388.log.gz 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104350.log 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93318.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110591.log.gz 2023-09-30T13:58:53.728 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101647.log 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.104350.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93318.log.gz 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97164.log 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106489.log 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97164.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101647.log.gz 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102715.log 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92962.log 2023-09-30T13:58:53.729 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97164.log.gz 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106489.log: /var/log/ceph/ceph-client.admin.102715.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106489.log.gzgzip 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101959.log 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102715.log.gz 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108569.log 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.92962.log: /var/log/ceph/ceph-client.admin.101959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111011.log 2023-09-30T13:58:53.730 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92962.log.gz 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.108569.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101959.log.gz 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110125.log 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96158.log 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111011.log.gz 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109294.log 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93972.log 2023-09-30T13:58:53.731 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110125.log.gz 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96158.log.gz 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105513.log 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93972.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109294.log.gz 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108936.log 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93972.log.gz 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99945.log 2023-09-30T13:58:53.732 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108936.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105513.log.gz 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100029.log 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5%/var/log/ceph/ceph-client.admin.99945.log: -- replaced with /var/log/ceph/ceph-client.admin.108936.log.gz 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103689.log 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103941.log 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99945.log.gz 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103689.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100029.log.gz -- 2023-09-30T13:58:53.733 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.2.98443.log 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103941.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103689.log.gz 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97416.log 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.2.98443.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103941.log.gz 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97248.log 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103731.log 2023-09-30T13:58:53.734 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97248.log: 91.1% -- replaced with /var/log/ceph/ceph-client.2.98443.log.gz 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 91.1% -- replaced with /var/log/ceph/ceph-client.admin.97416.log.gz 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111347.log 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97248.log.gz 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97374.log 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111347.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103731.log.gz 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99766.log 2023-09-30T13:58:53.735 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111347.log.gz/var/log/ceph/ceph-client.admin.97374.log: gzip -5 --verbose 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.96167.log 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95610.log 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97374.log.gz 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3%/var/log/ceph/ceph-client.admin.96167.log: -- replaced with /var/log/ceph/ceph-client.admin.99766.log.gz 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100723.log 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95610.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96167.log.gz 2023-09-30T13:58:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99808.log 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95610.log.gz/var/log/ceph/ceph-client.admin.100723.log: gzip 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94491.log 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99808.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100723.log.gz 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109705.log 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.94491.log: /var/log/ceph/ceph-client.admin.95070.log 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99808.log.gz 2023-09-30T13:58:53.737 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102337.log 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109705.log.gz 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111053.log 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.102337.log: -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95070.log.gz 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101773.log 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111053.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102337.log.gz 2023-09-30T13:58:53.738 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99514.log 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111053.log.gz 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.94491.log.gz 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105714.log 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101773.log: /var/log/ceph/ceph-client.admin.99514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99556.log 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101773.log.gz 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99514.log.gz 2023-09-30T13:58:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106872.log 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99556.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105714.log.gz 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109378.log 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106872.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99556.log.gz 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103477.log 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109378.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106872.log.gz 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111263.log 2023-09-30T13:58:53.740 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109378.log.gz 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99640.log 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99010.log 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111263.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103477.log.gz 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103297.log 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111263.log.gz 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99010.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99640.log.gz 2023-09-30T13:58:53.741 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107440.log 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99010.log.gz 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94718.log 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103297.log.gz 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100171.log 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107440.log.gz 2023-09-30T13:58:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105672.log 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100171.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94718.log.gz 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103255.log 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100171.log.gz 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105672.log.gz 2023-09-30T13:58:53.743 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96165.log 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107062.log 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103255.log.gz 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93402.log 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5%/var/log/ceph/ceph-client.admin.107062.log: -- replaced with /var/log/ceph/ceph-client.admin.96165.log.gz 2023-09-30T13:58:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111221.log 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95358.log 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107062.log.gz 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2%/var/log/ceph/ceph-client.admin.111221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104934.log 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93402.log.gz 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105840.log 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111221.log.gz 2023-09-30T13:58:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104934.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95358.log.gz 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106068.log 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105840.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104934.log.gz 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99220.log 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105840.log.gz 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96506.log 2023-09-30T13:58:53.746 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106068.log.gz 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.99220.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96503.log 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105924.log 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99220.log.gz 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96506.log.gz 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108106.log 2023-09-30T13:58:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105924.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96503.log.gz 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100594.log 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105924.log.gz 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105099.log 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105267.log 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100594.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108106.log.gz 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96366.log 2023-09-30T13:58:53.748 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100594.log.gz 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107020.log 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105099.log.gz 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110969.log 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105267.log.gz 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107020.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.97080.log -- replaced with /var/log/ceph/ceph-client.admin.96366.log.gz 2023-09-30T13:58:53.749 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106447.log 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107020.log.gz 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110969.log.gz 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109999.log 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107398.log 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106447.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97080.log.gz 2023-09-30T13:58:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103647.log 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106447.log.gz 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7%/var/log/ceph/ceph-client.admin.107398.log: -- replaced with /var/log/ceph/ceph-client.admin.109999.log.gz 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81254.log 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103647.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107398.log.gz 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103647.log.gz 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96164.log 2023-09-30T13:58:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.tmp-client.admin.81254.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81254.log.gz 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104549.log 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100297.log 88.7% 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96164.log.gz 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100638.log 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104549.log: /var/log/ceph/ceph-client.admin.100297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105882.log 2023-09-30T13:58:53.752 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104549.log.gz 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100638.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100297.log.gz 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101605.log 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105882.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105966.log 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100638.log.gz 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105882.log.gz 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101605.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T13:58:53.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105966.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101605.log.gz 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110549.log 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105966.log.gz 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93360.log 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102085.log 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110549.log: /var/log/ceph/ceph-client.admin.93360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99178.log 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110549.log.gz 2023-09-30T13:58:53.754 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106321.log 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93360.log.gz 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102085.log: /var/log/ceph/ceph-client.admin.99178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96996.log 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% 87.6%/var/log/ceph/ceph-client.admin.106321.log: -- replaced with /var/log/ceph/ceph-client.admin.99178.log.gz 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102085.log.gz 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101275.log 2023-09-30T13:58:53.755 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106321.log.gz 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100933.log 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102547.log 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96996.log.gz 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100071.log 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100933.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.101275.log.gz 2023-09-30T13:58:53.756 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97290.log 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100933.log.gz 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102547.log.gz 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.100071.log: /var/log/ceph/ceph-client.admin.98884.log 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106405.log 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97290.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100071.log.gz 2023-09-30T13:58:53.757 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102918.log 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97290.log.gz 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106405.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.98884.log.gz -5 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99346.log 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102918.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.106405.log.gz 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111137.log 2023-09-30T13:58:53.758 INFO:teuthology.orchestra.run.smithi062.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102918.log.gz 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99598.log 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96870.log 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99346.log.gz 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99598.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96157.log 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111137.log.gz 2023-09-30T13:58:53.759 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99598.log.gz 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100891.log 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99136.log 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96157.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96870.log.gz 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98606.log 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96157.log.gz 2023-09-30T13:58:53.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110843.log 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100891.log.gz 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97122.log 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99136.log.gz 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110311.log 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98606.log.gz 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97122.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110843.log.gz 2023-09-30T13:58:53.761 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100807.log 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97122.log.gz 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109831.log 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6%/var/log/ceph/ceph-client.admin.100807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87550.log 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110311.log.gz 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109831.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100807.log.gz -- 2023-09-30T13:58:53.762 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.96912.log 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109831.log.gz 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.87550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95028.log 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108232.log 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87550.log.gz 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96912.log: /var/log/ceph/ceph-client.admin.95028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101401.log 2023-09-30T13:58:53.763 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96912.log.gz 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1%/var/log/ceph/ceph-client.admin.108232.log: -- replaced with /var/log/ceph/ceph-client.admin.95028.log.gz 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103385.log 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101401.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108232.log.gz 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96166.log 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101401.log.gz 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111095.log 2023-09-30T13:58:53.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96166.log: gzip -5 89.0% --verbose -- /var/log/ceph/ceph-client.admin.94760.log 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103385.log.gz 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96166.log.gz 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110465.log 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94760.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111095.log.gz 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101815.log 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94760.log.gz 2023-09-30T13:58:53.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100681.log 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99903.log 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110465.log.gz 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100459.log 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101815.log.gz 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98564.log 2023-09-30T13:58:53.766 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100681.log.gz 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108725.log 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99903.log.gz 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98564.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100459.log.gz 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100255.log 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98564.log.gz 2023-09-30T13:58:53.767 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0%/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111387.log 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108725.log.gz 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98800.log 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102795.log 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100255.log.gz 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101217.log 2023-09-30T13:58:53.768 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111387.log.gz 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107964.log 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102795.log: -- replaced with /var/log/ceph/ceph-client.admin.98800.log.gz 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103519.log 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102795.log.gz 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103087.log 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101217.log.gz 2023-09-30T13:58:53.769 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107964.log: /var/log/ceph/ceph-client.admin.103519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102295.log 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3%/var/log/ceph/ceph-client.admin.103087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103857.log 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103519.log.gz 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107964.log.gz 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103087.log.gz 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96828.log 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102295.log.gz 2023-09-30T13:58:53.770 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98926.log 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103857.log.gz 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102876.log 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96828.log.gz 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102253.log 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.102876.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96162.log 2023-09-30T13:58:53.771 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98926.log.gz 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95830.log 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102876.log.gz 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96501.log 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102253.log.gz 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96162.log: /var/log/ceph/ceph-client.admin.95830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95112.log 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96501.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96162.log.gz 2023-09-30T13:58:53.772 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95830.log.gz 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104996.log 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96501.log.gz/var/log/ceph/ceph-client.admin.95112.log: 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103213.log 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95112.log.gz 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87637.log 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.103213.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103773.log 2023-09-30T13:58:53.773 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.87637.log: 88.2% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.103213.log.gz 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104996.log.gz 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93846.log 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87637.log.gz 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93056.log 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103773.log: /var/log/ceph/ceph-client.admin.93846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111305.log 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103773.log.gz 2023-09-30T13:58:53.774 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95442.log 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93846.log.gz 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93056.log: /var/log/ceph/ceph-client.admin.111305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98758.log 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93444.log 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111305.log.gz 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93056.log.gz 2023-09-30T13:58:53.775 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106008.log 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95442.log.gz 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93444.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98758.log.gz 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96786.log 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106008.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93444.log.gz 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110633.log 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106008.log.gz 2023-09-30T13:58:53.776 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109216.log 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.110633.log: -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96786.log.gz 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109663.log 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109216.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110633.log.gz 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105429.log 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109216.log.gz 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107482.log 2023-09-30T13:58:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105429.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109663.log.gz 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94844.log 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105429.log.gz 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101359.log 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.94844.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.107272.log 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101359.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.107482.log.gz 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93486.log 2023-09-30T13:58:53.778 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94844.log.gz 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose 88.2% --/var/log/ceph/ceph-client.admin.107272.log: /var/log/ceph/ceph-client.admin.95652.log 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101359.log.gz 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93486.log: gzip 88.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.104507.log 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107272.log.gz 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95652.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93486.log.gz 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102960.log 2023-09-30T13:58:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95833.log 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95652.log.gz 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101731.log 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104507.log.gz 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103045.log 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102960.log.gz 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95833.log: /var/log/ceph/ceph-client.admin.101731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96499.log 2023-09-30T13:58:53.780 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6%gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101731.log.gz -5 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.105387.log 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95833.log.gz 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103045.log: /var/log/ceph/ceph-client.admin.96499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109747.log 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103045.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96499.log.gz 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105387.log: 2023-09-30T13:58:53.781 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105387.log.gz 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.109873.log 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101175.log 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109747.log.gz 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109873.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101175.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109873.log.gz 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93592.log 2023-09-30T13:58:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.3.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101175.log.gz 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102589.log 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.93592.log: -5 --verbose -- /var/log/ceph/ceph-client.0.97948.log 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107104.log 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93592.log.gz 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6%/var/log/ceph/ceph-client.0.97948.log: -- replaced with /var/log/ceph/ceph-client.admin.102589.log.gz 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111429.log 2023-09-30T13:58:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102169.log 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111429.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107104.log.gz 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.0.97948.log.gz 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111429.log.gz 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93804.log 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.102169.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102673.log 2023-09-30T13:58:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93804.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102169.log.gz 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99304.log 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93804.log.gz 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109132.log 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102673.log: /var/log/ceph/ceph-client.admin.99304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105588.log 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99304.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102673.log.gz 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105471.log 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109132.log.gz 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.105588.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.107146.log 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105471.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105588.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110185.log 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105471.log.gz 2023-09-30T13:58:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110083.log 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109462.log 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107146.log.gz 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110083.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110185.log.gz 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108148.log 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1%/var/log/ceph/ceph-client.admin.109462.log: -- replaced with /var/log/ceph/ceph-client.admin.110083.log.gz 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97038.log 2023-09-30T13:58:53.787 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109462.log.gz 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99052.log 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108148.log.gz 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106914.log 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97038.log: /var/log/ceph/ceph-client.admin.99052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102127.log 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106914.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97038.log.gz 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99052.log.gz 2023-09-30T13:58:53.788 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106914.log.gz 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101317.log 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110227.log 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103171.log 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102127.log.gz 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101317.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106746.log 2023-09-30T13:58:53.789 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103171.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98968.log 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110227.log.gz/var/log/ceph/ceph-client.admin.106746.log: 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103171.log.gz 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106746.log.gz 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101563.log 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101875.log 2023-09-30T13:58:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101563.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98968.log.gz 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109336.log 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101563.log.gz 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93720.log 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101875.log: /var/log/ceph/ceph-client.admin.109336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100765.log 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.104350.log.gz 2023-09-30T13:58:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93720.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101875.log.gz 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109336.log.gz 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93720.log.gz 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107548.log 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94886.log 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107808.log 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100765.log.gz 2023-09-30T13:58:53.792 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109420.log 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107548.log.gz 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.107808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95232.log 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94886.log.gz 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.109420.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101007.log 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95232.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109420.log.gz 2023-09-30T13:58:53.793 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.0.107808.log.gz 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110675.log 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95232.log.gz 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110885.log 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101007.log: /var/log/ceph/ceph-client.admin.110675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96702.log 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101007.log.gz 2023-09-30T13:58:53.794 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110675.log.gz 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103563.log 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110885.log: /var/log/ceph/ceph-client.admin.96702.log: gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110885.log.gz 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.109789.log 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96702.log.gz 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108190.log 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103563.log.gz 2023-09-30T13:58:53.795 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109789.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109789.log.gz 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95568.log 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.y.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105225.log 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108190.log.gz 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110927.log 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2023-09-30T13:58:53.796 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95568.log.gz 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105225.log: /var/log/ceph/ceph-client.admin.110927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102463.log 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94676.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110927.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105225.log.gz 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gzgzip 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108064.log 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.102463.log: -- /var/log/ceph/ceph-client.admin.105345.log 2023-09-30T13:58:53.797 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101917.log 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102463.log.gz 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108064.log.gz 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99472.log 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105630.log 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105345.log.gz 2023-09-30T13:58:53.798 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99472.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101917.log.gz 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94802.log 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99472.log.gz 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103435.log 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105630.log: /var/log/ceph/ceph-client.admin.94802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95484.log 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103435.log: 89.0% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105630.log.gz 2023-09-30T13:58:53.799 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94802.log.gz 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103435.log.gz 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103129.log 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.95484.log: /var/log/ceph/ceph-client.admin.95400.log 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103129.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95484.log.gz 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103129.log.gz 2023-09-30T13:58:53.800 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.110507.log 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100113.log 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95400.log.gz 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93152.log 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110507.log.gz 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.100113.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.106976.log 2023-09-30T13:58:53.801 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93152.log: gzip -5 --verbose -- 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100113.log.gz 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.109579.log 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93152.log.gz 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102043.log 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106976.log.gz 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.109579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95831.log 2023-09-30T13:58:53.802 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102043.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109579.log.gz 2023-09-30T13:58:53.805 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100213.log 2023-09-30T13:58:53.805 INFO:teuthology.orchestra.run.smithi062.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102043.log.gz 2023-09-30T13:58:53.805 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104591.log 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95831.log.gz 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99430.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100213.log.gz 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106830.log 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104591.log.gz 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105183.log 2023-09-30T13:58:53.806 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106830.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99430.log.gz 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96502.log 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106830.log.gz 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105183.log: /var/log/ceph/ceph-client.admin.96502.log: gzip -5 --verbose 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105183.log.gz 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.96170.log 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.96502.log.gz 2023-09-30T13:58:53.807 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94014.log 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.96170.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104091.log 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94014.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96170.log.gz 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109174.log 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104091.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94014.log.gz 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104091.log.gz 2023-09-30T13:58:53.808 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106664.log 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93634.log 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109174.log.gz 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99682.log 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106664.log.gz 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93634.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93634.log.gz 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106584.log 2023-09-30T13:58:53.809 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109537.log 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99682.log.gz 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93762.log 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111179.log 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109537.log: 88.7%/var/log/ceph/ceph-client.admin.93762.log: -- replaced with /var/log/ceph/ceph-client.admin.106584.log.gz 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109537.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93762.log.gz 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 2023-09-30T13:58:53.810 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102421.log 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.111179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100849.log 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5%/var/log/ceph/ceph-client.admin.102421.log: -- replaced with /var/log/ceph/ceph-client.admin.111179.log.gz 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101689.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102421.log.gz 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100849.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T13:58:53.811 INFO:teuthology.orchestra.run.smithi062.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100849.log.gz 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101049.log 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101689.log.gz 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.95829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106363.log 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101049.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101049.log.gz 2023-09-30T13:58:53.812 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106237.log 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106363.log.gz 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104025.log 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108006.log 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106237.log: /var/log/ceph/ceph-client.admin.104025.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106237.log.gz 2023-09-30T13:58:53.813 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94944.log 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108006.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.104025.log.gz 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108006.log.gz 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95834.log 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94944.log: /var/log/ceph/ceph-client.admin.95834.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94944.log.gz 2023-09-30T13:58:53.814 INFO:teuthology.orchestra.run.smithi062.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95834.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109957.log 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107356.log 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109957.log.gz 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103003.log 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107356.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107356.log.gz 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104872.log 2023-09-30T13:58:53.815 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103003.log.gz 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103899.log 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104872.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104872.log.gz 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93530.log 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103899.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103899.log.gz 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100339.log 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93530.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93530.log.gz 2023-09-30T13:58:53.816 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106788.log 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100339.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100339.log.gz 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101443.log 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106788.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106788.log.gz 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103815.log 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101443.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101443.log.gz 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103341.log 2023-09-30T13:58:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103815.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103815.log.gz 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100381.log 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103341.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103341.log.gz 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100546.log 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100381.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100381.log.gz 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106195.log 2023-09-30T13:58:53.818 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100546.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100546.log.gz 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96505.log 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106195.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106195.log.gz 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93676.log 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96505.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96505.log.gz 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93888.log 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93676.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93676.log.gz 2023-09-30T13:58:53.819 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105756.log 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93888.log.gz 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94080.log 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105756.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105756.log.gz 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95154.log 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94080.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94080.log.gz 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105141.log 2023-09-30T13:58:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95154.log.gz 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107314.log 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105141.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105141.log.gz 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97332.log 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107314.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107314.log.gz 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110801.log 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97332.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97332.log.gz 2023-09-30T13:58:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105798.log 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.110801.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110801.log.gz 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99987.log 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105798.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105798.log.gz 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107188.log 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99987.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99987.log.gz 2023-09-30T13:58:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87284.log 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107188.log.gz 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106153.log 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.87284.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87284.log.gz 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96744.log 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106153.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106153.log.gz 2023-09-30T13:58:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93275.log 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96744.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96744.log.gz 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101133.log 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93275.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93275.log.gz 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99262.log 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101133.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101133.log.gz 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106111.log 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99262.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99262.log.gz 2023-09-30T13:58:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102505.log 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106111.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106111.log.gz 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108852.log 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102505.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102505.log.gz 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108852.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108852.log.gz 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98842.log 2023-09-30T13:58:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.a.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103605.log 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98842.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98842.log.gz 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95826.log 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103605.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103605.log.gz 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100502.log 2023-09-30T13:58:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95826.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95826.log.gz 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98716.log 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100502.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100502.log.gz 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97544.log 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98716.log.gz 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109621.log 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97544.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97544.log.gz 2023-09-30T13:58:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109621.log.gz 2023-09-30T13:58:53.828 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T13:58:53.904 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-09-30T13:58:53.947 INFO:teuthology.orchestra.run.smithi062.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T13:58:54.986 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T13:58:55.023 INFO:teuthology.orchestra.run.smithi135.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-09-30T13:58:55.174 INFO:teuthology.orchestra.run.smithi135.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-09-30T13:58:55.308 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T13:58:55.487 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-09-30T13:58:55.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-09-30T13:58:55.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-09-30T13:58:55.691 INFO:teuthology.orchestra.run.smithi062.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-30T13:58:55.795 INFO:teuthology.orchestra.run.smithi135.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-09-30T13:58:56.259 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T13:58:58.050 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.108569.log.gz 2023-09-30T13:58:58.052 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-09-30T13:58:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m4.533s 2023-09-30T13:58:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m12.775s 2023-09-30T13:58:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.605s 2023-09-30T13:59:02.026 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-09-30T13:59:02.028 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-09-30T13:59:02.028 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m8.486s 2023-09-30T13:59:02.028 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m15.596s 2023-09-30T13:59:02.029 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.529s 2023-09-30T13:59:02.029 INFO:tasks.ceph:Archiving logs... 2023-09-30T13:59:02.029 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi062/log 2023-09-30T13:59:02.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T13:59:04.081 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi135/log 2023-09-30T13:59:04.082 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T13:59:06.274 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T13:59:06.286 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T13:59:06.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T13:59:06.289 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T13:59:06.373 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T13:59:06.382 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T13:59:06.382 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T13:59:06.385 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T13:59:06.399 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2023-09-30T13:59:06.401 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2023-09-30T13:59:06.404 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T13:59:06.404 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2023-09-30T13:59:06.404 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 +767us[ +767us] +/- 71ms 2023-09-30T13:59:06.404 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1026us[-1026us] +/- 49ms 2023-09-30T13:59:06.405 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +904us[ +904us] +/- 86ms 2023-09-30T13:59:06.405 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:59:06.406 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T13:59:06.406 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-09-30T13:59:06.407 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 19 +767us[ +767us] +/- 71ms 2023-09-30T13:59:06.407 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1017us[-1009us] +/- 49ms 2023-09-30T13:59:06.407 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +915us[ +915us] +/- 86ms 2023-09-30T13:59:06.407 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T13:59:06.407 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T13:59:06.416 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T13:59:06.417 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T13:59:06.426 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T13:59:06.564 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T13:59:06.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T13:59:06.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:59:06.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T13:59:06.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:59:06.735 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T13:59:06.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T13:59:06.754 INFO:teuthology.task.internal:Duration was 742.638924 seconds 2023-09-30T13:59:06.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T13:59:06.764 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T13:59:06.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T13:59:06.766 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T13:59:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T13:59:06.819 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T13:59:07.121 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T13:59:07.121 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2023-09-30T13:59:07.121 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T13:59:07.142 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-09-30T13:59:07.142 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T13:59:07.178 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T13:59:07.178 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T13:59:07.184 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T13:59:07.247 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T13:59:07.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T13:59:07.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T13:59:07.382 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T13:59:07.395 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T13:59:07.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T13:59:07.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T13:59:07.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T13:59:07.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T13:59:07.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T13:59:07.497 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2023-09-30T13:59:07.521 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-09-30T13:59:07.537 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T13:59:07.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:59:07.571 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T13:59:07.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T13:59:07.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T13:59:07.602 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T13:59:07.602 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi062 2023-09-30T13:59:07.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T13:59:07.655 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589/remote/smithi135 2023-09-30T13:59:07.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T13:59:07.690 INFO:teuthology.task.internal:Removing archive directory... 2023-09-30T13:59:07.691 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T13:59:07.693 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T13:59:07.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T13:59:07.750 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T13:59:07.751 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T13:59:07.760 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T13:59:07.761 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T13:59:07.763 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T13:59:07.775 INFO:teuthology.orchestra.run.smithi062.stdout: 265241 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 13:59 /home/ubuntu/cephtest 2023-09-30T13:59:07.793 INFO:teuthology.orchestra.run.smithi135.stdout: 265981 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 13:59 /home/ubuntu/cephtest 2023-09-30T13:59:07.794 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T13:59:07.805 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T13:59:07.827 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T13:59:07.848 DEBUG:teuthology.nuke:shortname: smithi062 2023-09-30T13:59:07.849 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T13:59:07.871 DEBUG:teuthology.nuke:shortname: smithi135 2023-09-30T13:59:07.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T13:59:07.874 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 13:38:18.811613', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGZBAhHPuluu1uEAN7RJbWAWb9Rc1RiIZ09OFcjEkpCMJtg6ZtvAu6tQxSvbIICTn7Y1fDINEVlPDyrrlnSbM0='} 2023-09-30T13:59:07.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:46:13-fs-main-distro-default-smithi/7407589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 13:38:18.813095', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPRhBi4DeLtpJNYmZrP4yTEJzTwCziio4JdbwekYe9qRFGbHPgD3JmLuig9RWJKPhQGu+FfG8Rs+h7gr3F4C/q4='} 2023-09-30T13:59:07.930 INFO:teuthology.orchestra.console.smithi062:Power off 2023-09-30T13:59:07.930 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T13:59:07.956 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-09-30T13:59:07.957 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:07.973 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-30T13:59:07.973 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T13:59:07.983 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-09-30T13:59:07.998 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-30T13:59:07.998 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:08.021 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-30T13:59:11.986 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:12.022 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:12.098 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-09-30T13:59:12.133 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-30T13:59:16.100 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:16.134 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T13:59:16.210 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-09-30T13:59:16.244 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-30T13:59:16.312 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-09-30T13:59:16.346 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-30T13:59:16.451 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} duration: 742.6389236450195 failure_reason: 'Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=547c3459bc534397b905c53a01348f19 status: fail success: false 2023-09-30T13:59:16.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T13:59:16.530 INFO:teuthology.run:FAIL